Attachment 1454623 Details for Bug 1595206 – cinder-scheduler.log

cinder-scheduler.log

cinder-scheduler.log (text/plain), 4.56 MB, created by Raviv Bar-Tal on 2018-06-26 11:16:45 UTC

(hide)

Description:

Filename:

MIME Type:

Creator: Raviv Bar-Tal

Created: 2018-06-26 11:16:45 UTC

Size: 4.56 MB

patch

obsolete

>2018-06-25 11:22:22.636 1 INFO cinder.rpc [req-0159646b-32fd-4fab-ae74-f2beefb58965 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 11:22:22.643 1 INFO cinder.rpc [req-0159646b-32fd-4fab-ae74-f2beefb58965 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 11:22:22.657 1 INFO cinder.rpc [req-0159646b-32fd-4fab-ae74-f2beefb58965 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 11:22:22.662 1 INFO cinder.rpc [req-0159646b-32fd-4fab-ae74-f2beefb58965 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 11:22:22.718 1 WARNING oslo_config.cfg [req-0159646b-32fd-4fab-ae74-f2beefb58965 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 11:22:22.720 1 WARNING oslo_config.cfg [req-0159646b-32fd-4fab-ae74-f2beefb58965 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 11:22:22.720 1 WARNING oslo_config.cfg [req-0159646b-32fd-4fab-ae74-f2beefb58965 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 11:22:22.721 1 WARNING oslo_config.cfg [req-0159646b-32fd-4fab-ae74-f2beefb58965 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 11:22:22.726 1 WARNING oslo_config.cfg [req-0159646b-32fd-4fab-ae74-f2beefb58965 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 11:22:22.728 1 WARNING oslo_config.cfg [req-0159646b-32fd-4fab-ae74-f2beefb58965 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 11:22:22.731 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 11:22:22.737 1 INFO cinder.manager [req-a15f4a46-5aed-4743-aec9-609070222880 - - - - -] Initiating service 5 cleanup
>2018-06-25 11:22:22.743 1 INFO cinder.manager [req-a15f4a46-5aed-4743-aec9-609070222880 - - - - -] Service 5 cleanup completed.
>2018-06-25 11:24:07.219 1 INFO cinder.message.api [req-54172dff-1e05-4e73-a4b2-f34e16ebe2d8 - - - - -] Deleted 0 expired messages.
>2018-06-25 14:55:15.988 1 WARNING py.warnings [-] /usr/lib/python2.7/site-packages/amqp/connection.py:304: AMQPDeprecationWarning: The .transport attribute on the connection was accessed before
>the connection was established.  This is supported for now, but will
>be deprecated in amqp 2.2.0.
>
>Since amqp 2.0 you have to explicitly call Connection.connect()
>before using the connection.
>
>  W_FORCE_CONNECT.format(attr=attr)))
>: error: [Errno 104] Connection reset by peer
>2018-06-25 14:55:16.011 1 ERROR oslo.messaging._drivers.impl_rabbit [-] [3991bf3a-b407-4579-981b-de08bf356e4f] AMQP server on controller-1.internalapi.localdomain:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds. Client port: None: error: [Errno 104] Connection reset by peer
>2018-06-25 14:55:17.043 1 ERROR oslo.messaging._drivers.impl_rabbit [-] [3991bf3a-b407-4579-981b-de08bf356e4f] AMQP server on controller-1.internalapi.localdomain:5672 is unreachable: [Errno 111] ECONNREFUSED. Trying again in 1 seconds. Client port: None: error: [Errno 111] ECONNREFUSED
>2018-06-25 14:55:18.114 1 INFO oslo.messaging._drivers.impl_rabbit [-] [3991bf3a-b407-4579-981b-de08bf356e4f] Reconnected to AMQP server on controller-2.internalapi.localdomain:5672 via [amqp] client with port 43936.
>2018-06-25 14:55:26.409 1 WARNING oslo.messaging._drivers.impl_rabbit [-] Unexpected error during heartbeart thread processing, retrying...: error: [Errno 104] Connection reset by peer
>2018-06-25 14:55:41.423 1 WARNING oslo.messaging._drivers.impl_rabbit [-] Unexpected error during heartbeart thread processing, retrying...: error: [Errno 111] ECONNREFUSED
>2018-06-25 14:55:56.438 1 WARNING oslo.messaging._drivers.impl_rabbit [-] Unexpected error during heartbeart thread processing, retrying...: error: [Errno 111] ECONNREFUSED
>2018-06-25 14:56:11.450 1 WARNING oslo.messaging._drivers.impl_rabbit [-] Unexpected error during heartbeart thread processing, retrying...: error: [Errno 111] ECONNREFUSED
>2018-06-25 14:56:26.462 1 WARNING oslo.messaging._drivers.impl_rabbit [-] Unexpected error during heartbeart thread processing, retrying...: error: [Errno 111] ECONNREFUSED
>2018-06-25 14:56:41.473 1 WARNING oslo.messaging._drivers.impl_rabbit [-] Unexpected error during heartbeart thread processing, retrying...: error: [Errno 111] ECONNREFUSED
>2018-06-25 14:56:56.490 1 WARNING oslo.messaging._drivers.impl_rabbit [-] Unexpected error during heartbeart thread processing, retrying...: error: [Errno 111] ECONNREFUSED
>2018-06-25 14:57:11.504 1 WARNING oslo.messaging._drivers.impl_rabbit [-] Unexpected error during heartbeart thread processing, retrying...: error: [Errno 111] ECONNREFUSED
>2018-06-25 14:57:26.514 1 WARNING oslo.messaging._drivers.impl_rabbit [-] Unexpected error during heartbeart thread processing, retrying...: error: [Errno 111] ECONNREFUSED
>2018-06-25 14:57:41.526 1 WARNING oslo.messaging._drivers.impl_rabbit [-] Unexpected error during heartbeart thread processing, retrying...: error: [Errno 111] ECONNREFUSED
>2018-06-25 14:57:56.542 1 WARNING oslo.messaging._drivers.impl_rabbit [-] Unexpected error during heartbeart thread processing, retrying...: error: [Errno 111] ECONNREFUSED
>2018-06-25 14:58:11.554 1 WARNING oslo.messaging._drivers.impl_rabbit [-] Unexpected error during heartbeart thread processing, retrying...: error: [Errno 111] ECONNREFUSED
>2018-06-25 14:58:26.566 1 WARNING oslo.messaging._drivers.impl_rabbit [-] Unexpected error during heartbeart thread processing, retrying...: error: [Errno 111] ECONNREFUSED
>2018-06-25 14:58:41.578 1 WARNING oslo.messaging._drivers.impl_rabbit [-] Unexpected error during heartbeart thread processing, retrying...: error: [Errno 111] ECONNREFUSED
>2018-06-25 14:58:56.594 1 WARNING oslo.messaging._drivers.impl_rabbit [-] Unexpected error during heartbeart thread processing, retrying...: error: [Errno 111] ECONNREFUSED
>2018-06-25 14:59:11.608 1 WARNING oslo.messaging._drivers.impl_rabbit [-] Unexpected error during heartbeart thread processing, retrying...: error: [Errno 111] ECONNREFUSED
>2018-06-25 14:59:26.619 1 WARNING oslo.messaging._drivers.impl_rabbit [-] Unexpected error during heartbeart thread processing, retrying...: error: [Errno 111] ECONNREFUSED
>2018-06-25 14:59:41.631 1 WARNING oslo.messaging._drivers.impl_rabbit [-] Unexpected error during heartbeart thread processing, retrying...: error: [Errno 111] ECONNREFUSED
>2018-06-25 14:59:56.648 1 WARNING oslo.messaging._drivers.impl_rabbit [-] Unexpected error during heartbeart thread processing, retrying...: error: [Errno 111] ECONNREFUSED
>2018-06-25 15:00:11.662 1 WARNING oslo.messaging._drivers.impl_rabbit [-] Unexpected error during heartbeart thread processing, retrying...: error: [Errno 111] ECONNREFUSED
>2018-06-25 15:00:26.674 1 WARNING oslo.messaging._drivers.impl_rabbit [-] Unexpected error during heartbeart thread processing, retrying...: error: [Errno 111] ECONNREFUSED
>2018-06-25 15:00:41.687 1 WARNING oslo.messaging._drivers.impl_rabbit [-] Unexpected error during heartbeart thread processing, retrying...: error: [Errno 111] ECONNREFUSED
>2018-06-25 15:00:56.703 1 WARNING oslo.messaging._drivers.impl_rabbit [-] Unexpected error during heartbeart thread processing, retrying...: error: [Errno 111] ECONNREFUSED
>2018-06-25 15:01:11.715 1 WARNING oslo.messaging._drivers.impl_rabbit [-] Unexpected error during heartbeart thread processing, retrying...: error: [Errno 111] ECONNREFUSED
>2018-06-25 15:01:26.729 1 WARNING oslo.messaging._drivers.impl_rabbit [-] Unexpected error during heartbeart thread processing, retrying...: error: [Errno 111] ECONNREFUSED
>2018-06-25 15:01:41.742 1 WARNING oslo.messaging._drivers.impl_rabbit [-] Unexpected error during heartbeart thread processing, retrying...: error: [Errno 111] ECONNREFUSED
>2018-06-25 15:01:56.757 1 WARNING oslo.messaging._drivers.impl_rabbit [-] Unexpected error during heartbeart thread processing, retrying...: error: [Errno 111] ECONNREFUSED
>2018-06-25 15:02:11.768 1 WARNING oslo.messaging._drivers.impl_rabbit [-] Unexpected error during heartbeart thread processing, retrying...: error: [Errno 111] ECONNREFUSED
>2018-06-25 15:02:26.779 1 WARNING oslo.messaging._drivers.impl_rabbit [-] Unexpected error during heartbeart thread processing, retrying...: error: [Errno 111] ECONNREFUSED
>2018-06-25 15:02:41.793 1 WARNING oslo.messaging._drivers.impl_rabbit [-] Unexpected error during heartbeart thread processing, retrying...: error: [Errno 111] ECONNREFUSED
>2018-06-25 15:02:56.811 1 WARNING oslo.messaging._drivers.impl_rabbit [-] Unexpected error during heartbeart thread processing, retrying...: error: [Errno 111] ECONNREFUSED
>2018-06-25 15:03:11.823 1 WARNING oslo.messaging._drivers.impl_rabbit [-] Unexpected error during heartbeart thread processing, retrying...: error: [Errno 111] ECONNREFUSED
>2018-06-25 15:03:26.834 1 WARNING oslo.messaging._drivers.impl_rabbit [-] Unexpected error during heartbeart thread processing, retrying...: error: [Errno 111] ECONNREFUSED
>2018-06-25 15:03:41.847 1 WARNING oslo.messaging._drivers.impl_rabbit [-] Unexpected error during heartbeart thread processing, retrying...: error: [Errno 111] ECONNREFUSED
>2018-06-25 15:03:56.867 1 WARNING oslo.messaging._drivers.impl_rabbit [-] Unexpected error during heartbeart thread processing, retrying...: error: [Errno 111] ECONNREFUSED
>2018-06-25 15:04:11.881 1 WARNING oslo.messaging._drivers.impl_rabbit [-] Unexpected error during heartbeart thread processing, retrying...: error: [Errno 111] ECONNREFUSED
>2018-06-25 15:04:41.901 1 WARNING oslo.messaging._drivers.impl_rabbit [-] Unexpected error during heartbeart thread processing, retrying...: error: [Errno 104] Connection reset by peer
>2018-06-25 15:17:39.041 1 ERROR oslo_db.sqlalchemy.engines [req-3343125c-ad40-49c0-8bbc-4919b80ee7f6 - - - - -] Database connection was found disconnected; reconnecting: DBConnectionError: (pymysql.err.OperationalError) (2013, 'Lost connection to MySQL server during query') [SQL: u'SELECT 1'] (Background on this error at: http://sqlalche.me/e/e3q8)
>2018-06-25 15:17:39.041 1 ERROR oslo_db.sqlalchemy.engines Traceback (most recent call last):
>2018-06-25 15:17:39.041 1 ERROR oslo_db.sqlalchemy.engines   File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/engines.py", line 73, in _connect_ping_listener
>2018-06-25 15:17:39.041 1 ERROR oslo_db.sqlalchemy.engines     connection.scalar(select([1]))
>2018-06-25 15:17:39.041 1 ERROR oslo_db.sqlalchemy.engines   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 880, in scalar
>2018-06-25 15:17:39.041 1 ERROR oslo_db.sqlalchemy.engines     return self.execute(object, *multiparams, **params).scalar()
>2018-06-25 15:17:39.041 1 ERROR oslo_db.sqlalchemy.engines   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 948, in execute
>2018-06-25 15:17:39.041 1 ERROR oslo_db.sqlalchemy.engines     return meth(self, multiparams, params)
>2018-06-25 15:17:39.041 1 ERROR oslo_db.sqlalchemy.engines   File "/usr/lib64/python2.7/site-packages/sqlalchemy/sql/elements.py", line 269, in _execute_on_connection
>2018-06-25 15:17:39.041 1 ERROR oslo_db.sqlalchemy.engines     return connection._execute_clauseelement(self, multiparams, params)
>2018-06-25 15:17:39.041 1 ERROR oslo_db.sqlalchemy.engines   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1060, in _execute_clauseelement
>2018-06-25 15:17:39.041 1 ERROR oslo_db.sqlalchemy.engines     compiled_sql, distilled_params
>2018-06-25 15:17:39.041 1 ERROR oslo_db.sqlalchemy.engines   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1200, in _execute_context
>2018-06-25 15:17:39.041 1 ERROR oslo_db.sqlalchemy.engines     context)
>2018-06-25 15:17:39.041 1 ERROR oslo_db.sqlalchemy.engines   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1409, in _handle_dbapi_exception
>2018-06-25 15:17:39.041 1 ERROR oslo_db.sqlalchemy.engines     util.raise_from_cause(newraise, exc_info)
>2018-06-25 15:17:39.041 1 ERROR oslo_db.sqlalchemy.engines   File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/compat.py", line 203, in raise_from_cause
>2018-06-25 15:17:39.041 1 ERROR oslo_db.sqlalchemy.engines     reraise(type(exception), exception, tb=exc_tb, cause=cause)
>2018-06-25 15:17:39.041 1 ERROR oslo_db.sqlalchemy.engines   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1193, in _execute_context
>2018-06-25 15:17:39.041 1 ERROR oslo_db.sqlalchemy.engines     context)
>2018-06-25 15:17:39.041 1 ERROR oslo_db.sqlalchemy.engines   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/default.py", line 507, in do_execute
>2018-06-25 15:17:39.041 1 ERROR oslo_db.sqlalchemy.engines     cursor.execute(statement, parameters)
>2018-06-25 15:17:39.041 1 ERROR oslo_db.sqlalchemy.engines   File "/usr/lib/python2.7/site-packages/pymysql/cursors.py", line 166, in execute
>2018-06-25 15:17:39.041 1 ERROR oslo_db.sqlalchemy.engines     result = self._query(query)
>2018-06-25 15:17:39.041 1 ERROR oslo_db.sqlalchemy.engines   File "/usr/lib/python2.7/site-packages/pymysql/cursors.py", line 322, in _query
>2018-06-25 15:17:39.041 1 ERROR oslo_db.sqlalchemy.engines     conn.query(q)
>2018-06-25 15:17:39.041 1 ERROR oslo_db.sqlalchemy.engines   File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 856, in query
>2018-06-25 15:17:39.041 1 ERROR oslo_db.sqlalchemy.engines     self._affected_rows = self._read_query_result(unbuffered=unbuffered)
>2018-06-25 15:17:39.041 1 ERROR oslo_db.sqlalchemy.engines   File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 1057, in _read_query_result
>2018-06-25 15:17:39.041 1 ERROR oslo_db.sqlalchemy.engines     result.read()
>2018-06-25 15:17:39.041 1 ERROR oslo_db.sqlalchemy.engines   File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 1340, in read
>2018-06-25 15:17:39.041 1 ERROR oslo_db.sqlalchemy.engines     first_packet = self.connection._read_packet()
>2018-06-25 15:17:39.041 1 ERROR oslo_db.sqlalchemy.engines   File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 987, in _read_packet
>2018-06-25 15:17:39.041 1 ERROR oslo_db.sqlalchemy.engines     packet_header = self._read_bytes(4)
>2018-06-25 15:17:39.041 1 ERROR oslo_db.sqlalchemy.engines   File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 1033, in _read_bytes
>2018-06-25 15:17:39.041 1 ERROR oslo_db.sqlalchemy.engines     CR.CR_SERVER_LOST, "Lost connection to MySQL server during query")
>2018-06-25 15:17:39.041 1 ERROR oslo_db.sqlalchemy.engines DBConnectionError: (pymysql.err.OperationalError) (2013, 'Lost connection to MySQL server during query') [SQL: u'SELECT 1'] (Background on this error at: http://sqlalche.me/e/e3q8)
>2018-06-25 15:17:39.041 1 ERROR oslo_db.sqlalchemy.engines 
>2018-06-25 15:17:39.047 1 ERROR cinder.service [req-3343125c-ad40-49c0-8bbc-4919b80ee7f6 - - - - -] model server went away: DBConnectionError: (pymysql.err.OperationalError) (2003, "Can't connect to MySQL server on '172.17.1.18' ([Errno 111] ECONNREFUSED)") [SQL: u'SELECT 1'] (Background on this error at: http://sqlalche.me/e/e3q8)
>2018-06-25 15:17:39.047 1 ERROR cinder.service Traceback (most recent call last):
>2018-06-25 15:17:39.047 1 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 470, in report_state
>2018-06-25 15:17:39.047 1 ERROR cinder.service     Service.service_id)
>2018-06-25 15:17:39.047 1 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/objects/base.py", line 342, in get_by_id
>2018-06-25 15:17:39.047 1 ERROR cinder.service     orm_obj = db.get_by_id(context, cls.model, id, *args, **kwargs)
>2018-06-25 15:17:39.047 1 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/api.py", line 1777, in get_by_id
>2018-06-25 15:17:39.047 1 ERROR cinder.service     return IMPL.get_by_id(context, model, id, *args, **kwargs)
>2018-06-25 15:17:39.047 1 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 182, in wrapper
>2018-06-25 15:17:39.047 1 ERROR cinder.service     return f(*args, **kwargs)
>2018-06-25 15:17:39.047 1 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 6980, in get_by_id
>2018-06-25 15:17:39.047 1 ERROR cinder.service     return _GET_METHODS[model](context, id, *args, **kwargs)
>2018-06-25 15:17:39.047 1 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 164, in wrapper
>2018-06-25 15:17:39.047 1 ERROR cinder.service     return f(*args, **kwargs)
>2018-06-25 15:17:39.047 1 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 504, in service_get
>2018-06-25 15:17:39.047 1 ERROR cinder.service     service = None if not query else query.first()
>2018-06-25 15:17:39.047 1 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 2778, in first
>2018-06-25 15:17:39.047 1 ERROR cinder.service     ret = list(self[0:1])
>2018-06-25 15:17:39.047 1 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 2570, in __getitem__
>2018-06-25 15:17:39.047 1 ERROR cinder.service     return list(res)
>2018-06-25 15:17:39.047 1 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 2878, in __iter__
>2018-06-25 15:17:39.047 1 ERROR cinder.service     return self._execute_and_instances(context)
>2018-06-25 15:17:39.047 1 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 2899, in _execute_and_instances
>2018-06-25 15:17:39.047 1 ERROR cinder.service     close_with_result=True)
>2018-06-25 15:17:39.047 1 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 2908, in _get_bind_args
>2018-06-25 15:17:39.047 1 ERROR cinder.service     **kw
>2018-06-25 15:17:39.047 1 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 2890, in _connection_from_session
>2018-06-25 15:17:39.047 1 ERROR cinder.service     conn = self.session.connection(**kw)
>2018-06-25 15:17:39.047 1 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/session.py", line 1035, in connection
>2018-06-25 15:17:39.047 1 ERROR cinder.service     execution_options=execution_options)
>2018-06-25 15:17:39.047 1 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/session.py", line 1042, in _connection_for_bind
>2018-06-25 15:17:39.047 1 ERROR cinder.service     conn = engine.contextual_connect(**kw)
>2018-06-25 15:17:39.047 1 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 2125, in contextual_connect
>2018-06-25 15:17:39.047 1 ERROR cinder.service     **kwargs)
>2018-06-25 15:17:39.047 1 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 110, in __init__
>2018-06-25 15:17:39.047 1 ERROR cinder.service     self.dispatch.engine_connect(self, self.__branch)
>2018-06-25 15:17:39.047 1 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/event/attr.py", line 256, in __call__
>2018-06-25 15:17:39.047 1 ERROR cinder.service     fn(*args, **kw)
>2018-06-25 15:17:39.047 1 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/engines.py", line 83, in _connect_ping_listener
>2018-06-25 15:17:39.047 1 ERROR cinder.service     connection.scalar(select([1]))
>2018-06-25 15:17:39.047 1 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 880, in scalar
>2018-06-25 15:17:39.047 1 ERROR cinder.service     return self.execute(object, *multiparams, **params).scalar()
>2018-06-25 15:17:39.047 1 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 948, in execute
>2018-06-25 15:17:39.047 1 ERROR cinder.service     return meth(self, multiparams, params)
>2018-06-25 15:17:39.047 1 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/sql/elements.py", line 269, in _execute_on_connection
>2018-06-25 15:17:39.047 1 ERROR cinder.service     return connection._execute_clauseelement(self, multiparams, params)
>2018-06-25 15:17:39.047 1 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1060, in _execute_clauseelement
>2018-06-25 15:17:39.047 1 ERROR cinder.service     compiled_sql, distilled_params
>2018-06-25 15:17:39.047 1 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1132, in _execute_context
>2018-06-25 15:17:39.047 1 ERROR cinder.service     None, None)
>2018-06-25 15:17:39.047 1 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1409, in _handle_dbapi_exception
>2018-06-25 15:17:39.047 1 ERROR cinder.service     util.raise_from_cause(newraise, exc_info)
>2018-06-25 15:17:39.047 1 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/compat.py", line 203, in raise_from_cause
>2018-06-25 15:17:39.047 1 ERROR cinder.service     reraise(type(exception), exception, tb=exc_tb, cause=cause)
>2018-06-25 15:17:39.047 1 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1125, in _execute_context
>2018-06-25 15:17:39.047 1 ERROR cinder.service     conn = self._revalidate_connection()
>2018-06-25 15:17:39.047 1 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 429, in _revalidate_connection
>2018-06-25 15:17:39.047 1 ERROR cinder.service     self.__connection = self.engine.raw_connection(_connection=self)
>2018-06-25 15:17:39.047 1 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 2188, in raw_connection
>2018-06-25 15:17:39.047 1 ERROR cinder.service     self.pool.unique_connection, _connection)
>2018-06-25 15:17:39.047 1 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 2164, in _wrap_pool_connect
>2018-06-25 15:17:39.047 1 ERROR cinder.service     util.reraise(*sys.exc_info())
>2018-06-25 15:17:39.047 1 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 2158, in _wrap_pool_connect
>2018-06-25 15:17:39.047 1 ERROR cinder.service     return fn()
>2018-06-25 15:17:39.047 1 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 345, in unique_connection
>2018-06-25 15:17:39.047 1 ERROR cinder.service     return _ConnectionFairy._checkout(self)
>2018-06-25 15:17:39.047 1 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 782, in _checkout
>2018-06-25 15:17:39.047 1 ERROR cinder.service     fairy = _ConnectionRecord.checkout(pool)
>2018-06-25 15:17:39.047 1 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 537, in checkout
>2018-06-25 15:17:39.047 1 ERROR cinder.service     rec.checkin()
>2018-06-25 15:17:39.047 1 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/langhelpers.py", line 66, in __exit__
>2018-06-25 15:17:39.047 1 ERROR cinder.service     compat.reraise(exc_type, exc_value, exc_tb)
>2018-06-25 15:17:39.047 1 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 534, in checkout
>2018-06-25 15:17:39.047 1 ERROR cinder.service     dbapi_connection = rec.get_connection()
>2018-06-25 15:17:39.047 1 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 623, in get_connection
>2018-06-25 15:17:39.047 1 ERROR cinder.service     self.__connect()
>2018-06-25 15:17:39.047 1 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 667, in __connect
>2018-06-25 15:17:39.047 1 ERROR cinder.service     connection = pool._invoke_creator(self)
>2018-06-25 15:17:39.047 1 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/strategies.py", line 105, in connect
>2018-06-25 15:17:39.047 1 ERROR cinder.service     return dialect.connect(*cargs, **cparams)
>2018-06-25 15:17:39.047 1 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/default.py", line 410, in connect
>2018-06-25 15:17:39.047 1 ERROR cinder.service     return self.dbapi.connect(*cargs, **cparams)
>2018-06-25 15:17:39.047 1 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/pymysql/__init__.py", line 90, in Connect
>2018-06-25 15:17:39.047 1 ERROR cinder.service     return Connection(*args, **kwargs)
>2018-06-25 15:17:39.047 1 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 706, in __init__
>2018-06-25 15:17:39.047 1 ERROR cinder.service     self.connect()
>2018-06-25 15:17:39.047 1 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 963, in connect
>2018-06-25 15:17:39.047 1 ERROR cinder.service     raise exc
>2018-06-25 15:17:39.047 1 ERROR cinder.service DBConnectionError: (pymysql.err.OperationalError) (2003, "Can't connect to MySQL server on '172.17.1.18' ([Errno 111] ECONNREFUSED)") [SQL: u'SELECT 1'] (Background on this error at: http://sqlalche.me/e/e3q8)
>2018-06-25 15:17:39.047 1 ERROR cinder.service 
>2018-06-25 15:17:59.053 1 ERROR cinder.service [req-3343125c-ad40-49c0-8bbc-4919b80ee7f6 - - - - -] Recovered model server connection!
>2018-06-25 15:43:08.863 1 INFO cinder.rpc [req-e367e826-4217-475d-8923-d006737de119 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 15:43:08.879 1 INFO cinder.rpc [req-e367e826-4217-475d-8923-d006737de119 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 15:43:08.938 1 INFO cinder.rpc [req-e367e826-4217-475d-8923-d006737de119 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 15:43:08.961 1 INFO cinder.rpc [req-e367e826-4217-475d-8923-d006737de119 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 15:43:09.064 1 WARNING oslo_config.cfg [req-e367e826-4217-475d-8923-d006737de119 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 15:43:09.066 1 WARNING oslo_config.cfg [req-e367e826-4217-475d-8923-d006737de119 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 15:43:09.066 1 WARNING oslo_config.cfg [req-e367e826-4217-475d-8923-d006737de119 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 15:43:09.067 1 WARNING oslo_config.cfg [req-e367e826-4217-475d-8923-d006737de119 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 15:43:09.114 1 WARNING oslo_config.cfg [req-e367e826-4217-475d-8923-d006737de119 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 15:43:09.116 1 WARNING oslo_config.cfg [req-e367e826-4217-475d-8923-d006737de119 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 15:43:09.136 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 15:43:09.156 1 INFO cinder.manager [req-8067e6b3-712c-4466-bf9b-5c357ecf4196 - - - - -] Initiating service 5 cleanup
>2018-06-25 15:43:09.174 1 INFO cinder.manager [req-8067e6b3-712c-4466-bf9b-5c357ecf4196 - - - - -] Service 5 cleanup completed.
>2018-06-25 15:45:08.650 1 INFO cinder.message.api [req-0a824a2c-e514-4b1e-b7b6-c65aeb6693ae - - - - -] Deleted 0 expired messages.
>2018-06-25 15:59:38.073 1 INFO cinder.rpc [req-9f9dd4df-0fdd-4a00-b9b3-d63727771ca0 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 15:59:38.094 1 INFO cinder.rpc [req-9f9dd4df-0fdd-4a00-b9b3-d63727771ca0 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 15:59:38.131 1 INFO cinder.rpc [req-9f9dd4df-0fdd-4a00-b9b3-d63727771ca0 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 15:59:38.138 1 INFO cinder.rpc [req-9f9dd4df-0fdd-4a00-b9b3-d63727771ca0 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 15:59:38.230 1 WARNING oslo_config.cfg [req-9f9dd4df-0fdd-4a00-b9b3-d63727771ca0 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 15:59:38.233 1 WARNING oslo_config.cfg [req-9f9dd4df-0fdd-4a00-b9b3-d63727771ca0 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 15:59:38.233 1 WARNING oslo_config.cfg [req-9f9dd4df-0fdd-4a00-b9b3-d63727771ca0 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 15:59:38.234 1 WARNING oslo_config.cfg [req-9f9dd4df-0fdd-4a00-b9b3-d63727771ca0 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 15:59:38.239 1 WARNING oslo_config.cfg [req-9f9dd4df-0fdd-4a00-b9b3-d63727771ca0 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 15:59:38.241 1 WARNING oslo_config.cfg [req-9f9dd4df-0fdd-4a00-b9b3-d63727771ca0 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 15:59:38.244 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 15:59:38.261 1 INFO cinder.manager [req-3b2351fa-372a-4cdc-8373-4fab3dbcdba7 - - - - -] Initiating service 5 cleanup
>2018-06-25 15:59:38.276 1 INFO cinder.manager [req-3b2351fa-372a-4cdc-8373-4fab3dbcdba7 - - - - -] Service 5 cleanup completed.
>2018-06-25 16:01:31.736 1 INFO cinder.message.api [req-d3761c90-438a-4807-b172-7483b331956f - - - - -] Deleted 0 expired messages.
>2018-06-25 17:02:43.576 1 WARNING py.warnings [-] /usr/lib/python2.7/site-packages/amqp/connection.py:304: AMQPDeprecationWarning: The .transport attribute on the connection was accessed before
>the connection was established.  This is supported for now, but will
>be deprecated in amqp 2.2.0.
>
>Since amqp 2.0 you have to explicitly call Connection.connect()
>before using the connection.
>
>  W_FORCE_CONNECT.format(attr=attr)))
>: IOError: Socket closed
>2018-06-25 17:02:43.583 1 ERROR oslo.messaging._drivers.impl_rabbit [-] [c91a565e-0538-4017-a2fa-55869ac8ceb3] AMQP server controller-0.internalapi.localdomain:5672 closed the connection. Check login credentials: Socket closed: IOError: Socket closed
>2018-06-25 17:02:56.250 1 INFO oslo.messaging._drivers.impl_rabbit [-] [c91a565e-0538-4017-a2fa-55869ac8ceb3] Reconnected to AMQP server on controller-0.internalapi.localdomain:5672 via [amqp] client with port 60776.
>2018-06-25 17:03:25.956 1 WARNING oslo.messaging._drivers.impl_rabbit [-] Unexpected error during heartbeart thread processing, retrying...: error: [Errno 104] Connection reset by peer
>2018-06-25 17:03:39.369 1 ERROR oslo_db.sqlalchemy.engines [req-55bd0b5b-0ea3-46a6-904e-c322a4f22d44 - - - - -] Database connection was found disconnected; reconnecting: DBConnectionError: (pymysql.err.OperationalError) (2013, 'Lost connection to MySQL server during query') [SQL: u'SELECT 1'] (Background on this error at: http://sqlalche.me/e/e3q8)
>2018-06-25 17:03:39.369 1 ERROR oslo_db.sqlalchemy.engines Traceback (most recent call last):
>2018-06-25 17:03:39.369 1 ERROR oslo_db.sqlalchemy.engines   File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/engines.py", line 73, in _connect_ping_listener
>2018-06-25 17:03:39.369 1 ERROR oslo_db.sqlalchemy.engines     connection.scalar(select([1]))
>2018-06-25 17:03:39.369 1 ERROR oslo_db.sqlalchemy.engines   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 880, in scalar
>2018-06-25 17:03:39.369 1 ERROR oslo_db.sqlalchemy.engines     return self.execute(object, *multiparams, **params).scalar()
>2018-06-25 17:03:39.369 1 ERROR oslo_db.sqlalchemy.engines   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 948, in execute
>2018-06-25 17:03:39.369 1 ERROR oslo_db.sqlalchemy.engines     return meth(self, multiparams, params)
>2018-06-25 17:03:39.369 1 ERROR oslo_db.sqlalchemy.engines   File "/usr/lib64/python2.7/site-packages/sqlalchemy/sql/elements.py", line 269, in _execute_on_connection
>2018-06-25 17:03:39.369 1 ERROR oslo_db.sqlalchemy.engines     return connection._execute_clauseelement(self, multiparams, params)
>2018-06-25 17:03:39.369 1 ERROR oslo_db.sqlalchemy.engines   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1060, in _execute_clauseelement
>2018-06-25 17:03:39.369 1 ERROR oslo_db.sqlalchemy.engines     compiled_sql, distilled_params
>2018-06-25 17:03:39.369 1 ERROR oslo_db.sqlalchemy.engines   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1200, in _execute_context
>2018-06-25 17:03:39.369 1 ERROR oslo_db.sqlalchemy.engines     context)
>2018-06-25 17:03:39.369 1 ERROR oslo_db.sqlalchemy.engines   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1409, in _handle_dbapi_exception
>2018-06-25 17:03:39.369 1 ERROR oslo_db.sqlalchemy.engines     util.raise_from_cause(newraise, exc_info)
>2018-06-25 17:03:39.369 1 ERROR oslo_db.sqlalchemy.engines   File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/compat.py", line 203, in raise_from_cause
>2018-06-25 17:03:39.369 1 ERROR oslo_db.sqlalchemy.engines     reraise(type(exception), exception, tb=exc_tb, cause=cause)
>2018-06-25 17:03:39.369 1 ERROR oslo_db.sqlalchemy.engines   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1193, in _execute_context
>2018-06-25 17:03:39.369 1 ERROR oslo_db.sqlalchemy.engines     context)
>2018-06-25 17:03:39.369 1 ERROR oslo_db.sqlalchemy.engines   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/default.py", line 507, in do_execute
>2018-06-25 17:03:39.369 1 ERROR oslo_db.sqlalchemy.engines     cursor.execute(statement, parameters)
>2018-06-25 17:03:39.369 1 ERROR oslo_db.sqlalchemy.engines   File "/usr/lib/python2.7/site-packages/pymysql/cursors.py", line 166, in execute
>2018-06-25 17:03:39.369 1 ERROR oslo_db.sqlalchemy.engines     result = self._query(query)
>2018-06-25 17:03:39.369 1 ERROR oslo_db.sqlalchemy.engines   File "/usr/lib/python2.7/site-packages/pymysql/cursors.py", line 322, in _query
>2018-06-25 17:03:39.369 1 ERROR oslo_db.sqlalchemy.engines     conn.query(q)
>2018-06-25 17:03:39.369 1 ERROR oslo_db.sqlalchemy.engines   File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 856, in query
>2018-06-25 17:03:39.369 1 ERROR oslo_db.sqlalchemy.engines     self._affected_rows = self._read_query_result(unbuffered=unbuffered)
>2018-06-25 17:03:39.369 1 ERROR oslo_db.sqlalchemy.engines   File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 1057, in _read_query_result
>2018-06-25 17:03:39.369 1 ERROR oslo_db.sqlalchemy.engines     result.read()
>2018-06-25 17:03:39.369 1 ERROR oslo_db.sqlalchemy.engines   File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 1340, in read
>2018-06-25 17:03:39.369 1 ERROR oslo_db.sqlalchemy.engines     first_packet = self.connection._read_packet()
>2018-06-25 17:03:39.369 1 ERROR oslo_db.sqlalchemy.engines   File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 987, in _read_packet
>2018-06-25 17:03:39.369 1 ERROR oslo_db.sqlalchemy.engines     packet_header = self._read_bytes(4)
>2018-06-25 17:03:39.369 1 ERROR oslo_db.sqlalchemy.engines   File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 1033, in _read_bytes
>2018-06-25 17:03:39.369 1 ERROR oslo_db.sqlalchemy.engines     CR.CR_SERVER_LOST, "Lost connection to MySQL server during query")
>2018-06-25 17:03:39.369 1 ERROR oslo_db.sqlalchemy.engines DBConnectionError: (pymysql.err.OperationalError) (2013, 'Lost connection to MySQL server during query') [SQL: u'SELECT 1'] (Background on this error at: http://sqlalche.me/e/e3q8)
>2018-06-25 17:03:39.369 1 ERROR oslo_db.sqlalchemy.engines 
>2018-06-25 17:03:39.375 1 ERROR cinder.service [req-55bd0b5b-0ea3-46a6-904e-c322a4f22d44 - - - - -] model server went away: DBConnectionError: (pymysql.err.OperationalError) (2003, "Can't connect to MySQL server on '172.17.1.18' ([Errno 111] ECONNREFUSED)") [SQL: u'SELECT 1'] (Background on this error at: http://sqlalche.me/e/e3q8)
>2018-06-25 17:03:39.375 1 ERROR cinder.service Traceback (most recent call last):
>2018-06-25 17:03:39.375 1 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 470, in report_state
>2018-06-25 17:03:39.375 1 ERROR cinder.service     Service.service_id)
>2018-06-25 17:03:39.375 1 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/objects/base.py", line 342, in get_by_id
>2018-06-25 17:03:39.375 1 ERROR cinder.service     orm_obj = db.get_by_id(context, cls.model, id, *args, **kwargs)
>2018-06-25 17:03:39.375 1 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/api.py", line 1777, in get_by_id
>2018-06-25 17:03:39.375 1 ERROR cinder.service     return IMPL.get_by_id(context, model, id, *args, **kwargs)
>2018-06-25 17:03:39.375 1 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 182, in wrapper
>2018-06-25 17:03:39.375 1 ERROR cinder.service     return f(*args, **kwargs)
>2018-06-25 17:03:39.375 1 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 6980, in get_by_id
>2018-06-25 17:03:39.375 1 ERROR cinder.service     return _GET_METHODS[model](context, id, *args, **kwargs)
>2018-06-25 17:03:39.375 1 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 164, in wrapper
>2018-06-25 17:03:39.375 1 ERROR cinder.service     return f(*args, **kwargs)
>2018-06-25 17:03:39.375 1 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/cinder/db/sqlalchemy/api.py", line 504, in service_get
>2018-06-25 17:03:39.375 1 ERROR cinder.service     service = None if not query else query.first()
>2018-06-25 17:03:39.375 1 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 2778, in first
>2018-06-25 17:03:39.375 1 ERROR cinder.service     ret = list(self[0:1])
>2018-06-25 17:03:39.375 1 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 2570, in __getitem__
>2018-06-25 17:03:39.375 1 ERROR cinder.service     return list(res)
>2018-06-25 17:03:39.375 1 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 2878, in __iter__
>2018-06-25 17:03:39.375 1 ERROR cinder.service     return self._execute_and_instances(context)
>2018-06-25 17:03:39.375 1 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 2899, in _execute_and_instances
>2018-06-25 17:03:39.375 1 ERROR cinder.service     close_with_result=True)
>2018-06-25 17:03:39.375 1 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 2908, in _get_bind_args
>2018-06-25 17:03:39.375 1 ERROR cinder.service     **kw
>2018-06-25 17:03:39.375 1 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/query.py", line 2890, in _connection_from_session
>2018-06-25 17:03:39.375 1 ERROR cinder.service     conn = self.session.connection(**kw)
>2018-06-25 17:03:39.375 1 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/session.py", line 1035, in connection
>2018-06-25 17:03:39.375 1 ERROR cinder.service     execution_options=execution_options)
>2018-06-25 17:03:39.375 1 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/session.py", line 1042, in _connection_for_bind
>2018-06-25 17:03:39.375 1 ERROR cinder.service     conn = engine.contextual_connect(**kw)
>2018-06-25 17:03:39.375 1 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 2125, in contextual_connect
>2018-06-25 17:03:39.375 1 ERROR cinder.service     **kwargs)
>2018-06-25 17:03:39.375 1 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 110, in __init__
>2018-06-25 17:03:39.375 1 ERROR cinder.service     self.dispatch.engine_connect(self, self.__branch)
>2018-06-25 17:03:39.375 1 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/event/attr.py", line 256, in __call__
>2018-06-25 17:03:39.375 1 ERROR cinder.service     fn(*args, **kw)
>2018-06-25 17:03:39.375 1 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/engines.py", line 83, in _connect_ping_listener
>2018-06-25 17:03:39.375 1 ERROR cinder.service     connection.scalar(select([1]))
>2018-06-25 17:03:39.375 1 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 880, in scalar
>2018-06-25 17:03:39.375 1 ERROR cinder.service     return self.execute(object, *multiparams, **params).scalar()
>2018-06-25 17:03:39.375 1 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 948, in execute
>2018-06-25 17:03:39.375 1 ERROR cinder.service     return meth(self, multiparams, params)
>2018-06-25 17:03:39.375 1 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/sql/elements.py", line 269, in _execute_on_connection
>2018-06-25 17:03:39.375 1 ERROR cinder.service     return connection._execute_clauseelement(self, multiparams, params)
>2018-06-25 17:03:39.375 1 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1060, in _execute_clauseelement
>2018-06-25 17:03:39.375 1 ERROR cinder.service     compiled_sql, distilled_params
>2018-06-25 17:03:39.375 1 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1132, in _execute_context
>2018-06-25 17:03:39.375 1 ERROR cinder.service     None, None)
>2018-06-25 17:03:39.375 1 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1409, in _handle_dbapi_exception
>2018-06-25 17:03:39.375 1 ERROR cinder.service     util.raise_from_cause(newraise, exc_info)
>2018-06-25 17:03:39.375 1 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/compat.py", line 203, in raise_from_cause
>2018-06-25 17:03:39.375 1 ERROR cinder.service     reraise(type(exception), exception, tb=exc_tb, cause=cause)
>2018-06-25 17:03:39.375 1 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1125, in _execute_context
>2018-06-25 17:03:39.375 1 ERROR cinder.service     conn = self._revalidate_connection()
>2018-06-25 17:03:39.375 1 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 429, in _revalidate_connection
>2018-06-25 17:03:39.375 1 ERROR cinder.service     self.__connection = self.engine.raw_connection(_connection=self)
>2018-06-25 17:03:39.375 1 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 2188, in raw_connection
>2018-06-25 17:03:39.375 1 ERROR cinder.service     self.pool.unique_connection, _connection)
>2018-06-25 17:03:39.375 1 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 2164, in _wrap_pool_connect
>2018-06-25 17:03:39.375 1 ERROR cinder.service     util.reraise(*sys.exc_info())
>2018-06-25 17:03:39.375 1 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 2158, in _wrap_pool_connect
>2018-06-25 17:03:39.375 1 ERROR cinder.service     return fn()
>2018-06-25 17:03:39.375 1 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 345, in unique_connection
>2018-06-25 17:03:39.375 1 ERROR cinder.service     return _ConnectionFairy._checkout(self)
>2018-06-25 17:03:39.375 1 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 782, in _checkout
>2018-06-25 17:03:39.375 1 ERROR cinder.service     fairy = _ConnectionRecord.checkout(pool)
>2018-06-25 17:03:39.375 1 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 537, in checkout
>2018-06-25 17:03:39.375 1 ERROR cinder.service     rec.checkin()
>2018-06-25 17:03:39.375 1 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/langhelpers.py", line 66, in __exit__
>2018-06-25 17:03:39.375 1 ERROR cinder.service     compat.reraise(exc_type, exc_value, exc_tb)
>2018-06-25 17:03:39.375 1 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 534, in checkout
>2018-06-25 17:03:39.375 1 ERROR cinder.service     dbapi_connection = rec.get_connection()
>2018-06-25 17:03:39.375 1 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 623, in get_connection
>2018-06-25 17:03:39.375 1 ERROR cinder.service     self.__connect()
>2018-06-25 17:03:39.375 1 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/pool.py", line 667, in __connect
>2018-06-25 17:03:39.375 1 ERROR cinder.service     connection = pool._invoke_creator(self)
>2018-06-25 17:03:39.375 1 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/strategies.py", line 105, in connect
>2018-06-25 17:03:39.375 1 ERROR cinder.service     return dialect.connect(*cargs, **cparams)
>2018-06-25 17:03:39.375 1 ERROR cinder.service   File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/default.py", line 410, in connect
>2018-06-25 17:03:39.375 1 ERROR cinder.service     return self.dbapi.connect(*cargs, **cparams)
>2018-06-25 17:03:39.375 1 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/pymysql/__init__.py", line 90, in Connect
>2018-06-25 17:03:39.375 1 ERROR cinder.service     return Connection(*args, **kwargs)
>2018-06-25 17:03:39.375 1 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 706, in __init__
>2018-06-25 17:03:39.375 1 ERROR cinder.service     self.connect()
>2018-06-25 17:03:39.375 1 ERROR cinder.service   File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 963, in connect
>2018-06-25 17:03:39.375 1 ERROR cinder.service     raise exc
>2018-06-25 17:03:39.375 1 ERROR cinder.service DBConnectionError: (pymysql.err.OperationalError) (2003, "Can't connect to MySQL server on '172.17.1.18' ([Errno 111] ECONNREFUSED)") [SQL: u'SELECT 1'] (Background on this error at: http://sqlalche.me/e/e3q8)
>2018-06-25 17:03:39.375 1 ERROR cinder.service 
>2018-06-25 17:03:39.388 1 WARNING oslo.service.loopingcall [req-55bd0b5b-0ea3-46a6-904e-c322a4f22d44 - - - - -] Function 'cinder.service.Service.report_state' run outlasted interval by 58.47 sec
>2018-06-25 17:04:49.447 1 ERROR cinder.service [req-55bd0b5b-0ea3-46a6-904e-c322a4f22d44 - - - - -] Recovered model server connection!
>2018-06-25 17:51:55.624 1 WARNING cinder.scheduler.host_manager [req-274675db-9c17-44da-8e32-8251476898aa - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 17:51:55.643 1 INFO cinder.rpc [req-274675db-9c17-44da-8e32-8251476898aa - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 17:51:55.662 1 INFO cinder.rpc [req-274675db-9c17-44da-8e32-8251476898aa - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 17:51:55.744 1 INFO cinder.rpc [req-274675db-9c17-44da-8e32-8251476898aa - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 17:51:55.765 1 INFO cinder.rpc [req-274675db-9c17-44da-8e32-8251476898aa - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 17:51:55.876 1 WARNING oslo_config.cfg [req-274675db-9c17-44da-8e32-8251476898aa - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 17:51:55.878 1 WARNING oslo_config.cfg [req-274675db-9c17-44da-8e32-8251476898aa - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 17:51:55.879 1 WARNING oslo_config.cfg [req-274675db-9c17-44da-8e32-8251476898aa - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 17:51:55.879 1 WARNING oslo_config.cfg [req-274675db-9c17-44da-8e32-8251476898aa - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 17:51:55.895 1 WARNING oslo_config.cfg [req-274675db-9c17-44da-8e32-8251476898aa - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 17:51:55.897 1 WARNING oslo_config.cfg [req-274675db-9c17-44da-8e32-8251476898aa - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 17:51:55.900 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 17:51:55.971 1 INFO cinder.manager [req-17df4c54-cb85-4351-b494-4c271999d366 - - - - -] Initiating service 5 cleanup
>2018-06-25 17:51:56.015 1 INFO cinder.manager [req-17df4c54-cb85-4351-b494-4c271999d366 - - - - -] Service 5 cleanup completed.
>2018-06-25 17:54:05.569 1 ERROR oslo.messaging._drivers.impl_rabbit [req-17df4c54-cb85-4351-b494-4c271999d366 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 17:54:05.571 1 ERROR oslo.messaging._drivers.impl_rabbit [req-17df4c54-cb85-4351-b494-4c271999d366 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 17:54:05.572 1 ERROR oslo_service.service [req-17df4c54-cb85-4351-b494-4c271999d366 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 17:54:05.572 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 17:54:05.572 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 17:54:05.572 1 ERROR oslo_service.service     service.start()
>2018-06-25 17:54:05.572 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 17:54:05.572 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 17:54:05.572 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 17:54:05.572 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 17:54:05.572 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 17:54:05.572 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 17:54:05.572 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 17:54:05.572 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 17:54:05.572 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 17:54:05.572 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 17:54:05.572 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 17:54:05.572 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 17:54:05.572 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 17:54:05.572 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 17:54:05.572 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 17:54:05.572 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 17:54:05.572 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 17:54:05.572 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 17:54:05.572 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 17:54:05.572 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 17:54:05.572 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 17:54:05.572 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 17:54:05.572 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 17:54:05.572 1 ERROR oslo_service.service 
>2018-06-25 17:54:05.575 1 CRITICAL cinder [req-274675db-9c17-44da-8e32-8251476898aa - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 17:54:05.575 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 17:54:05.575 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 17:54:05.575 1 ERROR cinder     sys.exit(main())
>2018-06-25 17:54:05.575 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 17:54:05.575 1 ERROR cinder     service.wait()
>2018-06-25 17:54:05.575 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 17:54:05.575 1 ERROR cinder     _launcher.wait()
>2018-06-25 17:54:05.575 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 17:54:05.575 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 17:54:05.575 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 17:54:05.575 1 ERROR cinder     self.services.wait()
>2018-06-25 17:54:05.575 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 17:54:05.575 1 ERROR cinder     service.wait()
>2018-06-25 17:54:05.575 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 17:54:05.575 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 17:54:05.575 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 17:54:05.575 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 17:54:05.575 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 17:54:05.575 1 ERROR cinder     post_fn = fn()
>2018-06-25 17:54:05.575 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 17:54:05.575 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 17:54:05.575 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 17:54:05.575 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 17:54:05.575 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 17:54:05.575 1 ERROR cinder 
>2018-06-25 17:54:08.486 1 WARNING cinder.scheduler.host_manager [req-596321c6-5e1c-4c7e-8b1d-485c0bda3f57 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 17:54:08.498 1 INFO cinder.rpc [req-596321c6-5e1c-4c7e-8b1d-485c0bda3f57 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 17:54:08.506 1 INFO cinder.rpc [req-596321c6-5e1c-4c7e-8b1d-485c0bda3f57 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 17:54:08.519 1 INFO cinder.rpc [req-596321c6-5e1c-4c7e-8b1d-485c0bda3f57 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 17:54:08.529 1 INFO cinder.rpc [req-596321c6-5e1c-4c7e-8b1d-485c0bda3f57 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 17:54:08.643 1 WARNING oslo_config.cfg [req-596321c6-5e1c-4c7e-8b1d-485c0bda3f57 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 17:54:08.646 1 WARNING oslo_config.cfg [req-596321c6-5e1c-4c7e-8b1d-485c0bda3f57 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 17:54:08.646 1 WARNING oslo_config.cfg [req-596321c6-5e1c-4c7e-8b1d-485c0bda3f57 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 17:54:08.647 1 WARNING oslo_config.cfg [req-596321c6-5e1c-4c7e-8b1d-485c0bda3f57 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 17:54:08.652 1 WARNING oslo_config.cfg [req-596321c6-5e1c-4c7e-8b1d-485c0bda3f57 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 17:54:08.654 1 WARNING oslo_config.cfg [req-596321c6-5e1c-4c7e-8b1d-485c0bda3f57 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 17:54:08.657 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 17:54:08.665 1 INFO cinder.manager [req-1cb755d9-9418-4bf3-88e5-81aa0fa6125c - - - - -] Initiating service 5 cleanup
>2018-06-25 17:54:08.676 1 INFO cinder.manager [req-1cb755d9-9418-4bf3-88e5-81aa0fa6125c - - - - -] Service 5 cleanup completed.
>2018-06-25 17:56:13.041 1 ERROR oslo.messaging._drivers.impl_rabbit [req-1cb755d9-9418-4bf3-88e5-81aa0fa6125c - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 17:56:13.042 1 ERROR oslo.messaging._drivers.impl_rabbit [req-1cb755d9-9418-4bf3-88e5-81aa0fa6125c - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 17:56:13.043 1 ERROR oslo_service.service [req-1cb755d9-9418-4bf3-88e5-81aa0fa6125c - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 17:56:13.043 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 17:56:13.043 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 17:56:13.043 1 ERROR oslo_service.service     service.start()
>2018-06-25 17:56:13.043 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 17:56:13.043 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 17:56:13.043 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 17:56:13.043 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 17:56:13.043 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 17:56:13.043 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 17:56:13.043 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 17:56:13.043 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 17:56:13.043 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 17:56:13.043 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 17:56:13.043 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 17:56:13.043 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 17:56:13.043 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 17:56:13.043 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 17:56:13.043 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 17:56:13.043 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 17:56:13.043 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 17:56:13.043 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 17:56:13.043 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 17:56:13.043 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 17:56:13.043 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 17:56:13.043 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 17:56:13.043 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 17:56:13.043 1 ERROR oslo_service.service 
>2018-06-25 17:56:13.045 1 CRITICAL cinder [req-596321c6-5e1c-4c7e-8b1d-485c0bda3f57 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 17:56:13.045 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 17:56:13.045 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 17:56:13.045 1 ERROR cinder     sys.exit(main())
>2018-06-25 17:56:13.045 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 17:56:13.045 1 ERROR cinder     service.wait()
>2018-06-25 17:56:13.045 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 17:56:13.045 1 ERROR cinder     _launcher.wait()
>2018-06-25 17:56:13.045 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 17:56:13.045 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 17:56:13.045 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 17:56:13.045 1 ERROR cinder     self.services.wait()
>2018-06-25 17:56:13.045 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 17:56:13.045 1 ERROR cinder     service.wait()
>2018-06-25 17:56:13.045 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 17:56:13.045 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 17:56:13.045 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 17:56:13.045 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 17:56:13.045 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 17:56:13.045 1 ERROR cinder     post_fn = fn()
>2018-06-25 17:56:13.045 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 17:56:13.045 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 17:56:13.045 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 17:56:13.045 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 17:56:13.045 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 17:56:13.045 1 ERROR cinder 
>2018-06-25 17:56:15.677 1 WARNING cinder.scheduler.host_manager [req-9d50f289-70b0-46f0-aa56-e322b379a127 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 17:56:15.683 1 INFO cinder.rpc [req-9d50f289-70b0-46f0-aa56-e322b379a127 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 17:56:15.690 1 INFO cinder.rpc [req-9d50f289-70b0-46f0-aa56-e322b379a127 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 17:56:15.705 1 INFO cinder.rpc [req-9d50f289-70b0-46f0-aa56-e322b379a127 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 17:56:15.711 1 INFO cinder.rpc [req-9d50f289-70b0-46f0-aa56-e322b379a127 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 17:56:15.742 1 WARNING oslo_config.cfg [req-9d50f289-70b0-46f0-aa56-e322b379a127 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 17:56:15.744 1 WARNING oslo_config.cfg [req-9d50f289-70b0-46f0-aa56-e322b379a127 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 17:56:15.745 1 WARNING oslo_config.cfg [req-9d50f289-70b0-46f0-aa56-e322b379a127 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 17:56:15.745 1 WARNING oslo_config.cfg [req-9d50f289-70b0-46f0-aa56-e322b379a127 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 17:56:15.750 1 WARNING oslo_config.cfg [req-9d50f289-70b0-46f0-aa56-e322b379a127 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 17:56:15.751 1 WARNING oslo_config.cfg [req-9d50f289-70b0-46f0-aa56-e322b379a127 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 17:56:15.754 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 17:56:15.759 1 INFO cinder.manager [req-a74ede4c-e39d-4847-a120-a11788039dea - - - - -] Initiating service 5 cleanup
>2018-06-25 17:56:15.764 1 INFO cinder.manager [req-a74ede4c-e39d-4847-a120-a11788039dea - - - - -] Service 5 cleanup completed.
>2018-06-25 17:58:22.615 1 ERROR oslo.messaging._drivers.impl_rabbit [req-a74ede4c-e39d-4847-a120-a11788039dea - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 17:58:22.617 1 ERROR oslo.messaging._drivers.impl_rabbit [req-a74ede4c-e39d-4847-a120-a11788039dea - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 17:58:22.618 1 ERROR oslo_service.service [req-a74ede4c-e39d-4847-a120-a11788039dea - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 17:58:22.618 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 17:58:22.618 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 17:58:22.618 1 ERROR oslo_service.service     service.start()
>2018-06-25 17:58:22.618 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 17:58:22.618 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 17:58:22.618 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 17:58:22.618 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 17:58:22.618 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 17:58:22.618 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 17:58:22.618 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 17:58:22.618 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 17:58:22.618 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 17:58:22.618 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 17:58:22.618 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 17:58:22.618 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 17:58:22.618 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 17:58:22.618 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 17:58:22.618 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 17:58:22.618 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 17:58:22.618 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 17:58:22.618 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 17:58:22.618 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 17:58:22.618 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 17:58:22.618 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 17:58:22.618 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 17:58:22.618 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 17:58:22.618 1 ERROR oslo_service.service 
>2018-06-25 17:58:22.621 1 CRITICAL cinder [req-9d50f289-70b0-46f0-aa56-e322b379a127 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 17:58:22.621 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 17:58:22.621 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 17:58:22.621 1 ERROR cinder     sys.exit(main())
>2018-06-25 17:58:22.621 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 17:58:22.621 1 ERROR cinder     service.wait()
>2018-06-25 17:58:22.621 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 17:58:22.621 1 ERROR cinder     _launcher.wait()
>2018-06-25 17:58:22.621 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 17:58:22.621 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 17:58:22.621 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 17:58:22.621 1 ERROR cinder     self.services.wait()
>2018-06-25 17:58:22.621 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 17:58:22.621 1 ERROR cinder     service.wait()
>2018-06-25 17:58:22.621 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 17:58:22.621 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 17:58:22.621 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 17:58:22.621 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 17:58:22.621 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 17:58:22.621 1 ERROR cinder     post_fn = fn()
>2018-06-25 17:58:22.621 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 17:58:22.621 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 17:58:22.621 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 17:58:22.621 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 17:58:22.621 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 17:58:22.621 1 ERROR cinder 
>2018-06-25 17:58:25.283 1 WARNING cinder.scheduler.host_manager [req-0ecd1fa9-567b-4bc1-a748-5e6fa213aedf - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 17:58:25.294 1 INFO cinder.rpc [req-0ecd1fa9-567b-4bc1-a748-5e6fa213aedf - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 17:58:25.299 1 INFO cinder.rpc [req-0ecd1fa9-567b-4bc1-a748-5e6fa213aedf - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 17:58:25.319 1 INFO cinder.rpc [req-0ecd1fa9-567b-4bc1-a748-5e6fa213aedf - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 17:58:25.327 1 INFO cinder.rpc [req-0ecd1fa9-567b-4bc1-a748-5e6fa213aedf - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 17:58:25.359 1 WARNING oslo_config.cfg [req-0ecd1fa9-567b-4bc1-a748-5e6fa213aedf - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 17:58:25.361 1 WARNING oslo_config.cfg [req-0ecd1fa9-567b-4bc1-a748-5e6fa213aedf - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 17:58:25.362 1 WARNING oslo_config.cfg [req-0ecd1fa9-567b-4bc1-a748-5e6fa213aedf - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 17:58:25.362 1 WARNING oslo_config.cfg [req-0ecd1fa9-567b-4bc1-a748-5e6fa213aedf - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 17:58:25.367 1 WARNING oslo_config.cfg [req-0ecd1fa9-567b-4bc1-a748-5e6fa213aedf - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 17:58:25.368 1 WARNING oslo_config.cfg [req-0ecd1fa9-567b-4bc1-a748-5e6fa213aedf - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 17:58:25.371 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 17:58:25.379 1 INFO cinder.manager [req-9ec153de-7389-4562-a766-7d289965c882 - - - - -] Initiating service 5 cleanup
>2018-06-25 17:58:25.384 1 INFO cinder.manager [req-9ec153de-7389-4562-a766-7d289965c882 - - - - -] Service 5 cleanup completed.
>2018-06-25 18:00:31.513 1 ERROR oslo.messaging._drivers.impl_rabbit [req-9ec153de-7389-4562-a766-7d289965c882 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:00:31.515 1 ERROR oslo.messaging._drivers.impl_rabbit [req-9ec153de-7389-4562-a766-7d289965c882 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:00:31.515 1 ERROR oslo_service.service [req-9ec153de-7389-4562-a766-7d289965c882 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:00:31.515 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 18:00:31.515 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 18:00:31.515 1 ERROR oslo_service.service     service.start()
>2018-06-25 18:00:31.515 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 18:00:31.515 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 18:00:31.515 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 18:00:31.515 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 18:00:31.515 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 18:00:31.515 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 18:00:31.515 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 18:00:31.515 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 18:00:31.515 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 18:00:31.515 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 18:00:31.515 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 18:00:31.515 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 18:00:31.515 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 18:00:31.515 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 18:00:31.515 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 18:00:31.515 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 18:00:31.515 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 18:00:31.515 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 18:00:31.515 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 18:00:31.515 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 18:00:31.515 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 18:00:31.515 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 18:00:31.515 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:00:31.515 1 ERROR oslo_service.service 
>2018-06-25 18:00:31.518 1 CRITICAL cinder [req-0ecd1fa9-567b-4bc1-a748-5e6fa213aedf - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 18:00:31.518 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 18:00:31.518 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 18:00:31.518 1 ERROR cinder     sys.exit(main())
>2018-06-25 18:00:31.518 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 18:00:31.518 1 ERROR cinder     service.wait()
>2018-06-25 18:00:31.518 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 18:00:31.518 1 ERROR cinder     _launcher.wait()
>2018-06-25 18:00:31.518 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 18:00:31.518 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 18:00:31.518 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 18:00:31.518 1 ERROR cinder     self.services.wait()
>2018-06-25 18:00:31.518 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 18:00:31.518 1 ERROR cinder     service.wait()
>2018-06-25 18:00:31.518 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 18:00:31.518 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 18:00:31.518 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 18:00:31.518 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 18:00:31.518 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 18:00:31.518 1 ERROR cinder     post_fn = fn()
>2018-06-25 18:00:31.518 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 18:00:31.518 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 18:00:31.518 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 18:00:31.518 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 18:00:31.518 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 18:00:31.518 1 ERROR cinder 
>2018-06-25 18:00:34.190 1 WARNING cinder.scheduler.host_manager [req-19072774-7945-4ec2-9938-b0ab87d5a971 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 18:00:34.198 1 INFO cinder.rpc [req-19072774-7945-4ec2-9938-b0ab87d5a971 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 18:00:34.204 1 INFO cinder.rpc [req-19072774-7945-4ec2-9938-b0ab87d5a971 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 18:00:34.215 1 INFO cinder.rpc [req-19072774-7945-4ec2-9938-b0ab87d5a971 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 18:00:34.222 1 INFO cinder.rpc [req-19072774-7945-4ec2-9938-b0ab87d5a971 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 18:00:34.247 1 WARNING oslo_config.cfg [req-19072774-7945-4ec2-9938-b0ab87d5a971 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 18:00:34.250 1 WARNING oslo_config.cfg [req-19072774-7945-4ec2-9938-b0ab87d5a971 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:00:34.250 1 WARNING oslo_config.cfg [req-19072774-7945-4ec2-9938-b0ab87d5a971 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:00:34.251 1 WARNING oslo_config.cfg [req-19072774-7945-4ec2-9938-b0ab87d5a971 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:00:34.257 1 WARNING oslo_config.cfg [req-19072774-7945-4ec2-9938-b0ab87d5a971 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 18:00:34.258 1 WARNING oslo_config.cfg [req-19072774-7945-4ec2-9938-b0ab87d5a971 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 18:00:34.261 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 18:00:34.267 1 INFO cinder.manager [req-536f4898-78e2-4d58-8b45-b1862131bc05 - - - - -] Initiating service 5 cleanup
>2018-06-25 18:00:34.271 1 INFO cinder.manager [req-536f4898-78e2-4d58-8b45-b1862131bc05 - - - - -] Service 5 cleanup completed.
>2018-06-25 18:02:46.536 1 ERROR oslo.messaging._drivers.impl_rabbit [req-536f4898-78e2-4d58-8b45-b1862131bc05 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:02:46.538 1 ERROR oslo.messaging._drivers.impl_rabbit [req-536f4898-78e2-4d58-8b45-b1862131bc05 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:02:46.539 1 ERROR oslo_service.service [req-536f4898-78e2-4d58-8b45-b1862131bc05 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:02:46.539 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 18:02:46.539 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 18:02:46.539 1 ERROR oslo_service.service     service.start()
>2018-06-25 18:02:46.539 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 18:02:46.539 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 18:02:46.539 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 18:02:46.539 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 18:02:46.539 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 18:02:46.539 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 18:02:46.539 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 18:02:46.539 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 18:02:46.539 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 18:02:46.539 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 18:02:46.539 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 18:02:46.539 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 18:02:46.539 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 18:02:46.539 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 18:02:46.539 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 18:02:46.539 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 18:02:46.539 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 18:02:46.539 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 18:02:46.539 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 18:02:46.539 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 18:02:46.539 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 18:02:46.539 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 18:02:46.539 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:02:46.539 1 ERROR oslo_service.service 
>2018-06-25 18:02:46.541 1 CRITICAL cinder [req-19072774-7945-4ec2-9938-b0ab87d5a971 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 18:02:46.541 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 18:02:46.541 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 18:02:46.541 1 ERROR cinder     sys.exit(main())
>2018-06-25 18:02:46.541 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 18:02:46.541 1 ERROR cinder     service.wait()
>2018-06-25 18:02:46.541 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 18:02:46.541 1 ERROR cinder     _launcher.wait()
>2018-06-25 18:02:46.541 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 18:02:46.541 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 18:02:46.541 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 18:02:46.541 1 ERROR cinder     self.services.wait()
>2018-06-25 18:02:46.541 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 18:02:46.541 1 ERROR cinder     service.wait()
>2018-06-25 18:02:46.541 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 18:02:46.541 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 18:02:46.541 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 18:02:46.541 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 18:02:46.541 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 18:02:46.541 1 ERROR cinder     post_fn = fn()
>2018-06-25 18:02:46.541 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 18:02:46.541 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 18:02:46.541 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 18:02:46.541 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 18:02:46.541 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 18:02:46.541 1 ERROR cinder 
>2018-06-25 18:02:49.330 1 WARNING cinder.scheduler.host_manager [req-b97bc5ea-99b0-4eba-b7d5-a2b269cd2ada - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 18:02:49.338 1 INFO cinder.rpc [req-b97bc5ea-99b0-4eba-b7d5-a2b269cd2ada - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 18:02:49.346 1 INFO cinder.rpc [req-b97bc5ea-99b0-4eba-b7d5-a2b269cd2ada - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 18:02:49.360 1 INFO cinder.rpc [req-b97bc5ea-99b0-4eba-b7d5-a2b269cd2ada - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 18:02:49.366 1 INFO cinder.rpc [req-b97bc5ea-99b0-4eba-b7d5-a2b269cd2ada - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 18:02:49.391 1 WARNING oslo_config.cfg [req-b97bc5ea-99b0-4eba-b7d5-a2b269cd2ada - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 18:02:49.393 1 WARNING oslo_config.cfg [req-b97bc5ea-99b0-4eba-b7d5-a2b269cd2ada - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:02:49.394 1 WARNING oslo_config.cfg [req-b97bc5ea-99b0-4eba-b7d5-a2b269cd2ada - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:02:49.395 1 WARNING oslo_config.cfg [req-b97bc5ea-99b0-4eba-b7d5-a2b269cd2ada - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:02:49.400 1 WARNING oslo_config.cfg [req-b97bc5ea-99b0-4eba-b7d5-a2b269cd2ada - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 18:02:49.401 1 WARNING oslo_config.cfg [req-b97bc5ea-99b0-4eba-b7d5-a2b269cd2ada - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 18:02:49.404 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 18:02:49.414 1 INFO cinder.manager [req-d6acd25b-2471-4fbc-970c-53660a288c31 - - - - -] Initiating service 5 cleanup
>2018-06-25 18:02:49.422 1 INFO cinder.manager [req-d6acd25b-2471-4fbc-970c-53660a288c31 - - - - -] Service 5 cleanup completed.
>2018-06-25 18:05:00.967 1 ERROR oslo.messaging._drivers.impl_rabbit [req-d6acd25b-2471-4fbc-970c-53660a288c31 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:05:00.969 1 ERROR oslo.messaging._drivers.impl_rabbit [req-d6acd25b-2471-4fbc-970c-53660a288c31 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:05:00.970 1 ERROR oslo_service.service [req-d6acd25b-2471-4fbc-970c-53660a288c31 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:05:00.970 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 18:05:00.970 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 18:05:00.970 1 ERROR oslo_service.service     service.start()
>2018-06-25 18:05:00.970 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 18:05:00.970 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 18:05:00.970 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 18:05:00.970 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 18:05:00.970 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 18:05:00.970 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 18:05:00.970 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 18:05:00.970 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 18:05:00.970 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 18:05:00.970 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 18:05:00.970 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 18:05:00.970 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 18:05:00.970 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 18:05:00.970 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 18:05:00.970 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 18:05:00.970 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 18:05:00.970 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 18:05:00.970 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 18:05:00.970 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 18:05:00.970 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 18:05:00.970 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 18:05:00.970 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 18:05:00.970 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:05:00.970 1 ERROR oslo_service.service 
>2018-06-25 18:05:00.973 1 CRITICAL cinder [req-b97bc5ea-99b0-4eba-b7d5-a2b269cd2ada - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 18:05:00.973 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 18:05:00.973 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 18:05:00.973 1 ERROR cinder     sys.exit(main())
>2018-06-25 18:05:00.973 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 18:05:00.973 1 ERROR cinder     service.wait()
>2018-06-25 18:05:00.973 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 18:05:00.973 1 ERROR cinder     _launcher.wait()
>2018-06-25 18:05:00.973 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 18:05:00.973 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 18:05:00.973 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 18:05:00.973 1 ERROR cinder     self.services.wait()
>2018-06-25 18:05:00.973 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 18:05:00.973 1 ERROR cinder     service.wait()
>2018-06-25 18:05:00.973 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 18:05:00.973 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 18:05:00.973 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 18:05:00.973 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 18:05:00.973 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 18:05:00.973 1 ERROR cinder     post_fn = fn()
>2018-06-25 18:05:00.973 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 18:05:00.973 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 18:05:00.973 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 18:05:00.973 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 18:05:00.973 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 18:05:00.973 1 ERROR cinder 
>2018-06-25 18:05:03.663 1 WARNING cinder.scheduler.host_manager [req-31209f97-31b9-4a32-89ff-ad566d1b4a4d - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 18:05:03.668 1 INFO cinder.rpc [req-31209f97-31b9-4a32-89ff-ad566d1b4a4d - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 18:05:03.676 1 INFO cinder.rpc [req-31209f97-31b9-4a32-89ff-ad566d1b4a4d - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 18:05:03.694 1 INFO cinder.rpc [req-31209f97-31b9-4a32-89ff-ad566d1b4a4d - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 18:05:03.703 1 INFO cinder.rpc [req-31209f97-31b9-4a32-89ff-ad566d1b4a4d - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 18:05:03.740 1 WARNING oslo_config.cfg [req-31209f97-31b9-4a32-89ff-ad566d1b4a4d - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 18:05:03.743 1 WARNING oslo_config.cfg [req-31209f97-31b9-4a32-89ff-ad566d1b4a4d - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:05:03.744 1 WARNING oslo_config.cfg [req-31209f97-31b9-4a32-89ff-ad566d1b4a4d - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:05:03.744 1 WARNING oslo_config.cfg [req-31209f97-31b9-4a32-89ff-ad566d1b4a4d - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:05:03.752 1 WARNING oslo_config.cfg [req-31209f97-31b9-4a32-89ff-ad566d1b4a4d - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 18:05:03.755 1 WARNING oslo_config.cfg [req-31209f97-31b9-4a32-89ff-ad566d1b4a4d - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 18:05:03.760 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 18:05:03.771 1 INFO cinder.manager [req-dadfffa7-a283-43ba-820d-c1c2d51a48cb - - - - -] Initiating service 5 cleanup
>2018-06-25 18:05:03.778 1 INFO cinder.manager [req-dadfffa7-a283-43ba-820d-c1c2d51a48cb - - - - -] Service 5 cleanup completed.
>2018-06-25 18:07:15.937 1 ERROR oslo.messaging._drivers.impl_rabbit [req-dadfffa7-a283-43ba-820d-c1c2d51a48cb - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:07:15.940 1 ERROR oslo.messaging._drivers.impl_rabbit [req-dadfffa7-a283-43ba-820d-c1c2d51a48cb - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:07:15.941 1 ERROR oslo_service.service [req-dadfffa7-a283-43ba-820d-c1c2d51a48cb - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:07:15.941 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 18:07:15.941 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 18:07:15.941 1 ERROR oslo_service.service     service.start()
>2018-06-25 18:07:15.941 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 18:07:15.941 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 18:07:15.941 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 18:07:15.941 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 18:07:15.941 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 18:07:15.941 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 18:07:15.941 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 18:07:15.941 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 18:07:15.941 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 18:07:15.941 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 18:07:15.941 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 18:07:15.941 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 18:07:15.941 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 18:07:15.941 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 18:07:15.941 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 18:07:15.941 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 18:07:15.941 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 18:07:15.941 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 18:07:15.941 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 18:07:15.941 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 18:07:15.941 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 18:07:15.941 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 18:07:15.941 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:07:15.941 1 ERROR oslo_service.service 
>2018-06-25 18:07:15.945 1 CRITICAL cinder [req-31209f97-31b9-4a32-89ff-ad566d1b4a4d - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 18:07:15.945 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 18:07:15.945 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 18:07:15.945 1 ERROR cinder     sys.exit(main())
>2018-06-25 18:07:15.945 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 18:07:15.945 1 ERROR cinder     service.wait()
>2018-06-25 18:07:15.945 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 18:07:15.945 1 ERROR cinder     _launcher.wait()
>2018-06-25 18:07:15.945 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 18:07:15.945 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 18:07:15.945 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 18:07:15.945 1 ERROR cinder     self.services.wait()
>2018-06-25 18:07:15.945 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 18:07:15.945 1 ERROR cinder     service.wait()
>2018-06-25 18:07:15.945 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 18:07:15.945 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 18:07:15.945 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 18:07:15.945 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 18:07:15.945 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 18:07:15.945 1 ERROR cinder     post_fn = fn()
>2018-06-25 18:07:15.945 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 18:07:15.945 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 18:07:15.945 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 18:07:15.945 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 18:07:15.945 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 18:07:15.945 1 ERROR cinder 
>2018-06-25 18:07:18.738 1 WARNING cinder.scheduler.host_manager [req-1b91f872-94e3-4464-9a27-59c73c4df155 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 18:07:18.749 1 INFO cinder.rpc [req-1b91f872-94e3-4464-9a27-59c73c4df155 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 18:07:18.757 1 INFO cinder.rpc [req-1b91f872-94e3-4464-9a27-59c73c4df155 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 18:07:18.789 1 INFO cinder.rpc [req-1b91f872-94e3-4464-9a27-59c73c4df155 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 18:07:18.806 1 INFO cinder.rpc [req-1b91f872-94e3-4464-9a27-59c73c4df155 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 18:07:18.849 1 WARNING oslo_config.cfg [req-1b91f872-94e3-4464-9a27-59c73c4df155 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 18:07:18.852 1 WARNING oslo_config.cfg [req-1b91f872-94e3-4464-9a27-59c73c4df155 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:07:18.852 1 WARNING oslo_config.cfg [req-1b91f872-94e3-4464-9a27-59c73c4df155 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:07:18.853 1 WARNING oslo_config.cfg [req-1b91f872-94e3-4464-9a27-59c73c4df155 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:07:18.858 1 WARNING oslo_config.cfg [req-1b91f872-94e3-4464-9a27-59c73c4df155 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 18:07:18.859 1 WARNING oslo_config.cfg [req-1b91f872-94e3-4464-9a27-59c73c4df155 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 18:07:18.862 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 18:07:18.874 1 INFO cinder.manager [req-6389a3b5-700e-431d-be35-a2975a80b32c - - - - -] Initiating service 5 cleanup
>2018-06-25 18:07:18.881 1 INFO cinder.manager [req-6389a3b5-700e-431d-be35-a2975a80b32c - - - - -] Service 5 cleanup completed.
>2018-06-25 18:09:30.795 1 ERROR oslo.messaging._drivers.impl_rabbit [req-6389a3b5-700e-431d-be35-a2975a80b32c - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:09:30.798 1 ERROR oslo.messaging._drivers.impl_rabbit [req-6389a3b5-700e-431d-be35-a2975a80b32c - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:09:30.798 1 ERROR oslo_service.service [req-6389a3b5-700e-431d-be35-a2975a80b32c - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:09:30.798 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 18:09:30.798 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 18:09:30.798 1 ERROR oslo_service.service     service.start()
>2018-06-25 18:09:30.798 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 18:09:30.798 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 18:09:30.798 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 18:09:30.798 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 18:09:30.798 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 18:09:30.798 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 18:09:30.798 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 18:09:30.798 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 18:09:30.798 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 18:09:30.798 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 18:09:30.798 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 18:09:30.798 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 18:09:30.798 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 18:09:30.798 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 18:09:30.798 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 18:09:30.798 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 18:09:30.798 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 18:09:30.798 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 18:09:30.798 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 18:09:30.798 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 18:09:30.798 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 18:09:30.798 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 18:09:30.798 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:09:30.798 1 ERROR oslo_service.service 
>2018-06-25 18:09:30.802 1 CRITICAL cinder [req-1b91f872-94e3-4464-9a27-59c73c4df155 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 18:09:30.802 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 18:09:30.802 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 18:09:30.802 1 ERROR cinder     sys.exit(main())
>2018-06-25 18:09:30.802 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 18:09:30.802 1 ERROR cinder     service.wait()
>2018-06-25 18:09:30.802 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 18:09:30.802 1 ERROR cinder     _launcher.wait()
>2018-06-25 18:09:30.802 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 18:09:30.802 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 18:09:30.802 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 18:09:30.802 1 ERROR cinder     self.services.wait()
>2018-06-25 18:09:30.802 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 18:09:30.802 1 ERROR cinder     service.wait()
>2018-06-25 18:09:30.802 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 18:09:30.802 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 18:09:30.802 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 18:09:30.802 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 18:09:30.802 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 18:09:30.802 1 ERROR cinder     post_fn = fn()
>2018-06-25 18:09:30.802 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 18:09:30.802 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 18:09:30.802 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 18:09:30.802 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 18:09:30.802 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 18:09:30.802 1 ERROR cinder 
>2018-06-25 18:09:33.589 1 WARNING cinder.scheduler.host_manager [req-640e61f1-f89d-4f1e-b47a-bb6012ab17ea - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 18:09:33.596 1 INFO cinder.rpc [req-640e61f1-f89d-4f1e-b47a-bb6012ab17ea - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 18:09:33.602 1 INFO cinder.rpc [req-640e61f1-f89d-4f1e-b47a-bb6012ab17ea - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 18:09:33.618 1 INFO cinder.rpc [req-640e61f1-f89d-4f1e-b47a-bb6012ab17ea - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 18:09:33.624 1 INFO cinder.rpc [req-640e61f1-f89d-4f1e-b47a-bb6012ab17ea - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 18:09:33.647 1 WARNING oslo_config.cfg [req-640e61f1-f89d-4f1e-b47a-bb6012ab17ea - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 18:09:33.649 1 WARNING oslo_config.cfg [req-640e61f1-f89d-4f1e-b47a-bb6012ab17ea - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:09:33.650 1 WARNING oslo_config.cfg [req-640e61f1-f89d-4f1e-b47a-bb6012ab17ea - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:09:33.650 1 WARNING oslo_config.cfg [req-640e61f1-f89d-4f1e-b47a-bb6012ab17ea - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:09:33.656 1 WARNING oslo_config.cfg [req-640e61f1-f89d-4f1e-b47a-bb6012ab17ea - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 18:09:33.657 1 WARNING oslo_config.cfg [req-640e61f1-f89d-4f1e-b47a-bb6012ab17ea - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 18:09:33.660 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 18:09:33.666 1 INFO cinder.manager [req-832bebe6-b7f6-41d1-9a86-c698a2d3116b - - - - -] Initiating service 5 cleanup
>2018-06-25 18:09:33.676 1 INFO cinder.manager [req-832bebe6-b7f6-41d1-9a86-c698a2d3116b - - - - -] Service 5 cleanup completed.
>2018-06-25 18:11:39.757 1 ERROR oslo.messaging._drivers.impl_rabbit [req-832bebe6-b7f6-41d1-9a86-c698a2d3116b - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:11:39.759 1 ERROR oslo.messaging._drivers.impl_rabbit [req-832bebe6-b7f6-41d1-9a86-c698a2d3116b - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:11:39.759 1 ERROR oslo_service.service [req-832bebe6-b7f6-41d1-9a86-c698a2d3116b - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:11:39.759 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 18:11:39.759 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 18:11:39.759 1 ERROR oslo_service.service     service.start()
>2018-06-25 18:11:39.759 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 18:11:39.759 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 18:11:39.759 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 18:11:39.759 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 18:11:39.759 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 18:11:39.759 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 18:11:39.759 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 18:11:39.759 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 18:11:39.759 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 18:11:39.759 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 18:11:39.759 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 18:11:39.759 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 18:11:39.759 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 18:11:39.759 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 18:11:39.759 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 18:11:39.759 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 18:11:39.759 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 18:11:39.759 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 18:11:39.759 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 18:11:39.759 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 18:11:39.759 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 18:11:39.759 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 18:11:39.759 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:11:39.759 1 ERROR oslo_service.service 
>2018-06-25 18:11:39.762 1 CRITICAL cinder [req-640e61f1-f89d-4f1e-b47a-bb6012ab17ea - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 18:11:39.762 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 18:11:39.762 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 18:11:39.762 1 ERROR cinder     sys.exit(main())
>2018-06-25 18:11:39.762 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 18:11:39.762 1 ERROR cinder     service.wait()
>2018-06-25 18:11:39.762 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 18:11:39.762 1 ERROR cinder     _launcher.wait()
>2018-06-25 18:11:39.762 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 18:11:39.762 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 18:11:39.762 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 18:11:39.762 1 ERROR cinder     self.services.wait()
>2018-06-25 18:11:39.762 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 18:11:39.762 1 ERROR cinder     service.wait()
>2018-06-25 18:11:39.762 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 18:11:39.762 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 18:11:39.762 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 18:11:39.762 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 18:11:39.762 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 18:11:39.762 1 ERROR cinder     post_fn = fn()
>2018-06-25 18:11:39.762 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 18:11:39.762 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 18:11:39.762 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 18:11:39.762 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 18:11:39.762 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 18:11:39.762 1 ERROR cinder 
>2018-06-25 18:11:42.812 1 WARNING cinder.scheduler.host_manager [req-a1377e2a-a938-4522-9dac-1461febddca8 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 18:11:42.818 1 INFO cinder.rpc [req-a1377e2a-a938-4522-9dac-1461febddca8 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 18:11:42.824 1 INFO cinder.rpc [req-a1377e2a-a938-4522-9dac-1461febddca8 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 18:11:42.847 1 INFO cinder.rpc [req-a1377e2a-a938-4522-9dac-1461febddca8 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 18:11:42.855 1 INFO cinder.rpc [req-a1377e2a-a938-4522-9dac-1461febddca8 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 18:11:42.885 1 WARNING oslo_config.cfg [req-a1377e2a-a938-4522-9dac-1461febddca8 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 18:11:42.887 1 WARNING oslo_config.cfg [req-a1377e2a-a938-4522-9dac-1461febddca8 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:11:42.888 1 WARNING oslo_config.cfg [req-a1377e2a-a938-4522-9dac-1461febddca8 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:11:42.889 1 WARNING oslo_config.cfg [req-a1377e2a-a938-4522-9dac-1461febddca8 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:11:42.895 1 WARNING oslo_config.cfg [req-a1377e2a-a938-4522-9dac-1461febddca8 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 18:11:42.896 1 WARNING oslo_config.cfg [req-a1377e2a-a938-4522-9dac-1461febddca8 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 18:11:42.899 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 18:11:42.905 1 INFO cinder.manager [req-3da2eb6b-9496-4fbe-b635-d36336a74322 - - - - -] Initiating service 5 cleanup
>2018-06-25 18:11:42.917 1 INFO cinder.manager [req-3da2eb6b-9496-4fbe-b635-d36336a74322 - - - - -] Service 5 cleanup completed.
>2018-06-25 18:13:54.416 1 ERROR oslo.messaging._drivers.impl_rabbit [req-3da2eb6b-9496-4fbe-b635-d36336a74322 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:13:54.418 1 ERROR oslo.messaging._drivers.impl_rabbit [req-3da2eb6b-9496-4fbe-b635-d36336a74322 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:13:54.419 1 ERROR oslo_service.service [req-3da2eb6b-9496-4fbe-b635-d36336a74322 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:13:54.419 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 18:13:54.419 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 18:13:54.419 1 ERROR oslo_service.service     service.start()
>2018-06-25 18:13:54.419 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 18:13:54.419 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 18:13:54.419 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 18:13:54.419 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 18:13:54.419 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 18:13:54.419 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 18:13:54.419 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 18:13:54.419 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 18:13:54.419 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 18:13:54.419 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 18:13:54.419 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 18:13:54.419 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 18:13:54.419 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 18:13:54.419 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 18:13:54.419 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 18:13:54.419 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 18:13:54.419 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 18:13:54.419 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 18:13:54.419 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 18:13:54.419 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 18:13:54.419 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 18:13:54.419 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 18:13:54.419 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:13:54.419 1 ERROR oslo_service.service 
>2018-06-25 18:13:54.422 1 CRITICAL cinder [req-a1377e2a-a938-4522-9dac-1461febddca8 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 18:13:54.422 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 18:13:54.422 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 18:13:54.422 1 ERROR cinder     sys.exit(main())
>2018-06-25 18:13:54.422 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 18:13:54.422 1 ERROR cinder     service.wait()
>2018-06-25 18:13:54.422 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 18:13:54.422 1 ERROR cinder     _launcher.wait()
>2018-06-25 18:13:54.422 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 18:13:54.422 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 18:13:54.422 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 18:13:54.422 1 ERROR cinder     self.services.wait()
>2018-06-25 18:13:54.422 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 18:13:54.422 1 ERROR cinder     service.wait()
>2018-06-25 18:13:54.422 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 18:13:54.422 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 18:13:54.422 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 18:13:54.422 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 18:13:54.422 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 18:13:54.422 1 ERROR cinder     post_fn = fn()
>2018-06-25 18:13:54.422 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 18:13:54.422 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 18:13:54.422 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 18:13:54.422 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 18:13:54.422 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 18:13:54.422 1 ERROR cinder 
>2018-06-25 18:13:57.147 1 WARNING cinder.scheduler.host_manager [req-a5791887-6d96-414d-af2f-1f111ee4bb6b - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 18:13:57.153 1 INFO cinder.rpc [req-a5791887-6d96-414d-af2f-1f111ee4bb6b - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 18:13:57.159 1 INFO cinder.rpc [req-a5791887-6d96-414d-af2f-1f111ee4bb6b - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 18:13:57.171 1 INFO cinder.rpc [req-a5791887-6d96-414d-af2f-1f111ee4bb6b - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 18:13:57.176 1 INFO cinder.rpc [req-a5791887-6d96-414d-af2f-1f111ee4bb6b - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 18:13:57.209 1 WARNING oslo_config.cfg [req-a5791887-6d96-414d-af2f-1f111ee4bb6b - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 18:13:57.211 1 WARNING oslo_config.cfg [req-a5791887-6d96-414d-af2f-1f111ee4bb6b - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:13:57.212 1 WARNING oslo_config.cfg [req-a5791887-6d96-414d-af2f-1f111ee4bb6b - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:13:57.213 1 WARNING oslo_config.cfg [req-a5791887-6d96-414d-af2f-1f111ee4bb6b - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:13:57.217 1 WARNING oslo_config.cfg [req-a5791887-6d96-414d-af2f-1f111ee4bb6b - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 18:13:57.219 1 WARNING oslo_config.cfg [req-a5791887-6d96-414d-af2f-1f111ee4bb6b - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 18:13:57.221 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 18:13:57.228 1 INFO cinder.manager [req-33aa39e6-9101-4507-ba86-c86719621695 - - - - -] Initiating service 5 cleanup
>2018-06-25 18:13:57.233 1 INFO cinder.manager [req-33aa39e6-9101-4507-ba86-c86719621695 - - - - -] Service 5 cleanup completed.
>2018-06-25 18:16:09.730 1 ERROR oslo.messaging._drivers.impl_rabbit [req-33aa39e6-9101-4507-ba86-c86719621695 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:16:09.732 1 ERROR oslo.messaging._drivers.impl_rabbit [req-33aa39e6-9101-4507-ba86-c86719621695 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:16:09.733 1 ERROR oslo_service.service [req-33aa39e6-9101-4507-ba86-c86719621695 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:16:09.733 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 18:16:09.733 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 18:16:09.733 1 ERROR oslo_service.service     service.start()
>2018-06-25 18:16:09.733 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 18:16:09.733 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 18:16:09.733 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 18:16:09.733 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 18:16:09.733 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 18:16:09.733 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 18:16:09.733 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 18:16:09.733 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 18:16:09.733 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 18:16:09.733 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 18:16:09.733 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 18:16:09.733 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 18:16:09.733 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 18:16:09.733 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 18:16:09.733 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 18:16:09.733 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 18:16:09.733 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 18:16:09.733 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 18:16:09.733 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 18:16:09.733 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 18:16:09.733 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 18:16:09.733 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 18:16:09.733 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:16:09.733 1 ERROR oslo_service.service 
>2018-06-25 18:16:09.735 1 CRITICAL cinder [req-a5791887-6d96-414d-af2f-1f111ee4bb6b - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 18:16:09.735 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 18:16:09.735 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 18:16:09.735 1 ERROR cinder     sys.exit(main())
>2018-06-25 18:16:09.735 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 18:16:09.735 1 ERROR cinder     service.wait()
>2018-06-25 18:16:09.735 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 18:16:09.735 1 ERROR cinder     _launcher.wait()
>2018-06-25 18:16:09.735 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 18:16:09.735 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 18:16:09.735 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 18:16:09.735 1 ERROR cinder     self.services.wait()
>2018-06-25 18:16:09.735 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 18:16:09.735 1 ERROR cinder     service.wait()
>2018-06-25 18:16:09.735 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 18:16:09.735 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 18:16:09.735 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 18:16:09.735 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 18:16:09.735 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 18:16:09.735 1 ERROR cinder     post_fn = fn()
>2018-06-25 18:16:09.735 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 18:16:09.735 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 18:16:09.735 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 18:16:09.735 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 18:16:09.735 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 18:16:09.735 1 ERROR cinder 
>2018-06-25 18:16:12.451 1 WARNING cinder.scheduler.host_manager [req-c502148c-7282-42fc-919a-e9fe9038a7c2 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 18:16:12.456 1 INFO cinder.rpc [req-c502148c-7282-42fc-919a-e9fe9038a7c2 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 18:16:12.462 1 INFO cinder.rpc [req-c502148c-7282-42fc-919a-e9fe9038a7c2 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 18:16:12.473 1 INFO cinder.rpc [req-c502148c-7282-42fc-919a-e9fe9038a7c2 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 18:16:12.479 1 INFO cinder.rpc [req-c502148c-7282-42fc-919a-e9fe9038a7c2 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 18:16:12.502 1 WARNING oslo_config.cfg [req-c502148c-7282-42fc-919a-e9fe9038a7c2 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 18:16:12.504 1 WARNING oslo_config.cfg [req-c502148c-7282-42fc-919a-e9fe9038a7c2 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:16:12.505 1 WARNING oslo_config.cfg [req-c502148c-7282-42fc-919a-e9fe9038a7c2 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:16:12.505 1 WARNING oslo_config.cfg [req-c502148c-7282-42fc-919a-e9fe9038a7c2 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:16:12.511 1 WARNING oslo_config.cfg [req-c502148c-7282-42fc-919a-e9fe9038a7c2 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 18:16:12.512 1 WARNING oslo_config.cfg [req-c502148c-7282-42fc-919a-e9fe9038a7c2 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 18:16:12.515 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 18:16:12.521 1 INFO cinder.manager [req-be25652d-cc90-401e-a938-653cca4923e3 - - - - -] Initiating service 5 cleanup
>2018-06-25 18:16:12.525 1 INFO cinder.manager [req-be25652d-cc90-401e-a938-653cca4923e3 - - - - -] Service 5 cleanup completed.
>2018-06-25 18:18:18.733 1 ERROR oslo.messaging._drivers.impl_rabbit [req-be25652d-cc90-401e-a938-653cca4923e3 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:18:18.735 1 ERROR oslo.messaging._drivers.impl_rabbit [req-be25652d-cc90-401e-a938-653cca4923e3 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:18:18.735 1 ERROR oslo_service.service [req-be25652d-cc90-401e-a938-653cca4923e3 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:18:18.735 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 18:18:18.735 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 18:18:18.735 1 ERROR oslo_service.service     service.start()
>2018-06-25 18:18:18.735 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 18:18:18.735 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 18:18:18.735 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 18:18:18.735 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 18:18:18.735 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 18:18:18.735 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 18:18:18.735 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 18:18:18.735 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 18:18:18.735 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 18:18:18.735 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 18:18:18.735 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 18:18:18.735 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 18:18:18.735 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 18:18:18.735 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 18:18:18.735 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 18:18:18.735 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 18:18:18.735 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 18:18:18.735 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 18:18:18.735 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 18:18:18.735 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 18:18:18.735 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 18:18:18.735 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 18:18:18.735 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:18:18.735 1 ERROR oslo_service.service 
>2018-06-25 18:18:18.738 1 CRITICAL cinder [req-c502148c-7282-42fc-919a-e9fe9038a7c2 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 18:18:18.738 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 18:18:18.738 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 18:18:18.738 1 ERROR cinder     sys.exit(main())
>2018-06-25 18:18:18.738 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 18:18:18.738 1 ERROR cinder     service.wait()
>2018-06-25 18:18:18.738 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 18:18:18.738 1 ERROR cinder     _launcher.wait()
>2018-06-25 18:18:18.738 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 18:18:18.738 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 18:18:18.738 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 18:18:18.738 1 ERROR cinder     self.services.wait()
>2018-06-25 18:18:18.738 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 18:18:18.738 1 ERROR cinder     service.wait()
>2018-06-25 18:18:18.738 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 18:18:18.738 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 18:18:18.738 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 18:18:18.738 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 18:18:18.738 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 18:18:18.738 1 ERROR cinder     post_fn = fn()
>2018-06-25 18:18:18.738 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 18:18:18.738 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 18:18:18.738 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 18:18:18.738 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 18:18:18.738 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 18:18:18.738 1 ERROR cinder 
>2018-06-25 18:18:21.515 1 WARNING cinder.scheduler.host_manager [req-90d8070a-e863-4389-a666-b2a0ed0deba0 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 18:18:21.525 1 INFO cinder.rpc [req-90d8070a-e863-4389-a666-b2a0ed0deba0 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 18:18:21.530 1 INFO cinder.rpc [req-90d8070a-e863-4389-a666-b2a0ed0deba0 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 18:18:21.547 1 INFO cinder.rpc [req-90d8070a-e863-4389-a666-b2a0ed0deba0 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 18:18:21.554 1 INFO cinder.rpc [req-90d8070a-e863-4389-a666-b2a0ed0deba0 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 18:18:21.589 1 WARNING oslo_config.cfg [req-90d8070a-e863-4389-a666-b2a0ed0deba0 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 18:18:21.592 1 WARNING oslo_config.cfg [req-90d8070a-e863-4389-a666-b2a0ed0deba0 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:18:21.593 1 WARNING oslo_config.cfg [req-90d8070a-e863-4389-a666-b2a0ed0deba0 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:18:21.593 1 WARNING oslo_config.cfg [req-90d8070a-e863-4389-a666-b2a0ed0deba0 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:18:21.599 1 WARNING oslo_config.cfg [req-90d8070a-e863-4389-a666-b2a0ed0deba0 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 18:18:21.600 1 WARNING oslo_config.cfg [req-90d8070a-e863-4389-a666-b2a0ed0deba0 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 18:18:21.603 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 18:18:21.613 1 INFO cinder.manager [req-99317aa5-2395-4d0e-aaf5-8a05b94c4ed6 - - - - -] Initiating service 5 cleanup
>2018-06-25 18:18:21.634 1 INFO cinder.manager [req-99317aa5-2395-4d0e-aaf5-8a05b94c4ed6 - - - - -] Service 5 cleanup completed.
>2018-06-25 18:20:28.041 1 ERROR oslo.messaging._drivers.impl_rabbit [req-99317aa5-2395-4d0e-aaf5-8a05b94c4ed6 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:20:28.043 1 ERROR oslo.messaging._drivers.impl_rabbit [req-99317aa5-2395-4d0e-aaf5-8a05b94c4ed6 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:20:28.044 1 ERROR oslo_service.service [req-99317aa5-2395-4d0e-aaf5-8a05b94c4ed6 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:20:28.044 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 18:20:28.044 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 18:20:28.044 1 ERROR oslo_service.service     service.start()
>2018-06-25 18:20:28.044 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 18:20:28.044 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 18:20:28.044 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 18:20:28.044 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 18:20:28.044 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 18:20:28.044 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 18:20:28.044 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 18:20:28.044 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 18:20:28.044 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 18:20:28.044 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 18:20:28.044 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 18:20:28.044 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 18:20:28.044 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 18:20:28.044 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 18:20:28.044 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 18:20:28.044 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 18:20:28.044 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 18:20:28.044 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 18:20:28.044 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 18:20:28.044 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 18:20:28.044 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 18:20:28.044 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 18:20:28.044 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:20:28.044 1 ERROR oslo_service.service 
>2018-06-25 18:20:28.047 1 CRITICAL cinder [req-90d8070a-e863-4389-a666-b2a0ed0deba0 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 18:20:28.047 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 18:20:28.047 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 18:20:28.047 1 ERROR cinder     sys.exit(main())
>2018-06-25 18:20:28.047 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 18:20:28.047 1 ERROR cinder     service.wait()
>2018-06-25 18:20:28.047 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 18:20:28.047 1 ERROR cinder     _launcher.wait()
>2018-06-25 18:20:28.047 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 18:20:28.047 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 18:20:28.047 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 18:20:28.047 1 ERROR cinder     self.services.wait()
>2018-06-25 18:20:28.047 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 18:20:28.047 1 ERROR cinder     service.wait()
>2018-06-25 18:20:28.047 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 18:20:28.047 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 18:20:28.047 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 18:20:28.047 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 18:20:28.047 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 18:20:28.047 1 ERROR cinder     post_fn = fn()
>2018-06-25 18:20:28.047 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 18:20:28.047 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 18:20:28.047 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 18:20:28.047 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 18:20:28.047 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 18:20:28.047 1 ERROR cinder 
>2018-06-25 18:20:30.840 1 WARNING cinder.scheduler.host_manager [req-377ba1de-0b48-413e-a88b-343f4ab88448 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 18:20:30.847 1 INFO cinder.rpc [req-377ba1de-0b48-413e-a88b-343f4ab88448 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 18:20:30.853 1 INFO cinder.rpc [req-377ba1de-0b48-413e-a88b-343f4ab88448 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 18:20:30.865 1 INFO cinder.rpc [req-377ba1de-0b48-413e-a88b-343f4ab88448 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 18:20:30.872 1 INFO cinder.rpc [req-377ba1de-0b48-413e-a88b-343f4ab88448 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 18:20:30.896 1 WARNING oslo_config.cfg [req-377ba1de-0b48-413e-a88b-343f4ab88448 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 18:20:30.898 1 WARNING oslo_config.cfg [req-377ba1de-0b48-413e-a88b-343f4ab88448 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:20:30.899 1 WARNING oslo_config.cfg [req-377ba1de-0b48-413e-a88b-343f4ab88448 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:20:30.899 1 WARNING oslo_config.cfg [req-377ba1de-0b48-413e-a88b-343f4ab88448 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:20:30.904 1 WARNING oslo_config.cfg [req-377ba1de-0b48-413e-a88b-343f4ab88448 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 18:20:30.905 1 WARNING oslo_config.cfg [req-377ba1de-0b48-413e-a88b-343f4ab88448 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 18:20:30.908 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 18:20:30.916 1 INFO cinder.manager [req-f4006711-bdb2-4772-bac3-2012aaef0cc5 - - - - -] Initiating service 5 cleanup
>2018-06-25 18:20:30.923 1 INFO cinder.manager [req-f4006711-bdb2-4772-bac3-2012aaef0cc5 - - - - -] Service 5 cleanup completed.
>2018-06-25 18:22:37.290 1 ERROR oslo.messaging._drivers.impl_rabbit [req-f4006711-bdb2-4772-bac3-2012aaef0cc5 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:22:37.292 1 ERROR oslo.messaging._drivers.impl_rabbit [req-f4006711-bdb2-4772-bac3-2012aaef0cc5 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:22:37.292 1 ERROR oslo_service.service [req-f4006711-bdb2-4772-bac3-2012aaef0cc5 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:22:37.292 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 18:22:37.292 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 18:22:37.292 1 ERROR oslo_service.service     service.start()
>2018-06-25 18:22:37.292 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 18:22:37.292 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 18:22:37.292 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 18:22:37.292 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 18:22:37.292 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 18:22:37.292 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 18:22:37.292 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 18:22:37.292 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 18:22:37.292 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 18:22:37.292 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 18:22:37.292 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 18:22:37.292 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 18:22:37.292 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 18:22:37.292 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 18:22:37.292 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 18:22:37.292 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 18:22:37.292 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 18:22:37.292 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 18:22:37.292 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 18:22:37.292 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 18:22:37.292 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 18:22:37.292 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 18:22:37.292 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:22:37.292 1 ERROR oslo_service.service 
>2018-06-25 18:22:37.296 1 CRITICAL cinder [req-377ba1de-0b48-413e-a88b-343f4ab88448 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 18:22:37.296 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 18:22:37.296 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 18:22:37.296 1 ERROR cinder     sys.exit(main())
>2018-06-25 18:22:37.296 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 18:22:37.296 1 ERROR cinder     service.wait()
>2018-06-25 18:22:37.296 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 18:22:37.296 1 ERROR cinder     _launcher.wait()
>2018-06-25 18:22:37.296 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 18:22:37.296 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 18:22:37.296 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 18:22:37.296 1 ERROR cinder     self.services.wait()
>2018-06-25 18:22:37.296 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 18:22:37.296 1 ERROR cinder     service.wait()
>2018-06-25 18:22:37.296 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 18:22:37.296 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 18:22:37.296 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 18:22:37.296 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 18:22:37.296 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 18:22:37.296 1 ERROR cinder     post_fn = fn()
>2018-06-25 18:22:37.296 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 18:22:37.296 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 18:22:37.296 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 18:22:37.296 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 18:22:37.296 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 18:22:37.296 1 ERROR cinder 
>2018-06-25 18:22:40.029 1 WARNING cinder.scheduler.host_manager [req-76988a2b-3a67-4d3c-bd6d-49a3a84c883b - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 18:22:40.035 1 INFO cinder.rpc [req-76988a2b-3a67-4d3c-bd6d-49a3a84c883b - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 18:22:40.042 1 INFO cinder.rpc [req-76988a2b-3a67-4d3c-bd6d-49a3a84c883b - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 18:22:40.056 1 INFO cinder.rpc [req-76988a2b-3a67-4d3c-bd6d-49a3a84c883b - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 18:22:40.062 1 INFO cinder.rpc [req-76988a2b-3a67-4d3c-bd6d-49a3a84c883b - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 18:22:40.106 1 WARNING oslo_config.cfg [req-76988a2b-3a67-4d3c-bd6d-49a3a84c883b - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 18:22:40.108 1 WARNING oslo_config.cfg [req-76988a2b-3a67-4d3c-bd6d-49a3a84c883b - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:22:40.109 1 WARNING oslo_config.cfg [req-76988a2b-3a67-4d3c-bd6d-49a3a84c883b - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:22:40.109 1 WARNING oslo_config.cfg [req-76988a2b-3a67-4d3c-bd6d-49a3a84c883b - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:22:40.114 1 WARNING oslo_config.cfg [req-76988a2b-3a67-4d3c-bd6d-49a3a84c883b - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 18:22:40.116 1 WARNING oslo_config.cfg [req-76988a2b-3a67-4d3c-bd6d-49a3a84c883b - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 18:22:40.118 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 18:22:40.136 1 INFO cinder.manager [req-0ab5bb84-8707-40ca-abb9-1b359050ac32 - - - - -] Initiating service 5 cleanup
>2018-06-25 18:22:40.141 1 INFO cinder.manager [req-0ab5bb84-8707-40ca-abb9-1b359050ac32 - - - - -] Service 5 cleanup completed.
>2018-06-25 18:24:51.270 1 ERROR oslo.messaging._drivers.impl_rabbit [req-0ab5bb84-8707-40ca-abb9-1b359050ac32 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:24:51.272 1 ERROR oslo.messaging._drivers.impl_rabbit [req-0ab5bb84-8707-40ca-abb9-1b359050ac32 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:24:51.272 1 ERROR oslo_service.service [req-0ab5bb84-8707-40ca-abb9-1b359050ac32 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:24:51.272 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 18:24:51.272 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 18:24:51.272 1 ERROR oslo_service.service     service.start()
>2018-06-25 18:24:51.272 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 18:24:51.272 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 18:24:51.272 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 18:24:51.272 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 18:24:51.272 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 18:24:51.272 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 18:24:51.272 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 18:24:51.272 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 18:24:51.272 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 18:24:51.272 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 18:24:51.272 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 18:24:51.272 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 18:24:51.272 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 18:24:51.272 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 18:24:51.272 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 18:24:51.272 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 18:24:51.272 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 18:24:51.272 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 18:24:51.272 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 18:24:51.272 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 18:24:51.272 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 18:24:51.272 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 18:24:51.272 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:24:51.272 1 ERROR oslo_service.service 
>2018-06-25 18:24:51.275 1 CRITICAL cinder [req-76988a2b-3a67-4d3c-bd6d-49a3a84c883b - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 18:24:51.275 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 18:24:51.275 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 18:24:51.275 1 ERROR cinder     sys.exit(main())
>2018-06-25 18:24:51.275 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 18:24:51.275 1 ERROR cinder     service.wait()
>2018-06-25 18:24:51.275 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 18:24:51.275 1 ERROR cinder     _launcher.wait()
>2018-06-25 18:24:51.275 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 18:24:51.275 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 18:24:51.275 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 18:24:51.275 1 ERROR cinder     self.services.wait()
>2018-06-25 18:24:51.275 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 18:24:51.275 1 ERROR cinder     service.wait()
>2018-06-25 18:24:51.275 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 18:24:51.275 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 18:24:51.275 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 18:24:51.275 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 18:24:51.275 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 18:24:51.275 1 ERROR cinder     post_fn = fn()
>2018-06-25 18:24:51.275 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 18:24:51.275 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 18:24:51.275 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 18:24:51.275 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 18:24:51.275 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 18:24:51.275 1 ERROR cinder 
>2018-06-25 18:24:54.146 1 WARNING cinder.scheduler.host_manager [req-967fcb7e-6df0-4025-a198-487a44ab0e1d - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 18:24:54.152 1 INFO cinder.rpc [req-967fcb7e-6df0-4025-a198-487a44ab0e1d - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 18:24:54.158 1 INFO cinder.rpc [req-967fcb7e-6df0-4025-a198-487a44ab0e1d - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 18:24:54.169 1 INFO cinder.rpc [req-967fcb7e-6df0-4025-a198-487a44ab0e1d - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 18:24:54.176 1 INFO cinder.rpc [req-967fcb7e-6df0-4025-a198-487a44ab0e1d - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 18:24:54.212 1 WARNING oslo_config.cfg [req-967fcb7e-6df0-4025-a198-487a44ab0e1d - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 18:24:54.214 1 WARNING oslo_config.cfg [req-967fcb7e-6df0-4025-a198-487a44ab0e1d - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:24:54.215 1 WARNING oslo_config.cfg [req-967fcb7e-6df0-4025-a198-487a44ab0e1d - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:24:54.216 1 WARNING oslo_config.cfg [req-967fcb7e-6df0-4025-a198-487a44ab0e1d - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:24:54.221 1 WARNING oslo_config.cfg [req-967fcb7e-6df0-4025-a198-487a44ab0e1d - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 18:24:54.222 1 WARNING oslo_config.cfg [req-967fcb7e-6df0-4025-a198-487a44ab0e1d - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 18:24:54.224 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 18:24:54.231 1 INFO cinder.manager [req-a993d3e8-0a16-458c-9f35-c2b39520611c - - - - -] Initiating service 5 cleanup
>2018-06-25 18:24:54.236 1 INFO cinder.manager [req-a993d3e8-0a16-458c-9f35-c2b39520611c - - - - -] Service 5 cleanup completed.
>2018-06-25 18:26:58.626 1 ERROR oslo.messaging._drivers.impl_rabbit [req-a993d3e8-0a16-458c-9f35-c2b39520611c - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:26:58.628 1 ERROR oslo.messaging._drivers.impl_rabbit [req-a993d3e8-0a16-458c-9f35-c2b39520611c - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:26:58.628 1 ERROR oslo_service.service [req-a993d3e8-0a16-458c-9f35-c2b39520611c - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:26:58.628 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 18:26:58.628 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 18:26:58.628 1 ERROR oslo_service.service     service.start()
>2018-06-25 18:26:58.628 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 18:26:58.628 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 18:26:58.628 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 18:26:58.628 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 18:26:58.628 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 18:26:58.628 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 18:26:58.628 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 18:26:58.628 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 18:26:58.628 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 18:26:58.628 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 18:26:58.628 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 18:26:58.628 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 18:26:58.628 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 18:26:58.628 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 18:26:58.628 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 18:26:58.628 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 18:26:58.628 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 18:26:58.628 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 18:26:58.628 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 18:26:58.628 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 18:26:58.628 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 18:26:58.628 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 18:26:58.628 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:26:58.628 1 ERROR oslo_service.service 
>2018-06-25 18:26:58.631 1 CRITICAL cinder [req-967fcb7e-6df0-4025-a198-487a44ab0e1d - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 18:26:58.631 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 18:26:58.631 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 18:26:58.631 1 ERROR cinder     sys.exit(main())
>2018-06-25 18:26:58.631 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 18:26:58.631 1 ERROR cinder     service.wait()
>2018-06-25 18:26:58.631 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 18:26:58.631 1 ERROR cinder     _launcher.wait()
>2018-06-25 18:26:58.631 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 18:26:58.631 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 18:26:58.631 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 18:26:58.631 1 ERROR cinder     self.services.wait()
>2018-06-25 18:26:58.631 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 18:26:58.631 1 ERROR cinder     service.wait()
>2018-06-25 18:26:58.631 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 18:26:58.631 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 18:26:58.631 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 18:26:58.631 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 18:26:58.631 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 18:26:58.631 1 ERROR cinder     post_fn = fn()
>2018-06-25 18:26:58.631 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 18:26:58.631 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 18:26:58.631 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 18:26:58.631 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 18:26:58.631 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 18:26:58.631 1 ERROR cinder 
>2018-06-25 18:27:01.360 1 WARNING cinder.scheduler.host_manager [req-05ab9535-a62e-4d2f-9930-36af5ebd22c1 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 18:27:01.365 1 INFO cinder.rpc [req-05ab9535-a62e-4d2f-9930-36af5ebd22c1 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 18:27:01.373 1 INFO cinder.rpc [req-05ab9535-a62e-4d2f-9930-36af5ebd22c1 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 18:27:01.390 1 INFO cinder.rpc [req-05ab9535-a62e-4d2f-9930-36af5ebd22c1 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 18:27:01.403 1 INFO cinder.rpc [req-05ab9535-a62e-4d2f-9930-36af5ebd22c1 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 18:27:01.447 1 WARNING oslo_config.cfg [req-05ab9535-a62e-4d2f-9930-36af5ebd22c1 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 18:27:01.450 1 WARNING oslo_config.cfg [req-05ab9535-a62e-4d2f-9930-36af5ebd22c1 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:27:01.450 1 WARNING oslo_config.cfg [req-05ab9535-a62e-4d2f-9930-36af5ebd22c1 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:27:01.451 1 WARNING oslo_config.cfg [req-05ab9535-a62e-4d2f-9930-36af5ebd22c1 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:27:01.457 1 WARNING oslo_config.cfg [req-05ab9535-a62e-4d2f-9930-36af5ebd22c1 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 18:27:01.458 1 WARNING oslo_config.cfg [req-05ab9535-a62e-4d2f-9930-36af5ebd22c1 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 18:27:01.463 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 18:27:01.476 1 INFO cinder.manager [req-b138626d-2fc4-4906-95e8-124916a92e6a - - - - -] Initiating service 5 cleanup
>2018-06-25 18:27:01.481 1 INFO cinder.manager [req-b138626d-2fc4-4906-95e8-124916a92e6a - - - - -] Service 5 cleanup completed.
>2018-06-25 18:29:13.337 1 ERROR oslo.messaging._drivers.impl_rabbit [req-b138626d-2fc4-4906-95e8-124916a92e6a - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:29:13.339 1 ERROR oslo.messaging._drivers.impl_rabbit [req-b138626d-2fc4-4906-95e8-124916a92e6a - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:29:13.339 1 ERROR oslo_service.service [req-b138626d-2fc4-4906-95e8-124916a92e6a - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:29:13.339 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 18:29:13.339 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 18:29:13.339 1 ERROR oslo_service.service     service.start()
>2018-06-25 18:29:13.339 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 18:29:13.339 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 18:29:13.339 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 18:29:13.339 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 18:29:13.339 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 18:29:13.339 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 18:29:13.339 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 18:29:13.339 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 18:29:13.339 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 18:29:13.339 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 18:29:13.339 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 18:29:13.339 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 18:29:13.339 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 18:29:13.339 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 18:29:13.339 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 18:29:13.339 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 18:29:13.339 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 18:29:13.339 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 18:29:13.339 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 18:29:13.339 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 18:29:13.339 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 18:29:13.339 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 18:29:13.339 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:29:13.339 1 ERROR oslo_service.service 
>2018-06-25 18:29:13.342 1 CRITICAL cinder [req-05ab9535-a62e-4d2f-9930-36af5ebd22c1 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 18:29:13.342 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 18:29:13.342 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 18:29:13.342 1 ERROR cinder     sys.exit(main())
>2018-06-25 18:29:13.342 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 18:29:13.342 1 ERROR cinder     service.wait()
>2018-06-25 18:29:13.342 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 18:29:13.342 1 ERROR cinder     _launcher.wait()
>2018-06-25 18:29:13.342 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 18:29:13.342 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 18:29:13.342 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 18:29:13.342 1 ERROR cinder     self.services.wait()
>2018-06-25 18:29:13.342 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 18:29:13.342 1 ERROR cinder     service.wait()
>2018-06-25 18:29:13.342 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 18:29:13.342 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 18:29:13.342 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 18:29:13.342 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 18:29:13.342 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 18:29:13.342 1 ERROR cinder     post_fn = fn()
>2018-06-25 18:29:13.342 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 18:29:13.342 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 18:29:13.342 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 18:29:13.342 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 18:29:13.342 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 18:29:13.342 1 ERROR cinder 
>2018-06-25 18:29:16.049 1 WARNING cinder.scheduler.host_manager [req-3a144ffe-de8c-46bc-82cd-143b25d2e8d0 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 18:29:16.057 1 INFO cinder.rpc [req-3a144ffe-de8c-46bc-82cd-143b25d2e8d0 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 18:29:16.062 1 INFO cinder.rpc [req-3a144ffe-de8c-46bc-82cd-143b25d2e8d0 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 18:29:16.078 1 INFO cinder.rpc [req-3a144ffe-de8c-46bc-82cd-143b25d2e8d0 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 18:29:16.086 1 INFO cinder.rpc [req-3a144ffe-de8c-46bc-82cd-143b25d2e8d0 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 18:29:16.112 1 WARNING oslo_config.cfg [req-3a144ffe-de8c-46bc-82cd-143b25d2e8d0 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 18:29:16.114 1 WARNING oslo_config.cfg [req-3a144ffe-de8c-46bc-82cd-143b25d2e8d0 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:29:16.115 1 WARNING oslo_config.cfg [req-3a144ffe-de8c-46bc-82cd-143b25d2e8d0 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:29:16.116 1 WARNING oslo_config.cfg [req-3a144ffe-de8c-46bc-82cd-143b25d2e8d0 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:29:16.121 1 WARNING oslo_config.cfg [req-3a144ffe-de8c-46bc-82cd-143b25d2e8d0 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 18:29:16.122 1 WARNING oslo_config.cfg [req-3a144ffe-de8c-46bc-82cd-143b25d2e8d0 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 18:29:16.125 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 18:29:16.133 1 INFO cinder.manager [req-2abf44c6-6c2a-4dd5-b187-6b6d65f2de4e - - - - -] Initiating service 5 cleanup
>2018-06-25 18:29:16.138 1 INFO cinder.manager [req-2abf44c6-6c2a-4dd5-b187-6b6d65f2de4e - - - - -] Service 5 cleanup completed.
>2018-06-25 18:31:28.493 1 ERROR oslo.messaging._drivers.impl_rabbit [req-2abf44c6-6c2a-4dd5-b187-6b6d65f2de4e - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:31:28.495 1 ERROR oslo.messaging._drivers.impl_rabbit [req-2abf44c6-6c2a-4dd5-b187-6b6d65f2de4e - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:31:28.496 1 ERROR oslo_service.service [req-2abf44c6-6c2a-4dd5-b187-6b6d65f2de4e - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:31:28.496 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 18:31:28.496 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 18:31:28.496 1 ERROR oslo_service.service     service.start()
>2018-06-25 18:31:28.496 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 18:31:28.496 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 18:31:28.496 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 18:31:28.496 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 18:31:28.496 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 18:31:28.496 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 18:31:28.496 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 18:31:28.496 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 18:31:28.496 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 18:31:28.496 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 18:31:28.496 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 18:31:28.496 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 18:31:28.496 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 18:31:28.496 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 18:31:28.496 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 18:31:28.496 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 18:31:28.496 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 18:31:28.496 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 18:31:28.496 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 18:31:28.496 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 18:31:28.496 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 18:31:28.496 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 18:31:28.496 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:31:28.496 1 ERROR oslo_service.service 
>2018-06-25 18:31:28.498 1 CRITICAL cinder [req-3a144ffe-de8c-46bc-82cd-143b25d2e8d0 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 18:31:28.498 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 18:31:28.498 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 18:31:28.498 1 ERROR cinder     sys.exit(main())
>2018-06-25 18:31:28.498 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 18:31:28.498 1 ERROR cinder     service.wait()
>2018-06-25 18:31:28.498 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 18:31:28.498 1 ERROR cinder     _launcher.wait()
>2018-06-25 18:31:28.498 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 18:31:28.498 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 18:31:28.498 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 18:31:28.498 1 ERROR cinder     self.services.wait()
>2018-06-25 18:31:28.498 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 18:31:28.498 1 ERROR cinder     service.wait()
>2018-06-25 18:31:28.498 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 18:31:28.498 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 18:31:28.498 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 18:31:28.498 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 18:31:28.498 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 18:31:28.498 1 ERROR cinder     post_fn = fn()
>2018-06-25 18:31:28.498 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 18:31:28.498 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 18:31:28.498 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 18:31:28.498 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 18:31:28.498 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 18:31:28.498 1 ERROR cinder 
>2018-06-25 18:31:31.211 1 WARNING cinder.scheduler.host_manager [req-1e8523d5-ed04-446e-9833-f9860314314e - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 18:31:31.217 1 INFO cinder.rpc [req-1e8523d5-ed04-446e-9833-f9860314314e - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 18:31:31.224 1 INFO cinder.rpc [req-1e8523d5-ed04-446e-9833-f9860314314e - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 18:31:31.237 1 INFO cinder.rpc [req-1e8523d5-ed04-446e-9833-f9860314314e - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 18:31:31.244 1 INFO cinder.rpc [req-1e8523d5-ed04-446e-9833-f9860314314e - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 18:31:31.269 1 WARNING oslo_config.cfg [req-1e8523d5-ed04-446e-9833-f9860314314e - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 18:31:31.271 1 WARNING oslo_config.cfg [req-1e8523d5-ed04-446e-9833-f9860314314e - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:31:31.271 1 WARNING oslo_config.cfg [req-1e8523d5-ed04-446e-9833-f9860314314e - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:31:31.272 1 WARNING oslo_config.cfg [req-1e8523d5-ed04-446e-9833-f9860314314e - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:31:31.278 1 WARNING oslo_config.cfg [req-1e8523d5-ed04-446e-9833-f9860314314e - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 18:31:31.279 1 WARNING oslo_config.cfg [req-1e8523d5-ed04-446e-9833-f9860314314e - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 18:31:31.281 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 18:31:31.289 1 INFO cinder.manager [req-9dfab10a-11ac-4059-b934-82bd8d4012e6 - - - - -] Initiating service 5 cleanup
>2018-06-25 18:31:31.294 1 INFO cinder.manager [req-9dfab10a-11ac-4059-b934-82bd8d4012e6 - - - - -] Service 5 cleanup completed.
>2018-06-25 18:33:35.697 1 ERROR oslo.messaging._drivers.impl_rabbit [req-9dfab10a-11ac-4059-b934-82bd8d4012e6 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:33:35.700 1 ERROR oslo.messaging._drivers.impl_rabbit [req-9dfab10a-11ac-4059-b934-82bd8d4012e6 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:33:35.701 1 ERROR oslo_service.service [req-9dfab10a-11ac-4059-b934-82bd8d4012e6 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:33:35.701 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 18:33:35.701 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 18:33:35.701 1 ERROR oslo_service.service     service.start()
>2018-06-25 18:33:35.701 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 18:33:35.701 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 18:33:35.701 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 18:33:35.701 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 18:33:35.701 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 18:33:35.701 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 18:33:35.701 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 18:33:35.701 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 18:33:35.701 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 18:33:35.701 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 18:33:35.701 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 18:33:35.701 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 18:33:35.701 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 18:33:35.701 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 18:33:35.701 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 18:33:35.701 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 18:33:35.701 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 18:33:35.701 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 18:33:35.701 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 18:33:35.701 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 18:33:35.701 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 18:33:35.701 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 18:33:35.701 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:33:35.701 1 ERROR oslo_service.service 
>2018-06-25 18:33:35.706 1 CRITICAL cinder [req-1e8523d5-ed04-446e-9833-f9860314314e - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 18:33:35.706 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 18:33:35.706 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 18:33:35.706 1 ERROR cinder     sys.exit(main())
>2018-06-25 18:33:35.706 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 18:33:35.706 1 ERROR cinder     service.wait()
>2018-06-25 18:33:35.706 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 18:33:35.706 1 ERROR cinder     _launcher.wait()
>2018-06-25 18:33:35.706 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 18:33:35.706 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 18:33:35.706 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 18:33:35.706 1 ERROR cinder     self.services.wait()
>2018-06-25 18:33:35.706 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 18:33:35.706 1 ERROR cinder     service.wait()
>2018-06-25 18:33:35.706 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 18:33:35.706 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 18:33:35.706 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 18:33:35.706 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 18:33:35.706 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 18:33:35.706 1 ERROR cinder     post_fn = fn()
>2018-06-25 18:33:35.706 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 18:33:35.706 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 18:33:35.706 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 18:33:35.706 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 18:33:35.706 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 18:33:35.706 1 ERROR cinder 
>2018-06-25 18:33:38.572 1 WARNING cinder.scheduler.host_manager [req-0f6d822d-a19b-4fb7-aa0f-8cdaee29695b - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 18:33:38.579 1 INFO cinder.rpc [req-0f6d822d-a19b-4fb7-aa0f-8cdaee29695b - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 18:33:38.585 1 INFO cinder.rpc [req-0f6d822d-a19b-4fb7-aa0f-8cdaee29695b - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 18:33:38.598 1 INFO cinder.rpc [req-0f6d822d-a19b-4fb7-aa0f-8cdaee29695b - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 18:33:38.605 1 INFO cinder.rpc [req-0f6d822d-a19b-4fb7-aa0f-8cdaee29695b - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 18:33:38.632 1 WARNING oslo_config.cfg [req-0f6d822d-a19b-4fb7-aa0f-8cdaee29695b - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 18:33:38.635 1 WARNING oslo_config.cfg [req-0f6d822d-a19b-4fb7-aa0f-8cdaee29695b - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:33:38.636 1 WARNING oslo_config.cfg [req-0f6d822d-a19b-4fb7-aa0f-8cdaee29695b - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:33:38.636 1 WARNING oslo_config.cfg [req-0f6d822d-a19b-4fb7-aa0f-8cdaee29695b - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:33:38.642 1 WARNING oslo_config.cfg [req-0f6d822d-a19b-4fb7-aa0f-8cdaee29695b - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 18:33:38.643 1 WARNING oslo_config.cfg [req-0f6d822d-a19b-4fb7-aa0f-8cdaee29695b - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 18:33:38.646 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 18:33:38.654 1 INFO cinder.manager [req-c9ac0bed-d894-404f-8a4c-a107da9576da - - - - -] Initiating service 5 cleanup
>2018-06-25 18:33:38.660 1 INFO cinder.manager [req-c9ac0bed-d894-404f-8a4c-a107da9576da - - - - -] Service 5 cleanup completed.
>2018-06-25 18:35:51.132 1 ERROR oslo.messaging._drivers.impl_rabbit [req-c9ac0bed-d894-404f-8a4c-a107da9576da - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:35:51.134 1 ERROR oslo.messaging._drivers.impl_rabbit [req-c9ac0bed-d894-404f-8a4c-a107da9576da - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:35:51.134 1 ERROR oslo_service.service [req-c9ac0bed-d894-404f-8a4c-a107da9576da - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:35:51.134 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 18:35:51.134 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 18:35:51.134 1 ERROR oslo_service.service     service.start()
>2018-06-25 18:35:51.134 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 18:35:51.134 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 18:35:51.134 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 18:35:51.134 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 18:35:51.134 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 18:35:51.134 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 18:35:51.134 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 18:35:51.134 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 18:35:51.134 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 18:35:51.134 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 18:35:51.134 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 18:35:51.134 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 18:35:51.134 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 18:35:51.134 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 18:35:51.134 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 18:35:51.134 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 18:35:51.134 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 18:35:51.134 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 18:35:51.134 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 18:35:51.134 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 18:35:51.134 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 18:35:51.134 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 18:35:51.134 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:35:51.134 1 ERROR oslo_service.service 
>2018-06-25 18:35:51.137 1 CRITICAL cinder [req-0f6d822d-a19b-4fb7-aa0f-8cdaee29695b - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 18:35:51.137 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 18:35:51.137 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 18:35:51.137 1 ERROR cinder     sys.exit(main())
>2018-06-25 18:35:51.137 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 18:35:51.137 1 ERROR cinder     service.wait()
>2018-06-25 18:35:51.137 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 18:35:51.137 1 ERROR cinder     _launcher.wait()
>2018-06-25 18:35:51.137 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 18:35:51.137 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 18:35:51.137 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 18:35:51.137 1 ERROR cinder     self.services.wait()
>2018-06-25 18:35:51.137 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 18:35:51.137 1 ERROR cinder     service.wait()
>2018-06-25 18:35:51.137 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 18:35:51.137 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 18:35:51.137 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 18:35:51.137 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 18:35:51.137 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 18:35:51.137 1 ERROR cinder     post_fn = fn()
>2018-06-25 18:35:51.137 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 18:35:51.137 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 18:35:51.137 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 18:35:51.137 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 18:35:51.137 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 18:35:51.137 1 ERROR cinder 
>2018-06-25 18:35:53.853 1 WARNING cinder.scheduler.host_manager [req-10c3460e-6e3d-428f-a670-f25b8f3fddd1 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 18:35:53.860 1 INFO cinder.rpc [req-10c3460e-6e3d-428f-a670-f25b8f3fddd1 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 18:35:53.866 1 INFO cinder.rpc [req-10c3460e-6e3d-428f-a670-f25b8f3fddd1 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 18:35:53.878 1 INFO cinder.rpc [req-10c3460e-6e3d-428f-a670-f25b8f3fddd1 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 18:35:53.895 1 INFO cinder.rpc [req-10c3460e-6e3d-428f-a670-f25b8f3fddd1 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 18:35:53.933 1 WARNING oslo_config.cfg [req-10c3460e-6e3d-428f-a670-f25b8f3fddd1 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 18:35:53.936 1 WARNING oslo_config.cfg [req-10c3460e-6e3d-428f-a670-f25b8f3fddd1 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:35:53.937 1 WARNING oslo_config.cfg [req-10c3460e-6e3d-428f-a670-f25b8f3fddd1 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:35:53.937 1 WARNING oslo_config.cfg [req-10c3460e-6e3d-428f-a670-f25b8f3fddd1 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:35:53.943 1 WARNING oslo_config.cfg [req-10c3460e-6e3d-428f-a670-f25b8f3fddd1 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 18:35:53.944 1 WARNING oslo_config.cfg [req-10c3460e-6e3d-428f-a670-f25b8f3fddd1 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 18:35:53.948 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 18:35:53.958 1 INFO cinder.manager [req-dec0368d-0a88-409c-b376-2fb6eeea4195 - - - - -] Initiating service 5 cleanup
>2018-06-25 18:35:53.969 1 INFO cinder.manager [req-dec0368d-0a88-409c-b376-2fb6eeea4195 - - - - -] Service 5 cleanup completed.
>2018-06-25 18:38:00.199 1 ERROR oslo.messaging._drivers.impl_rabbit [req-dec0368d-0a88-409c-b376-2fb6eeea4195 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:38:00.201 1 ERROR oslo.messaging._drivers.impl_rabbit [req-dec0368d-0a88-409c-b376-2fb6eeea4195 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:38:00.201 1 ERROR oslo_service.service [req-dec0368d-0a88-409c-b376-2fb6eeea4195 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:38:00.201 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 18:38:00.201 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 18:38:00.201 1 ERROR oslo_service.service     service.start()
>2018-06-25 18:38:00.201 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 18:38:00.201 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 18:38:00.201 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 18:38:00.201 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 18:38:00.201 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 18:38:00.201 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 18:38:00.201 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 18:38:00.201 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 18:38:00.201 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 18:38:00.201 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 18:38:00.201 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 18:38:00.201 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 18:38:00.201 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 18:38:00.201 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 18:38:00.201 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 18:38:00.201 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 18:38:00.201 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 18:38:00.201 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 18:38:00.201 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 18:38:00.201 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 18:38:00.201 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 18:38:00.201 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 18:38:00.201 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:38:00.201 1 ERROR oslo_service.service 
>2018-06-25 18:38:00.204 1 CRITICAL cinder [req-10c3460e-6e3d-428f-a670-f25b8f3fddd1 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 18:38:00.204 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 18:38:00.204 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 18:38:00.204 1 ERROR cinder     sys.exit(main())
>2018-06-25 18:38:00.204 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 18:38:00.204 1 ERROR cinder     service.wait()
>2018-06-25 18:38:00.204 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 18:38:00.204 1 ERROR cinder     _launcher.wait()
>2018-06-25 18:38:00.204 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 18:38:00.204 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 18:38:00.204 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 18:38:00.204 1 ERROR cinder     self.services.wait()
>2018-06-25 18:38:00.204 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 18:38:00.204 1 ERROR cinder     service.wait()
>2018-06-25 18:38:00.204 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 18:38:00.204 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 18:38:00.204 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 18:38:00.204 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 18:38:00.204 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 18:38:00.204 1 ERROR cinder     post_fn = fn()
>2018-06-25 18:38:00.204 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 18:38:00.204 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 18:38:00.204 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 18:38:00.204 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 18:38:00.204 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 18:38:00.204 1 ERROR cinder 
>2018-06-25 18:38:02.892 1 WARNING cinder.scheduler.host_manager [req-2a85caed-942e-4ccd-a8de-8b28d61ef366 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 18:38:02.898 1 INFO cinder.rpc [req-2a85caed-942e-4ccd-a8de-8b28d61ef366 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 18:38:02.904 1 INFO cinder.rpc [req-2a85caed-942e-4ccd-a8de-8b28d61ef366 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 18:38:02.917 1 INFO cinder.rpc [req-2a85caed-942e-4ccd-a8de-8b28d61ef366 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 18:38:02.923 1 INFO cinder.rpc [req-2a85caed-942e-4ccd-a8de-8b28d61ef366 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 18:38:02.947 1 WARNING oslo_config.cfg [req-2a85caed-942e-4ccd-a8de-8b28d61ef366 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 18:38:02.950 1 WARNING oslo_config.cfg [req-2a85caed-942e-4ccd-a8de-8b28d61ef366 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:38:02.950 1 WARNING oslo_config.cfg [req-2a85caed-942e-4ccd-a8de-8b28d61ef366 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:38:02.951 1 WARNING oslo_config.cfg [req-2a85caed-942e-4ccd-a8de-8b28d61ef366 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:38:02.956 1 WARNING oslo_config.cfg [req-2a85caed-942e-4ccd-a8de-8b28d61ef366 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 18:38:02.957 1 WARNING oslo_config.cfg [req-2a85caed-942e-4ccd-a8de-8b28d61ef366 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 18:38:02.960 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 18:38:02.969 1 INFO cinder.manager [req-822ce47f-be03-4668-8419-1dae6505f81b - - - - -] Initiating service 5 cleanup
>2018-06-25 18:38:02.974 1 INFO cinder.manager [req-822ce47f-be03-4668-8419-1dae6505f81b - - - - -] Service 5 cleanup completed.
>2018-06-25 18:40:07.324 1 ERROR oslo.messaging._drivers.impl_rabbit [req-822ce47f-be03-4668-8419-1dae6505f81b - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:40:07.327 1 ERROR oslo.messaging._drivers.impl_rabbit [req-822ce47f-be03-4668-8419-1dae6505f81b - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:40:07.327 1 ERROR oslo_service.service [req-822ce47f-be03-4668-8419-1dae6505f81b - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:40:07.327 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 18:40:07.327 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 18:40:07.327 1 ERROR oslo_service.service     service.start()
>2018-06-25 18:40:07.327 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 18:40:07.327 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 18:40:07.327 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 18:40:07.327 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 18:40:07.327 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 18:40:07.327 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 18:40:07.327 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 18:40:07.327 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 18:40:07.327 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 18:40:07.327 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 18:40:07.327 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 18:40:07.327 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 18:40:07.327 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 18:40:07.327 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 18:40:07.327 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 18:40:07.327 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 18:40:07.327 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 18:40:07.327 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 18:40:07.327 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 18:40:07.327 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 18:40:07.327 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 18:40:07.327 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 18:40:07.327 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:40:07.327 1 ERROR oslo_service.service 
>2018-06-25 18:40:07.331 1 CRITICAL cinder [req-2a85caed-942e-4ccd-a8de-8b28d61ef366 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 18:40:07.331 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 18:40:07.331 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 18:40:07.331 1 ERROR cinder     sys.exit(main())
>2018-06-25 18:40:07.331 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 18:40:07.331 1 ERROR cinder     service.wait()
>2018-06-25 18:40:07.331 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 18:40:07.331 1 ERROR cinder     _launcher.wait()
>2018-06-25 18:40:07.331 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 18:40:07.331 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 18:40:07.331 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 18:40:07.331 1 ERROR cinder     self.services.wait()
>2018-06-25 18:40:07.331 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 18:40:07.331 1 ERROR cinder     service.wait()
>2018-06-25 18:40:07.331 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 18:40:07.331 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 18:40:07.331 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 18:40:07.331 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 18:40:07.331 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 18:40:07.331 1 ERROR cinder     post_fn = fn()
>2018-06-25 18:40:07.331 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 18:40:07.331 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 18:40:07.331 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 18:40:07.331 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 18:40:07.331 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 18:40:07.331 1 ERROR cinder 
>2018-06-25 18:40:10.062 1 WARNING cinder.scheduler.host_manager [req-5d3c44ce-3034-4895-827b-c8fed5ac25c1 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 18:40:10.067 1 INFO cinder.rpc [req-5d3c44ce-3034-4895-827b-c8fed5ac25c1 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 18:40:10.073 1 INFO cinder.rpc [req-5d3c44ce-3034-4895-827b-c8fed5ac25c1 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 18:40:10.085 1 INFO cinder.rpc [req-5d3c44ce-3034-4895-827b-c8fed5ac25c1 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 18:40:10.093 1 INFO cinder.rpc [req-5d3c44ce-3034-4895-827b-c8fed5ac25c1 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 18:40:10.123 1 WARNING oslo_config.cfg [req-5d3c44ce-3034-4895-827b-c8fed5ac25c1 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 18:40:10.126 1 WARNING oslo_config.cfg [req-5d3c44ce-3034-4895-827b-c8fed5ac25c1 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:40:10.126 1 WARNING oslo_config.cfg [req-5d3c44ce-3034-4895-827b-c8fed5ac25c1 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:40:10.127 1 WARNING oslo_config.cfg [req-5d3c44ce-3034-4895-827b-c8fed5ac25c1 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:40:10.132 1 WARNING oslo_config.cfg [req-5d3c44ce-3034-4895-827b-c8fed5ac25c1 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 18:40:10.134 1 WARNING oslo_config.cfg [req-5d3c44ce-3034-4895-827b-c8fed5ac25c1 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 18:40:10.137 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 18:40:10.144 1 INFO cinder.manager [req-a4f0a8a0-ea33-4d46-bf9c-9fb2094af7e7 - - - - -] Initiating service 5 cleanup
>2018-06-25 18:40:10.149 1 INFO cinder.manager [req-a4f0a8a0-ea33-4d46-bf9c-9fb2094af7e7 - - - - -] Service 5 cleanup completed.
>2018-06-25 18:42:14.566 1 ERROR oslo.messaging._drivers.impl_rabbit [req-a4f0a8a0-ea33-4d46-bf9c-9fb2094af7e7 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:42:14.568 1 ERROR oslo.messaging._drivers.impl_rabbit [req-a4f0a8a0-ea33-4d46-bf9c-9fb2094af7e7 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:42:14.568 1 ERROR oslo_service.service [req-a4f0a8a0-ea33-4d46-bf9c-9fb2094af7e7 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:42:14.568 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 18:42:14.568 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 18:42:14.568 1 ERROR oslo_service.service     service.start()
>2018-06-25 18:42:14.568 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 18:42:14.568 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 18:42:14.568 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 18:42:14.568 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 18:42:14.568 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 18:42:14.568 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 18:42:14.568 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 18:42:14.568 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 18:42:14.568 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 18:42:14.568 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 18:42:14.568 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 18:42:14.568 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 18:42:14.568 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 18:42:14.568 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 18:42:14.568 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 18:42:14.568 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 18:42:14.568 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 18:42:14.568 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 18:42:14.568 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 18:42:14.568 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 18:42:14.568 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 18:42:14.568 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 18:42:14.568 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:42:14.568 1 ERROR oslo_service.service 
>2018-06-25 18:42:14.571 1 CRITICAL cinder [req-5d3c44ce-3034-4895-827b-c8fed5ac25c1 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 18:42:14.571 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 18:42:14.571 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 18:42:14.571 1 ERROR cinder     sys.exit(main())
>2018-06-25 18:42:14.571 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 18:42:14.571 1 ERROR cinder     service.wait()
>2018-06-25 18:42:14.571 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 18:42:14.571 1 ERROR cinder     _launcher.wait()
>2018-06-25 18:42:14.571 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 18:42:14.571 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 18:42:14.571 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 18:42:14.571 1 ERROR cinder     self.services.wait()
>2018-06-25 18:42:14.571 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 18:42:14.571 1 ERROR cinder     service.wait()
>2018-06-25 18:42:14.571 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 18:42:14.571 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 18:42:14.571 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 18:42:14.571 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 18:42:14.571 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 18:42:14.571 1 ERROR cinder     post_fn = fn()
>2018-06-25 18:42:14.571 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 18:42:14.571 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 18:42:14.571 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 18:42:14.571 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 18:42:14.571 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 18:42:14.571 1 ERROR cinder 
>2018-06-25 18:42:17.211 1 WARNING cinder.scheduler.host_manager [req-8d21292e-ee86-4fb3-967b-938428c36ece - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 18:42:17.216 1 INFO cinder.rpc [req-8d21292e-ee86-4fb3-967b-938428c36ece - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 18:42:17.222 1 INFO cinder.rpc [req-8d21292e-ee86-4fb3-967b-938428c36ece - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 18:42:17.237 1 INFO cinder.rpc [req-8d21292e-ee86-4fb3-967b-938428c36ece - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 18:42:17.244 1 INFO cinder.rpc [req-8d21292e-ee86-4fb3-967b-938428c36ece - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 18:42:17.265 1 WARNING oslo_config.cfg [req-8d21292e-ee86-4fb3-967b-938428c36ece - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 18:42:17.267 1 WARNING oslo_config.cfg [req-8d21292e-ee86-4fb3-967b-938428c36ece - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:42:17.267 1 WARNING oslo_config.cfg [req-8d21292e-ee86-4fb3-967b-938428c36ece - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:42:17.268 1 WARNING oslo_config.cfg [req-8d21292e-ee86-4fb3-967b-938428c36ece - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:42:17.273 1 WARNING oslo_config.cfg [req-8d21292e-ee86-4fb3-967b-938428c36ece - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 18:42:17.274 1 WARNING oslo_config.cfg [req-8d21292e-ee86-4fb3-967b-938428c36ece - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 18:42:17.276 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 18:42:17.282 1 INFO cinder.manager [req-04f9604f-272b-4db4-bb25-aef7b4bfbedb - - - - -] Initiating service 5 cleanup
>2018-06-25 18:42:17.286 1 INFO cinder.manager [req-04f9604f-272b-4db4-bb25-aef7b4bfbedb - - - - -] Service 5 cleanup completed.
>2018-06-25 18:44:23.109 1 ERROR oslo.messaging._drivers.impl_rabbit [req-04f9604f-272b-4db4-bb25-aef7b4bfbedb - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:44:23.110 1 ERROR oslo.messaging._drivers.impl_rabbit [req-04f9604f-272b-4db4-bb25-aef7b4bfbedb - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:44:23.111 1 ERROR oslo_service.service [req-04f9604f-272b-4db4-bb25-aef7b4bfbedb - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:44:23.111 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 18:44:23.111 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 18:44:23.111 1 ERROR oslo_service.service     service.start()
>2018-06-25 18:44:23.111 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 18:44:23.111 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 18:44:23.111 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 18:44:23.111 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 18:44:23.111 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 18:44:23.111 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 18:44:23.111 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 18:44:23.111 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 18:44:23.111 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 18:44:23.111 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 18:44:23.111 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 18:44:23.111 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 18:44:23.111 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 18:44:23.111 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 18:44:23.111 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 18:44:23.111 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 18:44:23.111 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 18:44:23.111 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 18:44:23.111 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 18:44:23.111 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 18:44:23.111 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 18:44:23.111 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 18:44:23.111 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:44:23.111 1 ERROR oslo_service.service 
>2018-06-25 18:44:23.114 1 CRITICAL cinder [req-8d21292e-ee86-4fb3-967b-938428c36ece - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 18:44:23.114 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 18:44:23.114 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 18:44:23.114 1 ERROR cinder     sys.exit(main())
>2018-06-25 18:44:23.114 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 18:44:23.114 1 ERROR cinder     service.wait()
>2018-06-25 18:44:23.114 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 18:44:23.114 1 ERROR cinder     _launcher.wait()
>2018-06-25 18:44:23.114 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 18:44:23.114 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 18:44:23.114 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 18:44:23.114 1 ERROR cinder     self.services.wait()
>2018-06-25 18:44:23.114 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 18:44:23.114 1 ERROR cinder     service.wait()
>2018-06-25 18:44:23.114 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 18:44:23.114 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 18:44:23.114 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 18:44:23.114 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 18:44:23.114 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 18:44:23.114 1 ERROR cinder     post_fn = fn()
>2018-06-25 18:44:23.114 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 18:44:23.114 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 18:44:23.114 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 18:44:23.114 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 18:44:23.114 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 18:44:23.114 1 ERROR cinder 
>2018-06-25 18:44:25.875 1 WARNING cinder.scheduler.host_manager [req-4cdc9230-018f-40fb-8428-2431515cfe59 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 18:44:25.882 1 INFO cinder.rpc [req-4cdc9230-018f-40fb-8428-2431515cfe59 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 18:44:25.888 1 INFO cinder.rpc [req-4cdc9230-018f-40fb-8428-2431515cfe59 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 18:44:25.899 1 INFO cinder.rpc [req-4cdc9230-018f-40fb-8428-2431515cfe59 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 18:44:25.905 1 INFO cinder.rpc [req-4cdc9230-018f-40fb-8428-2431515cfe59 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 18:44:25.928 1 WARNING oslo_config.cfg [req-4cdc9230-018f-40fb-8428-2431515cfe59 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 18:44:25.930 1 WARNING oslo_config.cfg [req-4cdc9230-018f-40fb-8428-2431515cfe59 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:44:25.931 1 WARNING oslo_config.cfg [req-4cdc9230-018f-40fb-8428-2431515cfe59 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:44:25.931 1 WARNING oslo_config.cfg [req-4cdc9230-018f-40fb-8428-2431515cfe59 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:44:25.937 1 WARNING oslo_config.cfg [req-4cdc9230-018f-40fb-8428-2431515cfe59 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 18:44:25.938 1 WARNING oslo_config.cfg [req-4cdc9230-018f-40fb-8428-2431515cfe59 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 18:44:25.941 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 18:44:25.946 1 INFO cinder.manager [req-df4786bc-13c8-437c-8d85-3e30804afe73 - - - - -] Initiating service 5 cleanup
>2018-06-25 18:44:25.954 1 INFO cinder.manager [req-df4786bc-13c8-437c-8d85-3e30804afe73 - - - - -] Service 5 cleanup completed.
>2018-06-25 18:46:30.364 1 ERROR oslo.messaging._drivers.impl_rabbit [req-df4786bc-13c8-437c-8d85-3e30804afe73 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:46:30.368 1 ERROR oslo.messaging._drivers.impl_rabbit [req-df4786bc-13c8-437c-8d85-3e30804afe73 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:46:30.369 1 ERROR oslo_service.service [req-df4786bc-13c8-437c-8d85-3e30804afe73 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:46:30.369 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 18:46:30.369 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 18:46:30.369 1 ERROR oslo_service.service     service.start()
>2018-06-25 18:46:30.369 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 18:46:30.369 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 18:46:30.369 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 18:46:30.369 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 18:46:30.369 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 18:46:30.369 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 18:46:30.369 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 18:46:30.369 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 18:46:30.369 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 18:46:30.369 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 18:46:30.369 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 18:46:30.369 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 18:46:30.369 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 18:46:30.369 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 18:46:30.369 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 18:46:30.369 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 18:46:30.369 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 18:46:30.369 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 18:46:30.369 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 18:46:30.369 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 18:46:30.369 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 18:46:30.369 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 18:46:30.369 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:46:30.369 1 ERROR oslo_service.service 
>2018-06-25 18:46:30.372 1 CRITICAL cinder [req-4cdc9230-018f-40fb-8428-2431515cfe59 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 18:46:30.372 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 18:46:30.372 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 18:46:30.372 1 ERROR cinder     sys.exit(main())
>2018-06-25 18:46:30.372 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 18:46:30.372 1 ERROR cinder     service.wait()
>2018-06-25 18:46:30.372 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 18:46:30.372 1 ERROR cinder     _launcher.wait()
>2018-06-25 18:46:30.372 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 18:46:30.372 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 18:46:30.372 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 18:46:30.372 1 ERROR cinder     self.services.wait()
>2018-06-25 18:46:30.372 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 18:46:30.372 1 ERROR cinder     service.wait()
>2018-06-25 18:46:30.372 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 18:46:30.372 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 18:46:30.372 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 18:46:30.372 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 18:46:30.372 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 18:46:30.372 1 ERROR cinder     post_fn = fn()
>2018-06-25 18:46:30.372 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 18:46:30.372 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 18:46:30.372 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 18:46:30.372 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 18:46:30.372 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 18:46:30.372 1 ERROR cinder 
>2018-06-25 18:46:33.107 1 WARNING cinder.scheduler.host_manager [req-664d528b-39ae-463e-adea-330a460c53a7 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 18:46:33.113 1 INFO cinder.rpc [req-664d528b-39ae-463e-adea-330a460c53a7 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 18:46:33.121 1 INFO cinder.rpc [req-664d528b-39ae-463e-adea-330a460c53a7 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 18:46:33.132 1 INFO cinder.rpc [req-664d528b-39ae-463e-adea-330a460c53a7 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 18:46:33.139 1 INFO cinder.rpc [req-664d528b-39ae-463e-adea-330a460c53a7 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 18:46:33.162 1 WARNING oslo_config.cfg [req-664d528b-39ae-463e-adea-330a460c53a7 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 18:46:33.164 1 WARNING oslo_config.cfg [req-664d528b-39ae-463e-adea-330a460c53a7 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:46:33.165 1 WARNING oslo_config.cfg [req-664d528b-39ae-463e-adea-330a460c53a7 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:46:33.165 1 WARNING oslo_config.cfg [req-664d528b-39ae-463e-adea-330a460c53a7 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:46:33.170 1 WARNING oslo_config.cfg [req-664d528b-39ae-463e-adea-330a460c53a7 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 18:46:33.172 1 WARNING oslo_config.cfg [req-664d528b-39ae-463e-adea-330a460c53a7 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 18:46:33.174 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 18:46:33.181 1 INFO cinder.manager [req-340a8fb2-7c0d-4cf7-9b29-b8303887c603 - - - - -] Initiating service 5 cleanup
>2018-06-25 18:46:33.186 1 INFO cinder.manager [req-340a8fb2-7c0d-4cf7-9b29-b8303887c603 - - - - -] Service 5 cleanup completed.
>2018-06-25 18:48:39.266 1 ERROR oslo.messaging._drivers.impl_rabbit [req-340a8fb2-7c0d-4cf7-9b29-b8303887c603 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:48:39.268 1 ERROR oslo.messaging._drivers.impl_rabbit [req-340a8fb2-7c0d-4cf7-9b29-b8303887c603 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:48:39.269 1 ERROR oslo_service.service [req-340a8fb2-7c0d-4cf7-9b29-b8303887c603 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:48:39.269 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 18:48:39.269 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 18:48:39.269 1 ERROR oslo_service.service     service.start()
>2018-06-25 18:48:39.269 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 18:48:39.269 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 18:48:39.269 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 18:48:39.269 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 18:48:39.269 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 18:48:39.269 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 18:48:39.269 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 18:48:39.269 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 18:48:39.269 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 18:48:39.269 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 18:48:39.269 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 18:48:39.269 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 18:48:39.269 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 18:48:39.269 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 18:48:39.269 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 18:48:39.269 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 18:48:39.269 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 18:48:39.269 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 18:48:39.269 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 18:48:39.269 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 18:48:39.269 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 18:48:39.269 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 18:48:39.269 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:48:39.269 1 ERROR oslo_service.service 
>2018-06-25 18:48:39.272 1 CRITICAL cinder [req-664d528b-39ae-463e-adea-330a460c53a7 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 18:48:39.272 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 18:48:39.272 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 18:48:39.272 1 ERROR cinder     sys.exit(main())
>2018-06-25 18:48:39.272 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 18:48:39.272 1 ERROR cinder     service.wait()
>2018-06-25 18:48:39.272 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 18:48:39.272 1 ERROR cinder     _launcher.wait()
>2018-06-25 18:48:39.272 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 18:48:39.272 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 18:48:39.272 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 18:48:39.272 1 ERROR cinder     self.services.wait()
>2018-06-25 18:48:39.272 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 18:48:39.272 1 ERROR cinder     service.wait()
>2018-06-25 18:48:39.272 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 18:48:39.272 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 18:48:39.272 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 18:48:39.272 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 18:48:39.272 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 18:48:39.272 1 ERROR cinder     post_fn = fn()
>2018-06-25 18:48:39.272 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 18:48:39.272 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 18:48:39.272 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 18:48:39.272 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 18:48:39.272 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 18:48:39.272 1 ERROR cinder 
>2018-06-25 18:48:42.077 1 WARNING cinder.scheduler.host_manager [req-9a89f7ba-8cf1-4889-9936-989d0ad06ddf - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 18:48:42.093 1 INFO cinder.rpc [req-9a89f7ba-8cf1-4889-9936-989d0ad06ddf - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 18:48:42.104 1 INFO cinder.rpc [req-9a89f7ba-8cf1-4889-9936-989d0ad06ddf - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 18:48:42.120 1 INFO cinder.rpc [req-9a89f7ba-8cf1-4889-9936-989d0ad06ddf - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 18:48:42.126 1 INFO cinder.rpc [req-9a89f7ba-8cf1-4889-9936-989d0ad06ddf - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 18:48:42.156 1 WARNING oslo_config.cfg [req-9a89f7ba-8cf1-4889-9936-989d0ad06ddf - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 18:48:42.158 1 WARNING oslo_config.cfg [req-9a89f7ba-8cf1-4889-9936-989d0ad06ddf - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:48:42.159 1 WARNING oslo_config.cfg [req-9a89f7ba-8cf1-4889-9936-989d0ad06ddf - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:48:42.159 1 WARNING oslo_config.cfg [req-9a89f7ba-8cf1-4889-9936-989d0ad06ddf - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:48:42.165 1 WARNING oslo_config.cfg [req-9a89f7ba-8cf1-4889-9936-989d0ad06ddf - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 18:48:42.166 1 WARNING oslo_config.cfg [req-9a89f7ba-8cf1-4889-9936-989d0ad06ddf - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 18:48:42.169 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 18:48:42.176 1 INFO cinder.manager [req-7e65ffe8-3e39-4b0b-b475-0ec50e016e33 - - - - -] Initiating service 5 cleanup
>2018-06-25 18:48:42.181 1 INFO cinder.manager [req-7e65ffe8-3e39-4b0b-b475-0ec50e016e33 - - - - -] Service 5 cleanup completed.
>2018-06-25 18:50:46.587 1 ERROR oslo.messaging._drivers.impl_rabbit [req-7e65ffe8-3e39-4b0b-b475-0ec50e016e33 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:50:46.589 1 ERROR oslo.messaging._drivers.impl_rabbit [req-7e65ffe8-3e39-4b0b-b475-0ec50e016e33 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:50:46.589 1 ERROR oslo_service.service [req-7e65ffe8-3e39-4b0b-b475-0ec50e016e33 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:50:46.589 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 18:50:46.589 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 18:50:46.589 1 ERROR oslo_service.service     service.start()
>2018-06-25 18:50:46.589 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 18:50:46.589 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 18:50:46.589 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 18:50:46.589 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 18:50:46.589 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 18:50:46.589 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 18:50:46.589 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 18:50:46.589 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 18:50:46.589 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 18:50:46.589 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 18:50:46.589 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 18:50:46.589 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 18:50:46.589 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 18:50:46.589 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 18:50:46.589 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 18:50:46.589 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 18:50:46.589 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 18:50:46.589 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 18:50:46.589 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 18:50:46.589 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 18:50:46.589 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 18:50:46.589 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 18:50:46.589 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:50:46.589 1 ERROR oslo_service.service 
>2018-06-25 18:50:46.592 1 CRITICAL cinder [req-9a89f7ba-8cf1-4889-9936-989d0ad06ddf - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 18:50:46.592 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 18:50:46.592 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 18:50:46.592 1 ERROR cinder     sys.exit(main())
>2018-06-25 18:50:46.592 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 18:50:46.592 1 ERROR cinder     service.wait()
>2018-06-25 18:50:46.592 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 18:50:46.592 1 ERROR cinder     _launcher.wait()
>2018-06-25 18:50:46.592 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 18:50:46.592 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 18:50:46.592 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 18:50:46.592 1 ERROR cinder     self.services.wait()
>2018-06-25 18:50:46.592 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 18:50:46.592 1 ERROR cinder     service.wait()
>2018-06-25 18:50:46.592 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 18:50:46.592 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 18:50:46.592 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 18:50:46.592 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 18:50:46.592 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 18:50:46.592 1 ERROR cinder     post_fn = fn()
>2018-06-25 18:50:46.592 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 18:50:46.592 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 18:50:46.592 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 18:50:46.592 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 18:50:46.592 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 18:50:46.592 1 ERROR cinder 
>2018-06-25 18:50:49.422 1 WARNING cinder.scheduler.host_manager [req-90e722c7-9217-41e3-871d-423954336a84 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 18:50:49.432 1 INFO cinder.rpc [req-90e722c7-9217-41e3-871d-423954336a84 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 18:50:49.444 1 INFO cinder.rpc [req-90e722c7-9217-41e3-871d-423954336a84 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 18:50:49.478 1 INFO cinder.rpc [req-90e722c7-9217-41e3-871d-423954336a84 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 18:50:49.487 1 INFO cinder.rpc [req-90e722c7-9217-41e3-871d-423954336a84 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 18:50:49.563 1 WARNING oslo_config.cfg [req-90e722c7-9217-41e3-871d-423954336a84 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 18:50:49.565 1 WARNING oslo_config.cfg [req-90e722c7-9217-41e3-871d-423954336a84 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:50:49.566 1 WARNING oslo_config.cfg [req-90e722c7-9217-41e3-871d-423954336a84 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:50:49.567 1 WARNING oslo_config.cfg [req-90e722c7-9217-41e3-871d-423954336a84 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:50:49.572 1 WARNING oslo_config.cfg [req-90e722c7-9217-41e3-871d-423954336a84 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 18:50:49.573 1 WARNING oslo_config.cfg [req-90e722c7-9217-41e3-871d-423954336a84 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 18:50:49.577 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 18:50:49.588 1 INFO cinder.manager [req-ae132c1c-7817-470e-9df9-ab775916d85a - - - - -] Initiating service 5 cleanup
>2018-06-25 18:50:49.597 1 INFO cinder.manager [req-ae132c1c-7817-470e-9df9-ab775916d85a - - - - -] Service 5 cleanup completed.
>2018-06-25 18:52:53.943 1 ERROR oslo.messaging._drivers.impl_rabbit [req-ae132c1c-7817-470e-9df9-ab775916d85a - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:52:53.945 1 ERROR oslo.messaging._drivers.impl_rabbit [req-ae132c1c-7817-470e-9df9-ab775916d85a - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:52:53.945 1 ERROR oslo_service.service [req-ae132c1c-7817-470e-9df9-ab775916d85a - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:52:53.945 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 18:52:53.945 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 18:52:53.945 1 ERROR oslo_service.service     service.start()
>2018-06-25 18:52:53.945 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 18:52:53.945 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 18:52:53.945 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 18:52:53.945 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 18:52:53.945 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 18:52:53.945 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 18:52:53.945 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 18:52:53.945 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 18:52:53.945 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 18:52:53.945 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 18:52:53.945 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 18:52:53.945 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 18:52:53.945 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 18:52:53.945 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 18:52:53.945 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 18:52:53.945 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 18:52:53.945 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 18:52:53.945 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 18:52:53.945 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 18:52:53.945 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 18:52:53.945 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 18:52:53.945 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 18:52:53.945 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:52:53.945 1 ERROR oslo_service.service 
>2018-06-25 18:52:53.949 1 CRITICAL cinder [req-90e722c7-9217-41e3-871d-423954336a84 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 18:52:53.949 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 18:52:53.949 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 18:52:53.949 1 ERROR cinder     sys.exit(main())
>2018-06-25 18:52:53.949 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 18:52:53.949 1 ERROR cinder     service.wait()
>2018-06-25 18:52:53.949 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 18:52:53.949 1 ERROR cinder     _launcher.wait()
>2018-06-25 18:52:53.949 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 18:52:53.949 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 18:52:53.949 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 18:52:53.949 1 ERROR cinder     self.services.wait()
>2018-06-25 18:52:53.949 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 18:52:53.949 1 ERROR cinder     service.wait()
>2018-06-25 18:52:53.949 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 18:52:53.949 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 18:52:53.949 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 18:52:53.949 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 18:52:53.949 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 18:52:53.949 1 ERROR cinder     post_fn = fn()
>2018-06-25 18:52:53.949 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 18:52:53.949 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 18:52:53.949 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 18:52:53.949 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 18:52:53.949 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 18:52:53.949 1 ERROR cinder 
>2018-06-25 18:52:56.609 1 WARNING cinder.scheduler.host_manager [req-3fa1833c-d8da-4ab6-956b-614a6e0f891e - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 18:52:56.616 1 INFO cinder.rpc [req-3fa1833c-d8da-4ab6-956b-614a6e0f891e - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 18:52:56.621 1 INFO cinder.rpc [req-3fa1833c-d8da-4ab6-956b-614a6e0f891e - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 18:52:56.632 1 INFO cinder.rpc [req-3fa1833c-d8da-4ab6-956b-614a6e0f891e - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 18:52:56.639 1 INFO cinder.rpc [req-3fa1833c-d8da-4ab6-956b-614a6e0f891e - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 18:52:56.661 1 WARNING oslo_config.cfg [req-3fa1833c-d8da-4ab6-956b-614a6e0f891e - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 18:52:56.663 1 WARNING oslo_config.cfg [req-3fa1833c-d8da-4ab6-956b-614a6e0f891e - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:52:56.663 1 WARNING oslo_config.cfg [req-3fa1833c-d8da-4ab6-956b-614a6e0f891e - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:52:56.664 1 WARNING oslo_config.cfg [req-3fa1833c-d8da-4ab6-956b-614a6e0f891e - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:52:56.668 1 WARNING oslo_config.cfg [req-3fa1833c-d8da-4ab6-956b-614a6e0f891e - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 18:52:56.669 1 WARNING oslo_config.cfg [req-3fa1833c-d8da-4ab6-956b-614a6e0f891e - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 18:52:56.672 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 18:52:56.678 1 INFO cinder.manager [req-230097db-2639-4a48-84ae-2a16dad1fa98 - - - - -] Initiating service 5 cleanup
>2018-06-25 18:52:56.682 1 INFO cinder.manager [req-230097db-2639-4a48-84ae-2a16dad1fa98 - - - - -] Service 5 cleanup completed.
>2018-06-25 18:55:02.936 1 ERROR oslo.messaging._drivers.impl_rabbit [req-230097db-2639-4a48-84ae-2a16dad1fa98 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:55:02.938 1 ERROR oslo.messaging._drivers.impl_rabbit [req-230097db-2639-4a48-84ae-2a16dad1fa98 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:55:02.938 1 ERROR oslo_service.service [req-230097db-2639-4a48-84ae-2a16dad1fa98 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:55:02.938 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 18:55:02.938 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 18:55:02.938 1 ERROR oslo_service.service     service.start()
>2018-06-25 18:55:02.938 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 18:55:02.938 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 18:55:02.938 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 18:55:02.938 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 18:55:02.938 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 18:55:02.938 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 18:55:02.938 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 18:55:02.938 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 18:55:02.938 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 18:55:02.938 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 18:55:02.938 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 18:55:02.938 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 18:55:02.938 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 18:55:02.938 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 18:55:02.938 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 18:55:02.938 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 18:55:02.938 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 18:55:02.938 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 18:55:02.938 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 18:55:02.938 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 18:55:02.938 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 18:55:02.938 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 18:55:02.938 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:55:02.938 1 ERROR oslo_service.service 
>2018-06-25 18:55:02.941 1 CRITICAL cinder [req-3fa1833c-d8da-4ab6-956b-614a6e0f891e - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 18:55:02.941 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 18:55:02.941 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 18:55:02.941 1 ERROR cinder     sys.exit(main())
>2018-06-25 18:55:02.941 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 18:55:02.941 1 ERROR cinder     service.wait()
>2018-06-25 18:55:02.941 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 18:55:02.941 1 ERROR cinder     _launcher.wait()
>2018-06-25 18:55:02.941 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 18:55:02.941 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 18:55:02.941 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 18:55:02.941 1 ERROR cinder     self.services.wait()
>2018-06-25 18:55:02.941 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 18:55:02.941 1 ERROR cinder     service.wait()
>2018-06-25 18:55:02.941 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 18:55:02.941 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 18:55:02.941 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 18:55:02.941 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 18:55:02.941 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 18:55:02.941 1 ERROR cinder     post_fn = fn()
>2018-06-25 18:55:02.941 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 18:55:02.941 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 18:55:02.941 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 18:55:02.941 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 18:55:02.941 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 18:55:02.941 1 ERROR cinder 
>2018-06-25 18:55:05.750 1 WARNING cinder.scheduler.host_manager [req-3ffdef10-a77b-4829-9f48-4bfafc60f836 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 18:55:05.756 1 INFO cinder.rpc [req-3ffdef10-a77b-4829-9f48-4bfafc60f836 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 18:55:05.761 1 INFO cinder.rpc [req-3ffdef10-a77b-4829-9f48-4bfafc60f836 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 18:55:05.773 1 INFO cinder.rpc [req-3ffdef10-a77b-4829-9f48-4bfafc60f836 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 18:55:05.781 1 INFO cinder.rpc [req-3ffdef10-a77b-4829-9f48-4bfafc60f836 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 18:55:05.810 1 WARNING oslo_config.cfg [req-3ffdef10-a77b-4829-9f48-4bfafc60f836 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 18:55:05.812 1 WARNING oslo_config.cfg [req-3ffdef10-a77b-4829-9f48-4bfafc60f836 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:55:05.813 1 WARNING oslo_config.cfg [req-3ffdef10-a77b-4829-9f48-4bfafc60f836 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:55:05.813 1 WARNING oslo_config.cfg [req-3ffdef10-a77b-4829-9f48-4bfafc60f836 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:55:05.818 1 WARNING oslo_config.cfg [req-3ffdef10-a77b-4829-9f48-4bfafc60f836 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 18:55:05.820 1 WARNING oslo_config.cfg [req-3ffdef10-a77b-4829-9f48-4bfafc60f836 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 18:55:05.822 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 18:55:05.828 1 INFO cinder.manager [req-e4d681e2-9bd1-49b2-abd5-b4ad4b4706f3 - - - - -] Initiating service 5 cleanup
>2018-06-25 18:55:05.832 1 INFO cinder.manager [req-e4d681e2-9bd1-49b2-abd5-b4ad4b4706f3 - - - - -] Service 5 cleanup completed.
>2018-06-25 18:57:17.489 1 ERROR oslo.messaging._drivers.impl_rabbit [req-e4d681e2-9bd1-49b2-abd5-b4ad4b4706f3 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:57:17.492 1 ERROR oslo.messaging._drivers.impl_rabbit [req-e4d681e2-9bd1-49b2-abd5-b4ad4b4706f3 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:57:17.492 1 ERROR oslo_service.service [req-e4d681e2-9bd1-49b2-abd5-b4ad4b4706f3 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:57:17.492 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 18:57:17.492 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 18:57:17.492 1 ERROR oslo_service.service     service.start()
>2018-06-25 18:57:17.492 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 18:57:17.492 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 18:57:17.492 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 18:57:17.492 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 18:57:17.492 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 18:57:17.492 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 18:57:17.492 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 18:57:17.492 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 18:57:17.492 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 18:57:17.492 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 18:57:17.492 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 18:57:17.492 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 18:57:17.492 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 18:57:17.492 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 18:57:17.492 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 18:57:17.492 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 18:57:17.492 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 18:57:17.492 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 18:57:17.492 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 18:57:17.492 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 18:57:17.492 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 18:57:17.492 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 18:57:17.492 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:57:17.492 1 ERROR oslo_service.service 
>2018-06-25 18:57:17.496 1 CRITICAL cinder [req-3ffdef10-a77b-4829-9f48-4bfafc60f836 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 18:57:17.496 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 18:57:17.496 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 18:57:17.496 1 ERROR cinder     sys.exit(main())
>2018-06-25 18:57:17.496 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 18:57:17.496 1 ERROR cinder     service.wait()
>2018-06-25 18:57:17.496 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 18:57:17.496 1 ERROR cinder     _launcher.wait()
>2018-06-25 18:57:17.496 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 18:57:17.496 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 18:57:17.496 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 18:57:17.496 1 ERROR cinder     self.services.wait()
>2018-06-25 18:57:17.496 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 18:57:17.496 1 ERROR cinder     service.wait()
>2018-06-25 18:57:17.496 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 18:57:17.496 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 18:57:17.496 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 18:57:17.496 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 18:57:17.496 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 18:57:17.496 1 ERROR cinder     post_fn = fn()
>2018-06-25 18:57:17.496 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 18:57:17.496 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 18:57:17.496 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 18:57:17.496 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 18:57:17.496 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 18:57:17.496 1 ERROR cinder 
>2018-06-25 18:57:20.267 1 WARNING cinder.scheduler.host_manager [req-104c4d2b-d3f7-4e5a-8823-52dd9c99b95d - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 18:57:20.277 1 INFO cinder.rpc [req-104c4d2b-d3f7-4e5a-8823-52dd9c99b95d - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 18:57:20.287 1 INFO cinder.rpc [req-104c4d2b-d3f7-4e5a-8823-52dd9c99b95d - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 18:57:20.299 1 INFO cinder.rpc [req-104c4d2b-d3f7-4e5a-8823-52dd9c99b95d - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 18:57:20.304 1 INFO cinder.rpc [req-104c4d2b-d3f7-4e5a-8823-52dd9c99b95d - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 18:57:20.330 1 WARNING oslo_config.cfg [req-104c4d2b-d3f7-4e5a-8823-52dd9c99b95d - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 18:57:20.332 1 WARNING oslo_config.cfg [req-104c4d2b-d3f7-4e5a-8823-52dd9c99b95d - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:57:20.332 1 WARNING oslo_config.cfg [req-104c4d2b-d3f7-4e5a-8823-52dd9c99b95d - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:57:20.333 1 WARNING oslo_config.cfg [req-104c4d2b-d3f7-4e5a-8823-52dd9c99b95d - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:57:20.338 1 WARNING oslo_config.cfg [req-104c4d2b-d3f7-4e5a-8823-52dd9c99b95d - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 18:57:20.339 1 WARNING oslo_config.cfg [req-104c4d2b-d3f7-4e5a-8823-52dd9c99b95d - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 18:57:20.342 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 18:57:20.348 1 INFO cinder.manager [req-b662160a-4c63-47bf-a208-603a5ed56b01 - - - - -] Initiating service 5 cleanup
>2018-06-25 18:57:20.354 1 INFO cinder.manager [req-b662160a-4c63-47bf-a208-603a5ed56b01 - - - - -] Service 5 cleanup completed.
>2018-06-25 18:59:32.424 1 ERROR oslo.messaging._drivers.impl_rabbit [req-b662160a-4c63-47bf-a208-603a5ed56b01 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:59:32.426 1 ERROR oslo.messaging._drivers.impl_rabbit [req-b662160a-4c63-47bf-a208-603a5ed56b01 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:59:32.426 1 ERROR oslo_service.service [req-b662160a-4c63-47bf-a208-603a5ed56b01 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:59:32.426 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 18:59:32.426 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 18:59:32.426 1 ERROR oslo_service.service     service.start()
>2018-06-25 18:59:32.426 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 18:59:32.426 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 18:59:32.426 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 18:59:32.426 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 18:59:32.426 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 18:59:32.426 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 18:59:32.426 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 18:59:32.426 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 18:59:32.426 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 18:59:32.426 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 18:59:32.426 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 18:59:32.426 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 18:59:32.426 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 18:59:32.426 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 18:59:32.426 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 18:59:32.426 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 18:59:32.426 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 18:59:32.426 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 18:59:32.426 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 18:59:32.426 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 18:59:32.426 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 18:59:32.426 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 18:59:32.426 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 18:59:32.426 1 ERROR oslo_service.service 
>2018-06-25 18:59:32.429 1 CRITICAL cinder [req-104c4d2b-d3f7-4e5a-8823-52dd9c99b95d - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 18:59:32.429 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 18:59:32.429 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 18:59:32.429 1 ERROR cinder     sys.exit(main())
>2018-06-25 18:59:32.429 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 18:59:32.429 1 ERROR cinder     service.wait()
>2018-06-25 18:59:32.429 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 18:59:32.429 1 ERROR cinder     _launcher.wait()
>2018-06-25 18:59:32.429 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 18:59:32.429 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 18:59:32.429 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 18:59:32.429 1 ERROR cinder     self.services.wait()
>2018-06-25 18:59:32.429 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 18:59:32.429 1 ERROR cinder     service.wait()
>2018-06-25 18:59:32.429 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 18:59:32.429 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 18:59:32.429 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 18:59:32.429 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 18:59:32.429 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 18:59:32.429 1 ERROR cinder     post_fn = fn()
>2018-06-25 18:59:32.429 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 18:59:32.429 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 18:59:32.429 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 18:59:32.429 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 18:59:32.429 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 18:59:32.429 1 ERROR cinder 
>2018-06-25 18:59:35.103 1 WARNING cinder.scheduler.host_manager [req-aa5debb3-c2ec-406b-99f8-407cdb1fd98c - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 18:59:35.109 1 INFO cinder.rpc [req-aa5debb3-c2ec-406b-99f8-407cdb1fd98c - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 18:59:35.114 1 INFO cinder.rpc [req-aa5debb3-c2ec-406b-99f8-407cdb1fd98c - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 18:59:35.129 1 INFO cinder.rpc [req-aa5debb3-c2ec-406b-99f8-407cdb1fd98c - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 18:59:35.135 1 INFO cinder.rpc [req-aa5debb3-c2ec-406b-99f8-407cdb1fd98c - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 18:59:35.159 1 WARNING oslo_config.cfg [req-aa5debb3-c2ec-406b-99f8-407cdb1fd98c - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 18:59:35.161 1 WARNING oslo_config.cfg [req-aa5debb3-c2ec-406b-99f8-407cdb1fd98c - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:59:35.162 1 WARNING oslo_config.cfg [req-aa5debb3-c2ec-406b-99f8-407cdb1fd98c - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:59:35.162 1 WARNING oslo_config.cfg [req-aa5debb3-c2ec-406b-99f8-407cdb1fd98c - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 18:59:35.167 1 WARNING oslo_config.cfg [req-aa5debb3-c2ec-406b-99f8-407cdb1fd98c - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 18:59:35.168 1 WARNING oslo_config.cfg [req-aa5debb3-c2ec-406b-99f8-407cdb1fd98c - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 18:59:35.171 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 18:59:35.177 1 INFO cinder.manager [req-8938f4a4-0434-49ec-9aa2-cefbdf295e8b - - - - -] Initiating service 5 cleanup
>2018-06-25 18:59:35.182 1 INFO cinder.manager [req-8938f4a4-0434-49ec-9aa2-cefbdf295e8b - - - - -] Service 5 cleanup completed.
>2018-06-25 19:01:39.443 1 ERROR oslo.messaging._drivers.impl_rabbit [req-8938f4a4-0434-49ec-9aa2-cefbdf295e8b - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:01:39.446 1 ERROR oslo.messaging._drivers.impl_rabbit [req-8938f4a4-0434-49ec-9aa2-cefbdf295e8b - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:01:39.446 1 ERROR oslo_service.service [req-8938f4a4-0434-49ec-9aa2-cefbdf295e8b - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:01:39.446 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 19:01:39.446 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 19:01:39.446 1 ERROR oslo_service.service     service.start()
>2018-06-25 19:01:39.446 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 19:01:39.446 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 19:01:39.446 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 19:01:39.446 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 19:01:39.446 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 19:01:39.446 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 19:01:39.446 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 19:01:39.446 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 19:01:39.446 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 19:01:39.446 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 19:01:39.446 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 19:01:39.446 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 19:01:39.446 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 19:01:39.446 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 19:01:39.446 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 19:01:39.446 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 19:01:39.446 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 19:01:39.446 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 19:01:39.446 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 19:01:39.446 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 19:01:39.446 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 19:01:39.446 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 19:01:39.446 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:01:39.446 1 ERROR oslo_service.service 
>2018-06-25 19:01:39.449 1 CRITICAL cinder [req-aa5debb3-c2ec-406b-99f8-407cdb1fd98c - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 19:01:39.449 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 19:01:39.449 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 19:01:39.449 1 ERROR cinder     sys.exit(main())
>2018-06-25 19:01:39.449 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 19:01:39.449 1 ERROR cinder     service.wait()
>2018-06-25 19:01:39.449 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 19:01:39.449 1 ERROR cinder     _launcher.wait()
>2018-06-25 19:01:39.449 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 19:01:39.449 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 19:01:39.449 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 19:01:39.449 1 ERROR cinder     self.services.wait()
>2018-06-25 19:01:39.449 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 19:01:39.449 1 ERROR cinder     service.wait()
>2018-06-25 19:01:39.449 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 19:01:39.449 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 19:01:39.449 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 19:01:39.449 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 19:01:39.449 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 19:01:39.449 1 ERROR cinder     post_fn = fn()
>2018-06-25 19:01:39.449 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 19:01:39.449 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 19:01:39.449 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 19:01:39.449 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 19:01:39.449 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 19:01:39.449 1 ERROR cinder 
>2018-06-25 19:01:42.284 1 WARNING cinder.scheduler.host_manager [req-39a8d87c-ea06-4e05-ad7e-383281af95fb - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 19:01:42.290 1 INFO cinder.rpc [req-39a8d87c-ea06-4e05-ad7e-383281af95fb - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 19:01:42.295 1 INFO cinder.rpc [req-39a8d87c-ea06-4e05-ad7e-383281af95fb - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 19:01:42.310 1 INFO cinder.rpc [req-39a8d87c-ea06-4e05-ad7e-383281af95fb - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 19:01:42.316 1 INFO cinder.rpc [req-39a8d87c-ea06-4e05-ad7e-383281af95fb - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 19:01:42.339 1 WARNING oslo_config.cfg [req-39a8d87c-ea06-4e05-ad7e-383281af95fb - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 19:01:42.341 1 WARNING oslo_config.cfg [req-39a8d87c-ea06-4e05-ad7e-383281af95fb - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:01:42.342 1 WARNING oslo_config.cfg [req-39a8d87c-ea06-4e05-ad7e-383281af95fb - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:01:42.342 1 WARNING oslo_config.cfg [req-39a8d87c-ea06-4e05-ad7e-383281af95fb - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:01:42.347 1 WARNING oslo_config.cfg [req-39a8d87c-ea06-4e05-ad7e-383281af95fb - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 19:01:42.349 1 WARNING oslo_config.cfg [req-39a8d87c-ea06-4e05-ad7e-383281af95fb - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 19:01:42.351 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 19:01:42.364 1 INFO cinder.manager [req-d8f45201-2c81-486b-8c73-5b484791c78e - - - - -] Initiating service 5 cleanup
>2018-06-25 19:01:42.370 1 INFO cinder.manager [req-d8f45201-2c81-486b-8c73-5b484791c78e - - - - -] Service 5 cleanup completed.
>2018-06-25 19:03:54.140 1 ERROR oslo.messaging._drivers.impl_rabbit [req-d8f45201-2c81-486b-8c73-5b484791c78e - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:03:54.142 1 ERROR oslo.messaging._drivers.impl_rabbit [req-d8f45201-2c81-486b-8c73-5b484791c78e - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:03:54.142 1 ERROR oslo_service.service [req-d8f45201-2c81-486b-8c73-5b484791c78e - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:03:54.142 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 19:03:54.142 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 19:03:54.142 1 ERROR oslo_service.service     service.start()
>2018-06-25 19:03:54.142 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 19:03:54.142 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 19:03:54.142 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 19:03:54.142 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 19:03:54.142 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 19:03:54.142 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 19:03:54.142 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 19:03:54.142 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 19:03:54.142 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 19:03:54.142 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 19:03:54.142 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 19:03:54.142 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 19:03:54.142 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 19:03:54.142 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 19:03:54.142 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 19:03:54.142 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 19:03:54.142 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 19:03:54.142 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 19:03:54.142 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 19:03:54.142 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 19:03:54.142 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 19:03:54.142 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 19:03:54.142 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:03:54.142 1 ERROR oslo_service.service 
>2018-06-25 19:03:54.146 1 CRITICAL cinder [req-39a8d87c-ea06-4e05-ad7e-383281af95fb - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 19:03:54.146 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 19:03:54.146 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 19:03:54.146 1 ERROR cinder     sys.exit(main())
>2018-06-25 19:03:54.146 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 19:03:54.146 1 ERROR cinder     service.wait()
>2018-06-25 19:03:54.146 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 19:03:54.146 1 ERROR cinder     _launcher.wait()
>2018-06-25 19:03:54.146 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 19:03:54.146 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 19:03:54.146 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 19:03:54.146 1 ERROR cinder     self.services.wait()
>2018-06-25 19:03:54.146 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 19:03:54.146 1 ERROR cinder     service.wait()
>2018-06-25 19:03:54.146 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 19:03:54.146 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 19:03:54.146 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 19:03:54.146 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 19:03:54.146 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 19:03:54.146 1 ERROR cinder     post_fn = fn()
>2018-06-25 19:03:54.146 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 19:03:54.146 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 19:03:54.146 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 19:03:54.146 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 19:03:54.146 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 19:03:54.146 1 ERROR cinder 
>2018-06-25 19:03:56.923 1 WARNING cinder.scheduler.host_manager [req-c2bb1491-717a-4183-96ec-745b64ae4419 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 19:03:56.929 1 INFO cinder.rpc [req-c2bb1491-717a-4183-96ec-745b64ae4419 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 19:03:56.934 1 INFO cinder.rpc [req-c2bb1491-717a-4183-96ec-745b64ae4419 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 19:03:56.953 1 INFO cinder.rpc [req-c2bb1491-717a-4183-96ec-745b64ae4419 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 19:03:56.961 1 INFO cinder.rpc [req-c2bb1491-717a-4183-96ec-745b64ae4419 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 19:03:56.992 1 WARNING oslo_config.cfg [req-c2bb1491-717a-4183-96ec-745b64ae4419 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 19:03:56.994 1 WARNING oslo_config.cfg [req-c2bb1491-717a-4183-96ec-745b64ae4419 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:03:56.995 1 WARNING oslo_config.cfg [req-c2bb1491-717a-4183-96ec-745b64ae4419 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:03:56.995 1 WARNING oslo_config.cfg [req-c2bb1491-717a-4183-96ec-745b64ae4419 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:03:57.001 1 WARNING oslo_config.cfg [req-c2bb1491-717a-4183-96ec-745b64ae4419 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 19:03:57.003 1 WARNING oslo_config.cfg [req-c2bb1491-717a-4183-96ec-745b64ae4419 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 19:03:57.005 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 19:03:57.013 1 INFO cinder.manager [req-b7e5f3d7-b93a-4d7f-9d04-0903168c19fe - - - - -] Initiating service 5 cleanup
>2018-06-25 19:03:57.021 1 INFO cinder.manager [req-b7e5f3d7-b93a-4d7f-9d04-0903168c19fe - - - - -] Service 5 cleanup completed.
>2018-06-25 19:06:08.609 1 ERROR oslo.messaging._drivers.impl_rabbit [req-b7e5f3d7-b93a-4d7f-9d04-0903168c19fe - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:06:08.611 1 ERROR oslo.messaging._drivers.impl_rabbit [req-b7e5f3d7-b93a-4d7f-9d04-0903168c19fe - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:06:08.612 1 ERROR oslo_service.service [req-b7e5f3d7-b93a-4d7f-9d04-0903168c19fe - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:06:08.612 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 19:06:08.612 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 19:06:08.612 1 ERROR oslo_service.service     service.start()
>2018-06-25 19:06:08.612 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 19:06:08.612 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 19:06:08.612 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 19:06:08.612 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 19:06:08.612 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 19:06:08.612 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 19:06:08.612 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 19:06:08.612 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 19:06:08.612 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 19:06:08.612 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 19:06:08.612 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 19:06:08.612 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 19:06:08.612 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 19:06:08.612 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 19:06:08.612 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 19:06:08.612 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 19:06:08.612 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 19:06:08.612 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 19:06:08.612 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 19:06:08.612 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 19:06:08.612 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 19:06:08.612 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 19:06:08.612 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:06:08.612 1 ERROR oslo_service.service 
>2018-06-25 19:06:08.616 1 CRITICAL cinder [req-c2bb1491-717a-4183-96ec-745b64ae4419 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 19:06:08.616 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 19:06:08.616 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 19:06:08.616 1 ERROR cinder     sys.exit(main())
>2018-06-25 19:06:08.616 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 19:06:08.616 1 ERROR cinder     service.wait()
>2018-06-25 19:06:08.616 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 19:06:08.616 1 ERROR cinder     _launcher.wait()
>2018-06-25 19:06:08.616 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 19:06:08.616 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 19:06:08.616 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 19:06:08.616 1 ERROR cinder     self.services.wait()
>2018-06-25 19:06:08.616 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 19:06:08.616 1 ERROR cinder     service.wait()
>2018-06-25 19:06:08.616 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 19:06:08.616 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 19:06:08.616 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 19:06:08.616 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 19:06:08.616 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 19:06:08.616 1 ERROR cinder     post_fn = fn()
>2018-06-25 19:06:08.616 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 19:06:08.616 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 19:06:08.616 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 19:06:08.616 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 19:06:08.616 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 19:06:08.616 1 ERROR cinder 
>2018-06-25 19:06:11.305 1 WARNING cinder.scheduler.host_manager [req-e0258ab3-3116-4476-b222-0e5db4843763 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 19:06:11.312 1 INFO cinder.rpc [req-e0258ab3-3116-4476-b222-0e5db4843763 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 19:06:11.318 1 INFO cinder.rpc [req-e0258ab3-3116-4476-b222-0e5db4843763 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 19:06:11.330 1 INFO cinder.rpc [req-e0258ab3-3116-4476-b222-0e5db4843763 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 19:06:11.338 1 INFO cinder.rpc [req-e0258ab3-3116-4476-b222-0e5db4843763 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 19:06:11.364 1 WARNING oslo_config.cfg [req-e0258ab3-3116-4476-b222-0e5db4843763 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 19:06:11.366 1 WARNING oslo_config.cfg [req-e0258ab3-3116-4476-b222-0e5db4843763 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:06:11.367 1 WARNING oslo_config.cfg [req-e0258ab3-3116-4476-b222-0e5db4843763 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:06:11.367 1 WARNING oslo_config.cfg [req-e0258ab3-3116-4476-b222-0e5db4843763 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:06:11.372 1 WARNING oslo_config.cfg [req-e0258ab3-3116-4476-b222-0e5db4843763 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 19:06:11.374 1 WARNING oslo_config.cfg [req-e0258ab3-3116-4476-b222-0e5db4843763 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 19:06:11.377 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 19:06:11.383 1 INFO cinder.manager [req-346b4a4e-3a4f-4d25-8afa-34001b8f0990 - - - - -] Initiating service 5 cleanup
>2018-06-25 19:06:11.388 1 INFO cinder.manager [req-346b4a4e-3a4f-4d25-8afa-34001b8f0990 - - - - -] Service 5 cleanup completed.
>2018-06-25 19:08:23.524 1 ERROR oslo.messaging._drivers.impl_rabbit [req-346b4a4e-3a4f-4d25-8afa-34001b8f0990 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:08:23.527 1 ERROR oslo.messaging._drivers.impl_rabbit [req-346b4a4e-3a4f-4d25-8afa-34001b8f0990 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:08:23.527 1 ERROR oslo_service.service [req-346b4a4e-3a4f-4d25-8afa-34001b8f0990 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:08:23.527 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 19:08:23.527 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 19:08:23.527 1 ERROR oslo_service.service     service.start()
>2018-06-25 19:08:23.527 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 19:08:23.527 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 19:08:23.527 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 19:08:23.527 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 19:08:23.527 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 19:08:23.527 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 19:08:23.527 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 19:08:23.527 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 19:08:23.527 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 19:08:23.527 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 19:08:23.527 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 19:08:23.527 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 19:08:23.527 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 19:08:23.527 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 19:08:23.527 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 19:08:23.527 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 19:08:23.527 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 19:08:23.527 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 19:08:23.527 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 19:08:23.527 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 19:08:23.527 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 19:08:23.527 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 19:08:23.527 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:08:23.527 1 ERROR oslo_service.service 
>2018-06-25 19:08:23.531 1 CRITICAL cinder [req-e0258ab3-3116-4476-b222-0e5db4843763 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 19:08:23.531 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 19:08:23.531 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 19:08:23.531 1 ERROR cinder     sys.exit(main())
>2018-06-25 19:08:23.531 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 19:08:23.531 1 ERROR cinder     service.wait()
>2018-06-25 19:08:23.531 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 19:08:23.531 1 ERROR cinder     _launcher.wait()
>2018-06-25 19:08:23.531 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 19:08:23.531 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 19:08:23.531 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 19:08:23.531 1 ERROR cinder     self.services.wait()
>2018-06-25 19:08:23.531 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 19:08:23.531 1 ERROR cinder     service.wait()
>2018-06-25 19:08:23.531 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 19:08:23.531 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 19:08:23.531 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 19:08:23.531 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 19:08:23.531 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 19:08:23.531 1 ERROR cinder     post_fn = fn()
>2018-06-25 19:08:23.531 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 19:08:23.531 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 19:08:23.531 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 19:08:23.531 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 19:08:23.531 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 19:08:23.531 1 ERROR cinder 
>2018-06-25 19:08:26.314 1 WARNING cinder.scheduler.host_manager [req-04caa6b8-bd64-4fa9-9f0e-be495acf698b - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 19:08:26.321 1 INFO cinder.rpc [req-04caa6b8-bd64-4fa9-9f0e-be495acf698b - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 19:08:26.326 1 INFO cinder.rpc [req-04caa6b8-bd64-4fa9-9f0e-be495acf698b - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 19:08:26.339 1 INFO cinder.rpc [req-04caa6b8-bd64-4fa9-9f0e-be495acf698b - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 19:08:26.345 1 INFO cinder.rpc [req-04caa6b8-bd64-4fa9-9f0e-be495acf698b - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 19:08:26.385 1 WARNING oslo_config.cfg [req-04caa6b8-bd64-4fa9-9f0e-be495acf698b - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 19:08:26.390 1 WARNING oslo_config.cfg [req-04caa6b8-bd64-4fa9-9f0e-be495acf698b - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:08:26.391 1 WARNING oslo_config.cfg [req-04caa6b8-bd64-4fa9-9f0e-be495acf698b - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:08:26.391 1 WARNING oslo_config.cfg [req-04caa6b8-bd64-4fa9-9f0e-be495acf698b - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:08:26.397 1 WARNING oslo_config.cfg [req-04caa6b8-bd64-4fa9-9f0e-be495acf698b - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 19:08:26.398 1 WARNING oslo_config.cfg [req-04caa6b8-bd64-4fa9-9f0e-be495acf698b - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 19:08:26.401 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 19:08:26.409 1 INFO cinder.manager [req-6365f78d-e137-467b-9624-e5f5cc6662a3 - - - - -] Initiating service 5 cleanup
>2018-06-25 19:08:26.414 1 INFO cinder.manager [req-6365f78d-e137-467b-9624-e5f5cc6662a3 - - - - -] Service 5 cleanup completed.
>2018-06-25 19:10:39.099 1 ERROR oslo.messaging._drivers.impl_rabbit [req-6365f78d-e137-467b-9624-e5f5cc6662a3 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:10:39.101 1 ERROR oslo.messaging._drivers.impl_rabbit [req-6365f78d-e137-467b-9624-e5f5cc6662a3 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:10:39.102 1 ERROR oslo_service.service [req-6365f78d-e137-467b-9624-e5f5cc6662a3 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:10:39.102 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 19:10:39.102 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 19:10:39.102 1 ERROR oslo_service.service     service.start()
>2018-06-25 19:10:39.102 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 19:10:39.102 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 19:10:39.102 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 19:10:39.102 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 19:10:39.102 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 19:10:39.102 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 19:10:39.102 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 19:10:39.102 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 19:10:39.102 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 19:10:39.102 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 19:10:39.102 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 19:10:39.102 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 19:10:39.102 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 19:10:39.102 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 19:10:39.102 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 19:10:39.102 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 19:10:39.102 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 19:10:39.102 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 19:10:39.102 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 19:10:39.102 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 19:10:39.102 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 19:10:39.102 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 19:10:39.102 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:10:39.102 1 ERROR oslo_service.service 
>2018-06-25 19:10:39.105 1 CRITICAL cinder [req-04caa6b8-bd64-4fa9-9f0e-be495acf698b - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 19:10:39.105 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 19:10:39.105 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 19:10:39.105 1 ERROR cinder     sys.exit(main())
>2018-06-25 19:10:39.105 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 19:10:39.105 1 ERROR cinder     service.wait()
>2018-06-25 19:10:39.105 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 19:10:39.105 1 ERROR cinder     _launcher.wait()
>2018-06-25 19:10:39.105 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 19:10:39.105 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 19:10:39.105 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 19:10:39.105 1 ERROR cinder     self.services.wait()
>2018-06-25 19:10:39.105 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 19:10:39.105 1 ERROR cinder     service.wait()
>2018-06-25 19:10:39.105 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 19:10:39.105 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 19:10:39.105 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 19:10:39.105 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 19:10:39.105 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 19:10:39.105 1 ERROR cinder     post_fn = fn()
>2018-06-25 19:10:39.105 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 19:10:39.105 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 19:10:39.105 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 19:10:39.105 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 19:10:39.105 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 19:10:39.105 1 ERROR cinder 
>2018-06-25 19:10:41.886 1 WARNING cinder.scheduler.host_manager [req-04537c7b-1246-499b-abc2-6c8dd1a63137 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 19:10:41.892 1 INFO cinder.rpc [req-04537c7b-1246-499b-abc2-6c8dd1a63137 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 19:10:41.897 1 INFO cinder.rpc [req-04537c7b-1246-499b-abc2-6c8dd1a63137 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 19:10:41.909 1 INFO cinder.rpc [req-04537c7b-1246-499b-abc2-6c8dd1a63137 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 19:10:41.915 1 INFO cinder.rpc [req-04537c7b-1246-499b-abc2-6c8dd1a63137 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 19:10:41.936 1 WARNING oslo_config.cfg [req-04537c7b-1246-499b-abc2-6c8dd1a63137 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 19:10:41.938 1 WARNING oslo_config.cfg [req-04537c7b-1246-499b-abc2-6c8dd1a63137 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:10:41.939 1 WARNING oslo_config.cfg [req-04537c7b-1246-499b-abc2-6c8dd1a63137 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:10:41.939 1 WARNING oslo_config.cfg [req-04537c7b-1246-499b-abc2-6c8dd1a63137 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:10:41.945 1 WARNING oslo_config.cfg [req-04537c7b-1246-499b-abc2-6c8dd1a63137 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 19:10:41.946 1 WARNING oslo_config.cfg [req-04537c7b-1246-499b-abc2-6c8dd1a63137 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 19:10:41.949 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 19:10:41.956 1 INFO cinder.manager [req-5e6070e7-d23f-48d8-8ee4-4696cf0989de - - - - -] Initiating service 5 cleanup
>2018-06-25 19:10:41.961 1 INFO cinder.manager [req-5e6070e7-d23f-48d8-8ee4-4696cf0989de - - - - -] Service 5 cleanup completed.
>2018-06-25 19:12:46.289 1 ERROR oslo.messaging._drivers.impl_rabbit [req-5e6070e7-d23f-48d8-8ee4-4696cf0989de - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:12:46.292 1 ERROR oslo.messaging._drivers.impl_rabbit [req-5e6070e7-d23f-48d8-8ee4-4696cf0989de - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:12:46.293 1 ERROR oslo_service.service [req-5e6070e7-d23f-48d8-8ee4-4696cf0989de - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:12:46.293 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 19:12:46.293 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 19:12:46.293 1 ERROR oslo_service.service     service.start()
>2018-06-25 19:12:46.293 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 19:12:46.293 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 19:12:46.293 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 19:12:46.293 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 19:12:46.293 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 19:12:46.293 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 19:12:46.293 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 19:12:46.293 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 19:12:46.293 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 19:12:46.293 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 19:12:46.293 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 19:12:46.293 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 19:12:46.293 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 19:12:46.293 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 19:12:46.293 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 19:12:46.293 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 19:12:46.293 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 19:12:46.293 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 19:12:46.293 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 19:12:46.293 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 19:12:46.293 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 19:12:46.293 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 19:12:46.293 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:12:46.293 1 ERROR oslo_service.service 
>2018-06-25 19:12:46.298 1 CRITICAL cinder [req-04537c7b-1246-499b-abc2-6c8dd1a63137 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 19:12:46.298 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 19:12:46.298 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 19:12:46.298 1 ERROR cinder     sys.exit(main())
>2018-06-25 19:12:46.298 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 19:12:46.298 1 ERROR cinder     service.wait()
>2018-06-25 19:12:46.298 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 19:12:46.298 1 ERROR cinder     _launcher.wait()
>2018-06-25 19:12:46.298 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 19:12:46.298 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 19:12:46.298 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 19:12:46.298 1 ERROR cinder     self.services.wait()
>2018-06-25 19:12:46.298 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 19:12:46.298 1 ERROR cinder     service.wait()
>2018-06-25 19:12:46.298 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 19:12:46.298 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 19:12:46.298 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 19:12:46.298 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 19:12:46.298 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 19:12:46.298 1 ERROR cinder     post_fn = fn()
>2018-06-25 19:12:46.298 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 19:12:46.298 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 19:12:46.298 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 19:12:46.298 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 19:12:46.298 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 19:12:46.298 1 ERROR cinder 
>2018-06-25 19:12:49.124 1 WARNING cinder.scheduler.host_manager [req-9ed483a4-d7f6-4bf0-ac1c-550af56c741e - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 19:12:49.131 1 INFO cinder.rpc [req-9ed483a4-d7f6-4bf0-ac1c-550af56c741e - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 19:12:49.141 1 INFO cinder.rpc [req-9ed483a4-d7f6-4bf0-ac1c-550af56c741e - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 19:12:49.154 1 INFO cinder.rpc [req-9ed483a4-d7f6-4bf0-ac1c-550af56c741e - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 19:12:49.160 1 INFO cinder.rpc [req-9ed483a4-d7f6-4bf0-ac1c-550af56c741e - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 19:12:49.195 1 WARNING oslo_config.cfg [req-9ed483a4-d7f6-4bf0-ac1c-550af56c741e - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 19:12:49.198 1 WARNING oslo_config.cfg [req-9ed483a4-d7f6-4bf0-ac1c-550af56c741e - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:12:49.199 1 WARNING oslo_config.cfg [req-9ed483a4-d7f6-4bf0-ac1c-550af56c741e - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:12:49.200 1 WARNING oslo_config.cfg [req-9ed483a4-d7f6-4bf0-ac1c-550af56c741e - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:12:49.209 1 WARNING oslo_config.cfg [req-9ed483a4-d7f6-4bf0-ac1c-550af56c741e - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 19:12:49.210 1 WARNING oslo_config.cfg [req-9ed483a4-d7f6-4bf0-ac1c-550af56c741e - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 19:12:49.214 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 19:12:49.223 1 INFO cinder.manager [req-26bb5be1-a312-41f5-9995-d59cba6c0c39 - - - - -] Initiating service 5 cleanup
>2018-06-25 19:12:49.234 1 INFO cinder.manager [req-26bb5be1-a312-41f5-9995-d59cba6c0c39 - - - - -] Service 5 cleanup completed.
>2018-06-25 19:14:55.429 1 ERROR oslo.messaging._drivers.impl_rabbit [req-26bb5be1-a312-41f5-9995-d59cba6c0c39 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:14:55.431 1 ERROR oslo.messaging._drivers.impl_rabbit [req-26bb5be1-a312-41f5-9995-d59cba6c0c39 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:14:55.431 1 ERROR oslo_service.service [req-26bb5be1-a312-41f5-9995-d59cba6c0c39 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:14:55.431 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 19:14:55.431 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 19:14:55.431 1 ERROR oslo_service.service     service.start()
>2018-06-25 19:14:55.431 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 19:14:55.431 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 19:14:55.431 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 19:14:55.431 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 19:14:55.431 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 19:14:55.431 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 19:14:55.431 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 19:14:55.431 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 19:14:55.431 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 19:14:55.431 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 19:14:55.431 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 19:14:55.431 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 19:14:55.431 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 19:14:55.431 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 19:14:55.431 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 19:14:55.431 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 19:14:55.431 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 19:14:55.431 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 19:14:55.431 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 19:14:55.431 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 19:14:55.431 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 19:14:55.431 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 19:14:55.431 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:14:55.431 1 ERROR oslo_service.service 
>2018-06-25 19:14:55.434 1 CRITICAL cinder [req-9ed483a4-d7f6-4bf0-ac1c-550af56c741e - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 19:14:55.434 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 19:14:55.434 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 19:14:55.434 1 ERROR cinder     sys.exit(main())
>2018-06-25 19:14:55.434 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 19:14:55.434 1 ERROR cinder     service.wait()
>2018-06-25 19:14:55.434 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 19:14:55.434 1 ERROR cinder     _launcher.wait()
>2018-06-25 19:14:55.434 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 19:14:55.434 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 19:14:55.434 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 19:14:55.434 1 ERROR cinder     self.services.wait()
>2018-06-25 19:14:55.434 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 19:14:55.434 1 ERROR cinder     service.wait()
>2018-06-25 19:14:55.434 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 19:14:55.434 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 19:14:55.434 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 19:14:55.434 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 19:14:55.434 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 19:14:55.434 1 ERROR cinder     post_fn = fn()
>2018-06-25 19:14:55.434 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 19:14:55.434 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 19:14:55.434 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 19:14:55.434 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 19:14:55.434 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 19:14:55.434 1 ERROR cinder 
>2018-06-25 19:14:58.197 1 WARNING cinder.scheduler.host_manager [req-a911ba35-2458-41ed-af39-33df4d78134e - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 19:14:58.203 1 INFO cinder.rpc [req-a911ba35-2458-41ed-af39-33df4d78134e - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 19:14:58.209 1 INFO cinder.rpc [req-a911ba35-2458-41ed-af39-33df4d78134e - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 19:14:58.221 1 INFO cinder.rpc [req-a911ba35-2458-41ed-af39-33df4d78134e - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 19:14:58.229 1 INFO cinder.rpc [req-a911ba35-2458-41ed-af39-33df4d78134e - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 19:14:58.256 1 WARNING oslo_config.cfg [req-a911ba35-2458-41ed-af39-33df4d78134e - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 19:14:58.259 1 WARNING oslo_config.cfg [req-a911ba35-2458-41ed-af39-33df4d78134e - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:14:58.260 1 WARNING oslo_config.cfg [req-a911ba35-2458-41ed-af39-33df4d78134e - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:14:58.260 1 WARNING oslo_config.cfg [req-a911ba35-2458-41ed-af39-33df4d78134e - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:14:58.266 1 WARNING oslo_config.cfg [req-a911ba35-2458-41ed-af39-33df4d78134e - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 19:14:58.267 1 WARNING oslo_config.cfg [req-a911ba35-2458-41ed-af39-33df4d78134e - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 19:14:58.270 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 19:14:58.277 1 INFO cinder.manager [req-d01fea51-22ec-4075-acf5-b683adaa3230 - - - - -] Initiating service 5 cleanup
>2018-06-25 19:14:58.283 1 INFO cinder.manager [req-d01fea51-22ec-4075-acf5-b683adaa3230 - - - - -] Service 5 cleanup completed.
>2018-06-25 19:17:10.074 1 ERROR oslo.messaging._drivers.impl_rabbit [req-d01fea51-22ec-4075-acf5-b683adaa3230 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:17:10.076 1 ERROR oslo.messaging._drivers.impl_rabbit [req-d01fea51-22ec-4075-acf5-b683adaa3230 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:17:10.077 1 ERROR oslo_service.service [req-d01fea51-22ec-4075-acf5-b683adaa3230 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:17:10.077 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 19:17:10.077 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 19:17:10.077 1 ERROR oslo_service.service     service.start()
>2018-06-25 19:17:10.077 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 19:17:10.077 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 19:17:10.077 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 19:17:10.077 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 19:17:10.077 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 19:17:10.077 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 19:17:10.077 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 19:17:10.077 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 19:17:10.077 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 19:17:10.077 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 19:17:10.077 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 19:17:10.077 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 19:17:10.077 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 19:17:10.077 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 19:17:10.077 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 19:17:10.077 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 19:17:10.077 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 19:17:10.077 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 19:17:10.077 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 19:17:10.077 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 19:17:10.077 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 19:17:10.077 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 19:17:10.077 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:17:10.077 1 ERROR oslo_service.service 
>2018-06-25 19:17:10.080 1 CRITICAL cinder [req-a911ba35-2458-41ed-af39-33df4d78134e - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 19:17:10.080 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 19:17:10.080 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 19:17:10.080 1 ERROR cinder     sys.exit(main())
>2018-06-25 19:17:10.080 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 19:17:10.080 1 ERROR cinder     service.wait()
>2018-06-25 19:17:10.080 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 19:17:10.080 1 ERROR cinder     _launcher.wait()
>2018-06-25 19:17:10.080 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 19:17:10.080 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 19:17:10.080 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 19:17:10.080 1 ERROR cinder     self.services.wait()
>2018-06-25 19:17:10.080 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 19:17:10.080 1 ERROR cinder     service.wait()
>2018-06-25 19:17:10.080 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 19:17:10.080 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 19:17:10.080 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 19:17:10.080 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 19:17:10.080 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 19:17:10.080 1 ERROR cinder     post_fn = fn()
>2018-06-25 19:17:10.080 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 19:17:10.080 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 19:17:10.080 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 19:17:10.080 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 19:17:10.080 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 19:17:10.080 1 ERROR cinder 
>2018-06-25 19:17:12.817 1 WARNING cinder.scheduler.host_manager [req-0d8b416d-bbe3-4754-9e31-00d59c6a655e - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 19:17:12.824 1 INFO cinder.rpc [req-0d8b416d-bbe3-4754-9e31-00d59c6a655e - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 19:17:12.830 1 INFO cinder.rpc [req-0d8b416d-bbe3-4754-9e31-00d59c6a655e - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 19:17:12.844 1 INFO cinder.rpc [req-0d8b416d-bbe3-4754-9e31-00d59c6a655e - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 19:17:12.853 1 INFO cinder.rpc [req-0d8b416d-bbe3-4754-9e31-00d59c6a655e - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 19:17:12.879 1 WARNING oslo_config.cfg [req-0d8b416d-bbe3-4754-9e31-00d59c6a655e - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 19:17:12.881 1 WARNING oslo_config.cfg [req-0d8b416d-bbe3-4754-9e31-00d59c6a655e - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:17:12.881 1 WARNING oslo_config.cfg [req-0d8b416d-bbe3-4754-9e31-00d59c6a655e - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:17:12.882 1 WARNING oslo_config.cfg [req-0d8b416d-bbe3-4754-9e31-00d59c6a655e - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:17:12.887 1 WARNING oslo_config.cfg [req-0d8b416d-bbe3-4754-9e31-00d59c6a655e - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 19:17:12.889 1 WARNING oslo_config.cfg [req-0d8b416d-bbe3-4754-9e31-00d59c6a655e - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 19:17:12.891 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 19:17:12.897 1 INFO cinder.manager [req-1a411546-48c9-4f80-9311-59b8dde1d4e5 - - - - -] Initiating service 5 cleanup
>2018-06-25 19:17:12.902 1 INFO cinder.manager [req-1a411546-48c9-4f80-9311-59b8dde1d4e5 - - - - -] Service 5 cleanup completed.
>2018-06-25 19:19:19.248 1 ERROR oslo.messaging._drivers.impl_rabbit [req-1a411546-48c9-4f80-9311-59b8dde1d4e5 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:19:19.250 1 ERROR oslo.messaging._drivers.impl_rabbit [req-1a411546-48c9-4f80-9311-59b8dde1d4e5 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:19:19.250 1 ERROR oslo_service.service [req-1a411546-48c9-4f80-9311-59b8dde1d4e5 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:19:19.250 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 19:19:19.250 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 19:19:19.250 1 ERROR oslo_service.service     service.start()
>2018-06-25 19:19:19.250 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 19:19:19.250 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 19:19:19.250 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 19:19:19.250 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 19:19:19.250 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 19:19:19.250 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 19:19:19.250 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 19:19:19.250 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 19:19:19.250 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 19:19:19.250 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 19:19:19.250 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 19:19:19.250 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 19:19:19.250 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 19:19:19.250 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 19:19:19.250 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 19:19:19.250 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 19:19:19.250 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 19:19:19.250 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 19:19:19.250 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 19:19:19.250 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 19:19:19.250 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 19:19:19.250 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 19:19:19.250 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:19:19.250 1 ERROR oslo_service.service 
>2018-06-25 19:19:19.253 1 CRITICAL cinder [req-0d8b416d-bbe3-4754-9e31-00d59c6a655e - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 19:19:19.253 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 19:19:19.253 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 19:19:19.253 1 ERROR cinder     sys.exit(main())
>2018-06-25 19:19:19.253 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 19:19:19.253 1 ERROR cinder     service.wait()
>2018-06-25 19:19:19.253 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 19:19:19.253 1 ERROR cinder     _launcher.wait()
>2018-06-25 19:19:19.253 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 19:19:19.253 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 19:19:19.253 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 19:19:19.253 1 ERROR cinder     self.services.wait()
>2018-06-25 19:19:19.253 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 19:19:19.253 1 ERROR cinder     service.wait()
>2018-06-25 19:19:19.253 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 19:19:19.253 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 19:19:19.253 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 19:19:19.253 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 19:19:19.253 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 19:19:19.253 1 ERROR cinder     post_fn = fn()
>2018-06-25 19:19:19.253 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 19:19:19.253 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 19:19:19.253 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 19:19:19.253 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 19:19:19.253 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 19:19:19.253 1 ERROR cinder 
>2018-06-25 19:19:22.066 1 WARNING cinder.scheduler.host_manager [req-bd38277f-4174-4535-a6f1-3cf9f0fd37ee - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 19:19:22.072 1 INFO cinder.rpc [req-bd38277f-4174-4535-a6f1-3cf9f0fd37ee - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 19:19:22.077 1 INFO cinder.rpc [req-bd38277f-4174-4535-a6f1-3cf9f0fd37ee - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 19:19:22.087 1 INFO cinder.rpc [req-bd38277f-4174-4535-a6f1-3cf9f0fd37ee - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 19:19:22.093 1 INFO cinder.rpc [req-bd38277f-4174-4535-a6f1-3cf9f0fd37ee - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 19:19:22.116 1 WARNING oslo_config.cfg [req-bd38277f-4174-4535-a6f1-3cf9f0fd37ee - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 19:19:22.118 1 WARNING oslo_config.cfg [req-bd38277f-4174-4535-a6f1-3cf9f0fd37ee - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:19:22.118 1 WARNING oslo_config.cfg [req-bd38277f-4174-4535-a6f1-3cf9f0fd37ee - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:19:22.119 1 WARNING oslo_config.cfg [req-bd38277f-4174-4535-a6f1-3cf9f0fd37ee - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:19:22.124 1 WARNING oslo_config.cfg [req-bd38277f-4174-4535-a6f1-3cf9f0fd37ee - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 19:19:22.125 1 WARNING oslo_config.cfg [req-bd38277f-4174-4535-a6f1-3cf9f0fd37ee - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 19:19:22.128 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 19:19:22.134 1 INFO cinder.manager [req-359b4a9d-e0ea-47a4-8f7a-4fbee9f0a1fc - - - - -] Initiating service 5 cleanup
>2018-06-25 19:19:22.138 1 INFO cinder.manager [req-359b4a9d-e0ea-47a4-8f7a-4fbee9f0a1fc - - - - -] Service 5 cleanup completed.
>2018-06-25 19:21:28.260 1 ERROR oslo.messaging._drivers.impl_rabbit [req-359b4a9d-e0ea-47a4-8f7a-4fbee9f0a1fc - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:21:28.262 1 ERROR oslo.messaging._drivers.impl_rabbit [req-359b4a9d-e0ea-47a4-8f7a-4fbee9f0a1fc - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:21:28.262 1 ERROR oslo_service.service [req-359b4a9d-e0ea-47a4-8f7a-4fbee9f0a1fc - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:21:28.262 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 19:21:28.262 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 19:21:28.262 1 ERROR oslo_service.service     service.start()
>2018-06-25 19:21:28.262 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 19:21:28.262 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 19:21:28.262 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 19:21:28.262 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 19:21:28.262 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 19:21:28.262 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 19:21:28.262 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 19:21:28.262 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 19:21:28.262 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 19:21:28.262 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 19:21:28.262 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 19:21:28.262 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 19:21:28.262 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 19:21:28.262 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 19:21:28.262 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 19:21:28.262 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 19:21:28.262 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 19:21:28.262 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 19:21:28.262 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 19:21:28.262 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 19:21:28.262 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 19:21:28.262 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 19:21:28.262 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:21:28.262 1 ERROR oslo_service.service 
>2018-06-25 19:21:28.265 1 CRITICAL cinder [req-bd38277f-4174-4535-a6f1-3cf9f0fd37ee - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 19:21:28.265 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 19:21:28.265 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 19:21:28.265 1 ERROR cinder     sys.exit(main())
>2018-06-25 19:21:28.265 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 19:21:28.265 1 ERROR cinder     service.wait()
>2018-06-25 19:21:28.265 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 19:21:28.265 1 ERROR cinder     _launcher.wait()
>2018-06-25 19:21:28.265 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 19:21:28.265 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 19:21:28.265 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 19:21:28.265 1 ERROR cinder     self.services.wait()
>2018-06-25 19:21:28.265 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 19:21:28.265 1 ERROR cinder     service.wait()
>2018-06-25 19:21:28.265 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 19:21:28.265 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 19:21:28.265 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 19:21:28.265 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 19:21:28.265 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 19:21:28.265 1 ERROR cinder     post_fn = fn()
>2018-06-25 19:21:28.265 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 19:21:28.265 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 19:21:28.265 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 19:21:28.265 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 19:21:28.265 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 19:21:28.265 1 ERROR cinder 
>2018-06-25 19:21:31.032 1 WARNING cinder.scheduler.host_manager [req-679ff11a-a954-4c7d-8286-f43d5a9b364e - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 19:21:31.038 1 INFO cinder.rpc [req-679ff11a-a954-4c7d-8286-f43d5a9b364e - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 19:21:31.043 1 INFO cinder.rpc [req-679ff11a-a954-4c7d-8286-f43d5a9b364e - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 19:21:31.054 1 INFO cinder.rpc [req-679ff11a-a954-4c7d-8286-f43d5a9b364e - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 19:21:31.060 1 INFO cinder.rpc [req-679ff11a-a954-4c7d-8286-f43d5a9b364e - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 19:21:31.083 1 WARNING oslo_config.cfg [req-679ff11a-a954-4c7d-8286-f43d5a9b364e - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 19:21:31.085 1 WARNING oslo_config.cfg [req-679ff11a-a954-4c7d-8286-f43d5a9b364e - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:21:31.086 1 WARNING oslo_config.cfg [req-679ff11a-a954-4c7d-8286-f43d5a9b364e - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:21:31.086 1 WARNING oslo_config.cfg [req-679ff11a-a954-4c7d-8286-f43d5a9b364e - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:21:31.092 1 WARNING oslo_config.cfg [req-679ff11a-a954-4c7d-8286-f43d5a9b364e - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 19:21:31.093 1 WARNING oslo_config.cfg [req-679ff11a-a954-4c7d-8286-f43d5a9b364e - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 19:21:31.096 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 19:21:31.102 1 INFO cinder.manager [req-ed62b1db-60b9-456d-a75b-cdade445b0d4 - - - - -] Initiating service 5 cleanup
>2018-06-25 19:21:31.108 1 INFO cinder.manager [req-ed62b1db-60b9-456d-a75b-cdade445b0d4 - - - - -] Service 5 cleanup completed.
>2018-06-25 19:23:43.796 1 ERROR oslo.messaging._drivers.impl_rabbit [req-ed62b1db-60b9-456d-a75b-cdade445b0d4 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:23:43.798 1 ERROR oslo.messaging._drivers.impl_rabbit [req-ed62b1db-60b9-456d-a75b-cdade445b0d4 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:23:43.799 1 ERROR oslo_service.service [req-ed62b1db-60b9-456d-a75b-cdade445b0d4 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:23:43.799 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 19:23:43.799 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 19:23:43.799 1 ERROR oslo_service.service     service.start()
>2018-06-25 19:23:43.799 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 19:23:43.799 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 19:23:43.799 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 19:23:43.799 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 19:23:43.799 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 19:23:43.799 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 19:23:43.799 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 19:23:43.799 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 19:23:43.799 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 19:23:43.799 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 19:23:43.799 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 19:23:43.799 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 19:23:43.799 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 19:23:43.799 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 19:23:43.799 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 19:23:43.799 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 19:23:43.799 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 19:23:43.799 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 19:23:43.799 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 19:23:43.799 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 19:23:43.799 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 19:23:43.799 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 19:23:43.799 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:23:43.799 1 ERROR oslo_service.service 
>2018-06-25 19:23:43.801 1 CRITICAL cinder [req-679ff11a-a954-4c7d-8286-f43d5a9b364e - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 19:23:43.801 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 19:23:43.801 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 19:23:43.801 1 ERROR cinder     sys.exit(main())
>2018-06-25 19:23:43.801 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 19:23:43.801 1 ERROR cinder     service.wait()
>2018-06-25 19:23:43.801 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 19:23:43.801 1 ERROR cinder     _launcher.wait()
>2018-06-25 19:23:43.801 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 19:23:43.801 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 19:23:43.801 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 19:23:43.801 1 ERROR cinder     self.services.wait()
>2018-06-25 19:23:43.801 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 19:23:43.801 1 ERROR cinder     service.wait()
>2018-06-25 19:23:43.801 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 19:23:43.801 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 19:23:43.801 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 19:23:43.801 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 19:23:43.801 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 19:23:43.801 1 ERROR cinder     post_fn = fn()
>2018-06-25 19:23:43.801 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 19:23:43.801 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 19:23:43.801 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 19:23:43.801 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 19:23:43.801 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 19:23:43.801 1 ERROR cinder 
>2018-06-25 19:23:46.571 1 WARNING cinder.scheduler.host_manager [req-5eea927c-6733-4741-9be8-4decd4981fd0 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 19:23:46.576 1 INFO cinder.rpc [req-5eea927c-6733-4741-9be8-4decd4981fd0 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 19:23:46.582 1 INFO cinder.rpc [req-5eea927c-6733-4741-9be8-4decd4981fd0 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 19:23:46.592 1 INFO cinder.rpc [req-5eea927c-6733-4741-9be8-4decd4981fd0 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 19:23:46.598 1 INFO cinder.rpc [req-5eea927c-6733-4741-9be8-4decd4981fd0 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 19:23:46.621 1 WARNING oslo_config.cfg [req-5eea927c-6733-4741-9be8-4decd4981fd0 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 19:23:46.623 1 WARNING oslo_config.cfg [req-5eea927c-6733-4741-9be8-4decd4981fd0 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:23:46.624 1 WARNING oslo_config.cfg [req-5eea927c-6733-4741-9be8-4decd4981fd0 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:23:46.624 1 WARNING oslo_config.cfg [req-5eea927c-6733-4741-9be8-4decd4981fd0 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:23:46.629 1 WARNING oslo_config.cfg [req-5eea927c-6733-4741-9be8-4decd4981fd0 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 19:23:46.631 1 WARNING oslo_config.cfg [req-5eea927c-6733-4741-9be8-4decd4981fd0 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 19:23:46.633 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 19:23:46.639 1 INFO cinder.manager [req-59ec252e-c26a-4a5b-9638-b384a5e50345 - - - - -] Initiating service 5 cleanup
>2018-06-25 19:23:46.643 1 INFO cinder.manager [req-59ec252e-c26a-4a5b-9638-b384a5e50345 - - - - -] Service 5 cleanup completed.
>2018-06-25 19:25:52.783 1 ERROR oslo.messaging._drivers.impl_rabbit [req-59ec252e-c26a-4a5b-9638-b384a5e50345 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:25:52.785 1 ERROR oslo.messaging._drivers.impl_rabbit [req-59ec252e-c26a-4a5b-9638-b384a5e50345 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:25:52.785 1 ERROR oslo_service.service [req-59ec252e-c26a-4a5b-9638-b384a5e50345 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:25:52.785 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 19:25:52.785 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 19:25:52.785 1 ERROR oslo_service.service     service.start()
>2018-06-25 19:25:52.785 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 19:25:52.785 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 19:25:52.785 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 19:25:52.785 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 19:25:52.785 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 19:25:52.785 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 19:25:52.785 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 19:25:52.785 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 19:25:52.785 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 19:25:52.785 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 19:25:52.785 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 19:25:52.785 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 19:25:52.785 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 19:25:52.785 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 19:25:52.785 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 19:25:52.785 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 19:25:52.785 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 19:25:52.785 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 19:25:52.785 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 19:25:52.785 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 19:25:52.785 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 19:25:52.785 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 19:25:52.785 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:25:52.785 1 ERROR oslo_service.service 
>2018-06-25 19:25:52.788 1 CRITICAL cinder [req-5eea927c-6733-4741-9be8-4decd4981fd0 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 19:25:52.788 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 19:25:52.788 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 19:25:52.788 1 ERROR cinder     sys.exit(main())
>2018-06-25 19:25:52.788 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 19:25:52.788 1 ERROR cinder     service.wait()
>2018-06-25 19:25:52.788 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 19:25:52.788 1 ERROR cinder     _launcher.wait()
>2018-06-25 19:25:52.788 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 19:25:52.788 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 19:25:52.788 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 19:25:52.788 1 ERROR cinder     self.services.wait()
>2018-06-25 19:25:52.788 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 19:25:52.788 1 ERROR cinder     service.wait()
>2018-06-25 19:25:52.788 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 19:25:52.788 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 19:25:52.788 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 19:25:52.788 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 19:25:52.788 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 19:25:52.788 1 ERROR cinder     post_fn = fn()
>2018-06-25 19:25:52.788 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 19:25:52.788 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 19:25:52.788 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 19:25:52.788 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 19:25:52.788 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 19:25:52.788 1 ERROR cinder 
>2018-06-25 19:25:55.437 1 WARNING cinder.scheduler.host_manager [req-233a5168-9fbc-409f-808a-39e1af720c65 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 19:25:55.447 1 INFO cinder.rpc [req-233a5168-9fbc-409f-808a-39e1af720c65 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 19:25:55.452 1 INFO cinder.rpc [req-233a5168-9fbc-409f-808a-39e1af720c65 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 19:25:55.466 1 INFO cinder.rpc [req-233a5168-9fbc-409f-808a-39e1af720c65 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 19:25:55.475 1 INFO cinder.rpc [req-233a5168-9fbc-409f-808a-39e1af720c65 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 19:25:55.503 1 WARNING oslo_config.cfg [req-233a5168-9fbc-409f-808a-39e1af720c65 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 19:25:55.505 1 WARNING oslo_config.cfg [req-233a5168-9fbc-409f-808a-39e1af720c65 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:25:55.506 1 WARNING oslo_config.cfg [req-233a5168-9fbc-409f-808a-39e1af720c65 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:25:55.506 1 WARNING oslo_config.cfg [req-233a5168-9fbc-409f-808a-39e1af720c65 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:25:55.512 1 WARNING oslo_config.cfg [req-233a5168-9fbc-409f-808a-39e1af720c65 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 19:25:55.513 1 WARNING oslo_config.cfg [req-233a5168-9fbc-409f-808a-39e1af720c65 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 19:25:55.516 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 19:25:55.522 1 INFO cinder.manager [req-f781b1a5-4126-498d-91dd-63e27a317f4f - - - - -] Initiating service 5 cleanup
>2018-06-25 19:25:55.527 1 INFO cinder.manager [req-f781b1a5-4126-498d-91dd-63e27a317f4f - - - - -] Service 5 cleanup completed.
>2018-06-25 19:28:08.589 1 ERROR oslo.messaging._drivers.impl_rabbit [req-f781b1a5-4126-498d-91dd-63e27a317f4f - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:28:08.591 1 ERROR oslo.messaging._drivers.impl_rabbit [req-f781b1a5-4126-498d-91dd-63e27a317f4f - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:28:08.592 1 ERROR oslo_service.service [req-f781b1a5-4126-498d-91dd-63e27a317f4f - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:28:08.592 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 19:28:08.592 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 19:28:08.592 1 ERROR oslo_service.service     service.start()
>2018-06-25 19:28:08.592 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 19:28:08.592 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 19:28:08.592 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 19:28:08.592 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 19:28:08.592 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 19:28:08.592 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 19:28:08.592 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 19:28:08.592 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 19:28:08.592 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 19:28:08.592 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 19:28:08.592 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 19:28:08.592 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 19:28:08.592 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 19:28:08.592 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 19:28:08.592 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 19:28:08.592 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 19:28:08.592 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 19:28:08.592 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 19:28:08.592 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 19:28:08.592 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 19:28:08.592 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 19:28:08.592 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 19:28:08.592 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:28:08.592 1 ERROR oslo_service.service 
>2018-06-25 19:28:08.595 1 CRITICAL cinder [req-233a5168-9fbc-409f-808a-39e1af720c65 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 19:28:08.595 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 19:28:08.595 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 19:28:08.595 1 ERROR cinder     sys.exit(main())
>2018-06-25 19:28:08.595 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 19:28:08.595 1 ERROR cinder     service.wait()
>2018-06-25 19:28:08.595 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 19:28:08.595 1 ERROR cinder     _launcher.wait()
>2018-06-25 19:28:08.595 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 19:28:08.595 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 19:28:08.595 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 19:28:08.595 1 ERROR cinder     self.services.wait()
>2018-06-25 19:28:08.595 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 19:28:08.595 1 ERROR cinder     service.wait()
>2018-06-25 19:28:08.595 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 19:28:08.595 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 19:28:08.595 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 19:28:08.595 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 19:28:08.595 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 19:28:08.595 1 ERROR cinder     post_fn = fn()
>2018-06-25 19:28:08.595 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 19:28:08.595 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 19:28:08.595 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 19:28:08.595 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 19:28:08.595 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 19:28:08.595 1 ERROR cinder 
>2018-06-25 19:28:11.352 1 WARNING cinder.scheduler.host_manager [req-5f251add-b94f-464b-ad2e-0b3ef6eeab91 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 19:28:11.361 1 INFO cinder.rpc [req-5f251add-b94f-464b-ad2e-0b3ef6eeab91 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 19:28:11.369 1 INFO cinder.rpc [req-5f251add-b94f-464b-ad2e-0b3ef6eeab91 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 19:28:11.384 1 INFO cinder.rpc [req-5f251add-b94f-464b-ad2e-0b3ef6eeab91 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 19:28:11.391 1 INFO cinder.rpc [req-5f251add-b94f-464b-ad2e-0b3ef6eeab91 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 19:28:11.416 1 WARNING oslo_config.cfg [req-5f251add-b94f-464b-ad2e-0b3ef6eeab91 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 19:28:11.418 1 WARNING oslo_config.cfg [req-5f251add-b94f-464b-ad2e-0b3ef6eeab91 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:28:11.419 1 WARNING oslo_config.cfg [req-5f251add-b94f-464b-ad2e-0b3ef6eeab91 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:28:11.419 1 WARNING oslo_config.cfg [req-5f251add-b94f-464b-ad2e-0b3ef6eeab91 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:28:11.425 1 WARNING oslo_config.cfg [req-5f251add-b94f-464b-ad2e-0b3ef6eeab91 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 19:28:11.426 1 WARNING oslo_config.cfg [req-5f251add-b94f-464b-ad2e-0b3ef6eeab91 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 19:28:11.429 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 19:28:11.435 1 INFO cinder.manager [req-68c72932-3f0f-420a-ab68-b49ce379a4ae - - - - -] Initiating service 5 cleanup
>2018-06-25 19:28:11.440 1 INFO cinder.manager [req-68c72932-3f0f-420a-ab68-b49ce379a4ae - - - - -] Service 5 cleanup completed.
>2018-06-25 19:30:17.480 1 ERROR oslo.messaging._drivers.impl_rabbit [req-68c72932-3f0f-420a-ab68-b49ce379a4ae - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:30:17.483 1 ERROR oslo.messaging._drivers.impl_rabbit [req-68c72932-3f0f-420a-ab68-b49ce379a4ae - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:30:17.483 1 ERROR oslo_service.service [req-68c72932-3f0f-420a-ab68-b49ce379a4ae - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:30:17.483 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 19:30:17.483 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 19:30:17.483 1 ERROR oslo_service.service     service.start()
>2018-06-25 19:30:17.483 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 19:30:17.483 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 19:30:17.483 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 19:30:17.483 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 19:30:17.483 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 19:30:17.483 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 19:30:17.483 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 19:30:17.483 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 19:30:17.483 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 19:30:17.483 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 19:30:17.483 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 19:30:17.483 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 19:30:17.483 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 19:30:17.483 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 19:30:17.483 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 19:30:17.483 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 19:30:17.483 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 19:30:17.483 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 19:30:17.483 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 19:30:17.483 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 19:30:17.483 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 19:30:17.483 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 19:30:17.483 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:30:17.483 1 ERROR oslo_service.service 
>2018-06-25 19:30:17.488 1 CRITICAL cinder [req-5f251add-b94f-464b-ad2e-0b3ef6eeab91 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 19:30:17.488 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 19:30:17.488 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 19:30:17.488 1 ERROR cinder     sys.exit(main())
>2018-06-25 19:30:17.488 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 19:30:17.488 1 ERROR cinder     service.wait()
>2018-06-25 19:30:17.488 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 19:30:17.488 1 ERROR cinder     _launcher.wait()
>2018-06-25 19:30:17.488 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 19:30:17.488 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 19:30:17.488 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 19:30:17.488 1 ERROR cinder     self.services.wait()
>2018-06-25 19:30:17.488 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 19:30:17.488 1 ERROR cinder     service.wait()
>2018-06-25 19:30:17.488 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 19:30:17.488 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 19:30:17.488 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 19:30:17.488 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 19:30:17.488 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 19:30:17.488 1 ERROR cinder     post_fn = fn()
>2018-06-25 19:30:17.488 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 19:30:17.488 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 19:30:17.488 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 19:30:17.488 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 19:30:17.488 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 19:30:17.488 1 ERROR cinder 
>2018-06-25 19:30:20.255 1 WARNING cinder.scheduler.host_manager [req-06344982-3a9d-4b86-935a-c91952b5ecc9 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 19:30:20.262 1 INFO cinder.rpc [req-06344982-3a9d-4b86-935a-c91952b5ecc9 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 19:30:20.273 1 INFO cinder.rpc [req-06344982-3a9d-4b86-935a-c91952b5ecc9 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 19:30:20.292 1 INFO cinder.rpc [req-06344982-3a9d-4b86-935a-c91952b5ecc9 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 19:30:20.299 1 INFO cinder.rpc [req-06344982-3a9d-4b86-935a-c91952b5ecc9 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 19:30:20.329 1 WARNING oslo_config.cfg [req-06344982-3a9d-4b86-935a-c91952b5ecc9 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 19:30:20.331 1 WARNING oslo_config.cfg [req-06344982-3a9d-4b86-935a-c91952b5ecc9 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:30:20.332 1 WARNING oslo_config.cfg [req-06344982-3a9d-4b86-935a-c91952b5ecc9 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:30:20.332 1 WARNING oslo_config.cfg [req-06344982-3a9d-4b86-935a-c91952b5ecc9 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:30:20.339 1 WARNING oslo_config.cfg [req-06344982-3a9d-4b86-935a-c91952b5ecc9 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 19:30:20.340 1 WARNING oslo_config.cfg [req-06344982-3a9d-4b86-935a-c91952b5ecc9 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 19:30:20.343 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 19:30:20.350 1 INFO cinder.manager [req-451f86e9-a741-4d55-83bb-e52a33527926 - - - - -] Initiating service 5 cleanup
>2018-06-25 19:30:20.358 1 INFO cinder.manager [req-451f86e9-a741-4d55-83bb-e52a33527926 - - - - -] Service 5 cleanup completed.
>2018-06-25 19:32:27.037 1 ERROR oslo.messaging._drivers.impl_rabbit [req-451f86e9-a741-4d55-83bb-e52a33527926 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:32:27.040 1 ERROR oslo.messaging._drivers.impl_rabbit [req-451f86e9-a741-4d55-83bb-e52a33527926 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:32:27.040 1 ERROR oslo_service.service [req-451f86e9-a741-4d55-83bb-e52a33527926 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:32:27.040 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 19:32:27.040 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 19:32:27.040 1 ERROR oslo_service.service     service.start()
>2018-06-25 19:32:27.040 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 19:32:27.040 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 19:32:27.040 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 19:32:27.040 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 19:32:27.040 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 19:32:27.040 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 19:32:27.040 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 19:32:27.040 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 19:32:27.040 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 19:32:27.040 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 19:32:27.040 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 19:32:27.040 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 19:32:27.040 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 19:32:27.040 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 19:32:27.040 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 19:32:27.040 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 19:32:27.040 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 19:32:27.040 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 19:32:27.040 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 19:32:27.040 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 19:32:27.040 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 19:32:27.040 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 19:32:27.040 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:32:27.040 1 ERROR oslo_service.service 
>2018-06-25 19:32:27.043 1 CRITICAL cinder [req-06344982-3a9d-4b86-935a-c91952b5ecc9 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 19:32:27.043 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 19:32:27.043 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 19:32:27.043 1 ERROR cinder     sys.exit(main())
>2018-06-25 19:32:27.043 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 19:32:27.043 1 ERROR cinder     service.wait()
>2018-06-25 19:32:27.043 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 19:32:27.043 1 ERROR cinder     _launcher.wait()
>2018-06-25 19:32:27.043 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 19:32:27.043 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 19:32:27.043 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 19:32:27.043 1 ERROR cinder     self.services.wait()
>2018-06-25 19:32:27.043 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 19:32:27.043 1 ERROR cinder     service.wait()
>2018-06-25 19:32:27.043 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 19:32:27.043 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 19:32:27.043 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 19:32:27.043 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 19:32:27.043 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 19:32:27.043 1 ERROR cinder     post_fn = fn()
>2018-06-25 19:32:27.043 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 19:32:27.043 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 19:32:27.043 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 19:32:27.043 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 19:32:27.043 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 19:32:27.043 1 ERROR cinder 
>2018-06-25 19:32:29.730 1 WARNING cinder.scheduler.host_manager [req-e59b0bd7-b8ed-40e5-a0be-e0f89d96dc17 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 19:32:29.735 1 INFO cinder.rpc [req-e59b0bd7-b8ed-40e5-a0be-e0f89d96dc17 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 19:32:29.742 1 INFO cinder.rpc [req-e59b0bd7-b8ed-40e5-a0be-e0f89d96dc17 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 19:32:29.753 1 INFO cinder.rpc [req-e59b0bd7-b8ed-40e5-a0be-e0f89d96dc17 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 19:32:29.761 1 INFO cinder.rpc [req-e59b0bd7-b8ed-40e5-a0be-e0f89d96dc17 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 19:32:29.785 1 WARNING oslo_config.cfg [req-e59b0bd7-b8ed-40e5-a0be-e0f89d96dc17 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 19:32:29.787 1 WARNING oslo_config.cfg [req-e59b0bd7-b8ed-40e5-a0be-e0f89d96dc17 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:32:29.788 1 WARNING oslo_config.cfg [req-e59b0bd7-b8ed-40e5-a0be-e0f89d96dc17 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:32:29.788 1 WARNING oslo_config.cfg [req-e59b0bd7-b8ed-40e5-a0be-e0f89d96dc17 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:32:29.793 1 WARNING oslo_config.cfg [req-e59b0bd7-b8ed-40e5-a0be-e0f89d96dc17 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 19:32:29.795 1 WARNING oslo_config.cfg [req-e59b0bd7-b8ed-40e5-a0be-e0f89d96dc17 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 19:32:29.797 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 19:32:29.804 1 INFO cinder.manager [req-a65f3c74-881c-4806-baa6-6db7cb2270f7 - - - - -] Initiating service 5 cleanup
>2018-06-25 19:32:29.808 1 INFO cinder.manager [req-a65f3c74-881c-4806-baa6-6db7cb2270f7 - - - - -] Service 5 cleanup completed.
>2018-06-25 19:34:42.285 1 ERROR oslo.messaging._drivers.impl_rabbit [req-a65f3c74-881c-4806-baa6-6db7cb2270f7 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:34:42.288 1 ERROR oslo.messaging._drivers.impl_rabbit [req-a65f3c74-881c-4806-baa6-6db7cb2270f7 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:34:42.288 1 ERROR oslo_service.service [req-a65f3c74-881c-4806-baa6-6db7cb2270f7 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:34:42.288 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 19:34:42.288 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 19:34:42.288 1 ERROR oslo_service.service     service.start()
>2018-06-25 19:34:42.288 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 19:34:42.288 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 19:34:42.288 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 19:34:42.288 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 19:34:42.288 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 19:34:42.288 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 19:34:42.288 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 19:34:42.288 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 19:34:42.288 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 19:34:42.288 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 19:34:42.288 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 19:34:42.288 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 19:34:42.288 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 19:34:42.288 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 19:34:42.288 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 19:34:42.288 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 19:34:42.288 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 19:34:42.288 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 19:34:42.288 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 19:34:42.288 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 19:34:42.288 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 19:34:42.288 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 19:34:42.288 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:34:42.288 1 ERROR oslo_service.service 
>2018-06-25 19:34:42.291 1 CRITICAL cinder [req-e59b0bd7-b8ed-40e5-a0be-e0f89d96dc17 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 19:34:42.291 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 19:34:42.291 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 19:34:42.291 1 ERROR cinder     sys.exit(main())
>2018-06-25 19:34:42.291 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 19:34:42.291 1 ERROR cinder     service.wait()
>2018-06-25 19:34:42.291 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 19:34:42.291 1 ERROR cinder     _launcher.wait()
>2018-06-25 19:34:42.291 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 19:34:42.291 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 19:34:42.291 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 19:34:42.291 1 ERROR cinder     self.services.wait()
>2018-06-25 19:34:42.291 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 19:34:42.291 1 ERROR cinder     service.wait()
>2018-06-25 19:34:42.291 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 19:34:42.291 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 19:34:42.291 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 19:34:42.291 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 19:34:42.291 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 19:34:42.291 1 ERROR cinder     post_fn = fn()
>2018-06-25 19:34:42.291 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 19:34:42.291 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 19:34:42.291 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 19:34:42.291 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 19:34:42.291 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 19:34:42.291 1 ERROR cinder 
>2018-06-25 19:34:44.989 1 WARNING cinder.scheduler.host_manager [req-1031402f-f810-41b8-acaa-4fb8d563275c - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 19:34:44.994 1 INFO cinder.rpc [req-1031402f-f810-41b8-acaa-4fb8d563275c - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 19:34:45.000 1 INFO cinder.rpc [req-1031402f-f810-41b8-acaa-4fb8d563275c - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 19:34:45.010 1 INFO cinder.rpc [req-1031402f-f810-41b8-acaa-4fb8d563275c - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 19:34:45.015 1 INFO cinder.rpc [req-1031402f-f810-41b8-acaa-4fb8d563275c - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 19:34:45.038 1 WARNING oslo_config.cfg [req-1031402f-f810-41b8-acaa-4fb8d563275c - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 19:34:45.041 1 WARNING oslo_config.cfg [req-1031402f-f810-41b8-acaa-4fb8d563275c - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:34:45.041 1 WARNING oslo_config.cfg [req-1031402f-f810-41b8-acaa-4fb8d563275c - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:34:45.042 1 WARNING oslo_config.cfg [req-1031402f-f810-41b8-acaa-4fb8d563275c - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:34:45.047 1 WARNING oslo_config.cfg [req-1031402f-f810-41b8-acaa-4fb8d563275c - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 19:34:45.048 1 WARNING oslo_config.cfg [req-1031402f-f810-41b8-acaa-4fb8d563275c - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 19:34:45.051 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 19:34:45.056 1 INFO cinder.manager [req-313743f3-25d5-478c-ad9f-b9fd07c89e1b - - - - -] Initiating service 5 cleanup
>2018-06-25 19:34:45.060 1 INFO cinder.manager [req-313743f3-25d5-478c-ad9f-b9fd07c89e1b - - - - -] Service 5 cleanup completed.
>2018-06-25 19:36:51.700 1 ERROR oslo.messaging._drivers.impl_rabbit [req-313743f3-25d5-478c-ad9f-b9fd07c89e1b - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:36:51.702 1 ERROR oslo.messaging._drivers.impl_rabbit [req-313743f3-25d5-478c-ad9f-b9fd07c89e1b - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:36:51.702 1 ERROR oslo_service.service [req-313743f3-25d5-478c-ad9f-b9fd07c89e1b - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:36:51.702 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 19:36:51.702 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 19:36:51.702 1 ERROR oslo_service.service     service.start()
>2018-06-25 19:36:51.702 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 19:36:51.702 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 19:36:51.702 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 19:36:51.702 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 19:36:51.702 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 19:36:51.702 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 19:36:51.702 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 19:36:51.702 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 19:36:51.702 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 19:36:51.702 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 19:36:51.702 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 19:36:51.702 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 19:36:51.702 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 19:36:51.702 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 19:36:51.702 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 19:36:51.702 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 19:36:51.702 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 19:36:51.702 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 19:36:51.702 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 19:36:51.702 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 19:36:51.702 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 19:36:51.702 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 19:36:51.702 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:36:51.702 1 ERROR oslo_service.service 
>2018-06-25 19:36:51.705 1 CRITICAL cinder [req-1031402f-f810-41b8-acaa-4fb8d563275c - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 19:36:51.705 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 19:36:51.705 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 19:36:51.705 1 ERROR cinder     sys.exit(main())
>2018-06-25 19:36:51.705 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 19:36:51.705 1 ERROR cinder     service.wait()
>2018-06-25 19:36:51.705 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 19:36:51.705 1 ERROR cinder     _launcher.wait()
>2018-06-25 19:36:51.705 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 19:36:51.705 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 19:36:51.705 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 19:36:51.705 1 ERROR cinder     self.services.wait()
>2018-06-25 19:36:51.705 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 19:36:51.705 1 ERROR cinder     service.wait()
>2018-06-25 19:36:51.705 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 19:36:51.705 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 19:36:51.705 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 19:36:51.705 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 19:36:51.705 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 19:36:51.705 1 ERROR cinder     post_fn = fn()
>2018-06-25 19:36:51.705 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 19:36:51.705 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 19:36:51.705 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 19:36:51.705 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 19:36:51.705 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 19:36:51.705 1 ERROR cinder 
>2018-06-25 19:36:54.446 1 WARNING cinder.scheduler.host_manager [req-40338afc-4978-41b7-b179-77539a6bc981 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 19:36:54.452 1 INFO cinder.rpc [req-40338afc-4978-41b7-b179-77539a6bc981 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 19:36:54.458 1 INFO cinder.rpc [req-40338afc-4978-41b7-b179-77539a6bc981 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 19:36:54.470 1 INFO cinder.rpc [req-40338afc-4978-41b7-b179-77539a6bc981 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 19:36:54.478 1 INFO cinder.rpc [req-40338afc-4978-41b7-b179-77539a6bc981 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 19:36:54.510 1 WARNING oslo_config.cfg [req-40338afc-4978-41b7-b179-77539a6bc981 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 19:36:54.512 1 WARNING oslo_config.cfg [req-40338afc-4978-41b7-b179-77539a6bc981 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:36:54.513 1 WARNING oslo_config.cfg [req-40338afc-4978-41b7-b179-77539a6bc981 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:36:54.513 1 WARNING oslo_config.cfg [req-40338afc-4978-41b7-b179-77539a6bc981 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:36:54.518 1 WARNING oslo_config.cfg [req-40338afc-4978-41b7-b179-77539a6bc981 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 19:36:54.520 1 WARNING oslo_config.cfg [req-40338afc-4978-41b7-b179-77539a6bc981 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 19:36:54.522 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 19:36:54.530 1 INFO cinder.manager [req-7c30827b-de39-41b1-879b-0a9f74beffab - - - - -] Initiating service 5 cleanup
>2018-06-25 19:36:54.537 1 INFO cinder.manager [req-7c30827b-de39-41b1-879b-0a9f74beffab - - - - -] Service 5 cleanup completed.
>2018-06-25 19:39:06.389 1 ERROR oslo.messaging._drivers.impl_rabbit [req-7c30827b-de39-41b1-879b-0a9f74beffab - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:39:06.391 1 ERROR oslo.messaging._drivers.impl_rabbit [req-7c30827b-de39-41b1-879b-0a9f74beffab - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:39:06.391 1 ERROR oslo_service.service [req-7c30827b-de39-41b1-879b-0a9f74beffab - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:39:06.391 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 19:39:06.391 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 19:39:06.391 1 ERROR oslo_service.service     service.start()
>2018-06-25 19:39:06.391 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 19:39:06.391 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 19:39:06.391 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 19:39:06.391 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 19:39:06.391 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 19:39:06.391 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 19:39:06.391 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 19:39:06.391 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 19:39:06.391 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 19:39:06.391 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 19:39:06.391 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 19:39:06.391 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 19:39:06.391 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 19:39:06.391 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 19:39:06.391 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 19:39:06.391 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 19:39:06.391 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 19:39:06.391 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 19:39:06.391 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 19:39:06.391 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 19:39:06.391 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 19:39:06.391 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 19:39:06.391 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:39:06.391 1 ERROR oslo_service.service 
>2018-06-25 19:39:06.394 1 CRITICAL cinder [req-40338afc-4978-41b7-b179-77539a6bc981 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 19:39:06.394 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 19:39:06.394 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 19:39:06.394 1 ERROR cinder     sys.exit(main())
>2018-06-25 19:39:06.394 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 19:39:06.394 1 ERROR cinder     service.wait()
>2018-06-25 19:39:06.394 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 19:39:06.394 1 ERROR cinder     _launcher.wait()
>2018-06-25 19:39:06.394 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 19:39:06.394 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 19:39:06.394 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 19:39:06.394 1 ERROR cinder     self.services.wait()
>2018-06-25 19:39:06.394 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 19:39:06.394 1 ERROR cinder     service.wait()
>2018-06-25 19:39:06.394 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 19:39:06.394 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 19:39:06.394 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 19:39:06.394 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 19:39:06.394 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 19:39:06.394 1 ERROR cinder     post_fn = fn()
>2018-06-25 19:39:06.394 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 19:39:06.394 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 19:39:06.394 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 19:39:06.394 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 19:39:06.394 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 19:39:06.394 1 ERROR cinder 
>2018-06-25 19:39:09.059 1 WARNING cinder.scheduler.host_manager [req-8911190b-f543-41be-a720-8b3dc72122e9 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 19:39:09.067 1 INFO cinder.rpc [req-8911190b-f543-41be-a720-8b3dc72122e9 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 19:39:09.076 1 INFO cinder.rpc [req-8911190b-f543-41be-a720-8b3dc72122e9 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 19:39:09.088 1 INFO cinder.rpc [req-8911190b-f543-41be-a720-8b3dc72122e9 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 19:39:09.097 1 INFO cinder.rpc [req-8911190b-f543-41be-a720-8b3dc72122e9 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 19:39:09.121 1 WARNING oslo_config.cfg [req-8911190b-f543-41be-a720-8b3dc72122e9 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 19:39:09.123 1 WARNING oslo_config.cfg [req-8911190b-f543-41be-a720-8b3dc72122e9 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:39:09.123 1 WARNING oslo_config.cfg [req-8911190b-f543-41be-a720-8b3dc72122e9 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:39:09.124 1 WARNING oslo_config.cfg [req-8911190b-f543-41be-a720-8b3dc72122e9 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:39:09.129 1 WARNING oslo_config.cfg [req-8911190b-f543-41be-a720-8b3dc72122e9 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 19:39:09.130 1 WARNING oslo_config.cfg [req-8911190b-f543-41be-a720-8b3dc72122e9 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 19:39:09.133 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 19:39:09.138 1 INFO cinder.manager [req-9c0b85aa-5f70-4aec-bd57-1bc030d1143e - - - - -] Initiating service 5 cleanup
>2018-06-25 19:39:09.143 1 INFO cinder.manager [req-9c0b85aa-5f70-4aec-bd57-1bc030d1143e - - - - -] Service 5 cleanup completed.
>2018-06-25 19:41:15.496 1 ERROR oslo.messaging._drivers.impl_rabbit [req-9c0b85aa-5f70-4aec-bd57-1bc030d1143e - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:41:15.499 1 ERROR oslo.messaging._drivers.impl_rabbit [req-9c0b85aa-5f70-4aec-bd57-1bc030d1143e - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:41:15.500 1 ERROR oslo_service.service [req-9c0b85aa-5f70-4aec-bd57-1bc030d1143e - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:41:15.500 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 19:41:15.500 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 19:41:15.500 1 ERROR oslo_service.service     service.start()
>2018-06-25 19:41:15.500 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 19:41:15.500 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 19:41:15.500 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 19:41:15.500 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 19:41:15.500 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 19:41:15.500 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 19:41:15.500 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 19:41:15.500 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 19:41:15.500 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 19:41:15.500 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 19:41:15.500 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 19:41:15.500 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 19:41:15.500 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 19:41:15.500 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 19:41:15.500 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 19:41:15.500 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 19:41:15.500 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 19:41:15.500 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 19:41:15.500 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 19:41:15.500 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 19:41:15.500 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 19:41:15.500 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 19:41:15.500 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:41:15.500 1 ERROR oslo_service.service 
>2018-06-25 19:41:15.504 1 CRITICAL cinder [req-8911190b-f543-41be-a720-8b3dc72122e9 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 19:41:15.504 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 19:41:15.504 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 19:41:15.504 1 ERROR cinder     sys.exit(main())
>2018-06-25 19:41:15.504 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 19:41:15.504 1 ERROR cinder     service.wait()
>2018-06-25 19:41:15.504 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 19:41:15.504 1 ERROR cinder     _launcher.wait()
>2018-06-25 19:41:15.504 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 19:41:15.504 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 19:41:15.504 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 19:41:15.504 1 ERROR cinder     self.services.wait()
>2018-06-25 19:41:15.504 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 19:41:15.504 1 ERROR cinder     service.wait()
>2018-06-25 19:41:15.504 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 19:41:15.504 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 19:41:15.504 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 19:41:15.504 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 19:41:15.504 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 19:41:15.504 1 ERROR cinder     post_fn = fn()
>2018-06-25 19:41:15.504 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 19:41:15.504 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 19:41:15.504 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 19:41:15.504 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 19:41:15.504 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 19:41:15.504 1 ERROR cinder 
>2018-06-25 19:41:18.325 1 WARNING cinder.scheduler.host_manager [req-b54bc65b-2082-41db-86c0-0ef9a4c36d15 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 19:41:18.332 1 INFO cinder.rpc [req-b54bc65b-2082-41db-86c0-0ef9a4c36d15 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 19:41:18.340 1 INFO cinder.rpc [req-b54bc65b-2082-41db-86c0-0ef9a4c36d15 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 19:41:18.364 1 INFO cinder.rpc [req-b54bc65b-2082-41db-86c0-0ef9a4c36d15 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 19:41:18.373 1 INFO cinder.rpc [req-b54bc65b-2082-41db-86c0-0ef9a4c36d15 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 19:41:18.420 1 WARNING oslo_config.cfg [req-b54bc65b-2082-41db-86c0-0ef9a4c36d15 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 19:41:18.423 1 WARNING oslo_config.cfg [req-b54bc65b-2082-41db-86c0-0ef9a4c36d15 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:41:18.423 1 WARNING oslo_config.cfg [req-b54bc65b-2082-41db-86c0-0ef9a4c36d15 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:41:18.424 1 WARNING oslo_config.cfg [req-b54bc65b-2082-41db-86c0-0ef9a4c36d15 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:41:18.430 1 WARNING oslo_config.cfg [req-b54bc65b-2082-41db-86c0-0ef9a4c36d15 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 19:41:18.431 1 WARNING oslo_config.cfg [req-b54bc65b-2082-41db-86c0-0ef9a4c36d15 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 19:41:18.434 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 19:41:18.441 1 INFO cinder.manager [req-77240479-f8a6-4207-b62c-296510e6b7fd - - - - -] Initiating service 5 cleanup
>2018-06-25 19:41:18.446 1 INFO cinder.manager [req-77240479-f8a6-4207-b62c-296510e6b7fd - - - - -] Service 5 cleanup completed.
>2018-06-25 19:43:30.926 1 ERROR oslo.messaging._drivers.impl_rabbit [req-77240479-f8a6-4207-b62c-296510e6b7fd - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:43:30.928 1 ERROR oslo.messaging._drivers.impl_rabbit [req-77240479-f8a6-4207-b62c-296510e6b7fd - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:43:30.928 1 ERROR oslo_service.service [req-77240479-f8a6-4207-b62c-296510e6b7fd - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:43:30.928 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 19:43:30.928 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 19:43:30.928 1 ERROR oslo_service.service     service.start()
>2018-06-25 19:43:30.928 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 19:43:30.928 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 19:43:30.928 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 19:43:30.928 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 19:43:30.928 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 19:43:30.928 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 19:43:30.928 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 19:43:30.928 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 19:43:30.928 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 19:43:30.928 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 19:43:30.928 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 19:43:30.928 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 19:43:30.928 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 19:43:30.928 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 19:43:30.928 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 19:43:30.928 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 19:43:30.928 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 19:43:30.928 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 19:43:30.928 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 19:43:30.928 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 19:43:30.928 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 19:43:30.928 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 19:43:30.928 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:43:30.928 1 ERROR oslo_service.service 
>2018-06-25 19:43:30.931 1 CRITICAL cinder [req-b54bc65b-2082-41db-86c0-0ef9a4c36d15 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 19:43:30.931 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 19:43:30.931 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 19:43:30.931 1 ERROR cinder     sys.exit(main())
>2018-06-25 19:43:30.931 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 19:43:30.931 1 ERROR cinder     service.wait()
>2018-06-25 19:43:30.931 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 19:43:30.931 1 ERROR cinder     _launcher.wait()
>2018-06-25 19:43:30.931 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 19:43:30.931 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 19:43:30.931 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 19:43:30.931 1 ERROR cinder     self.services.wait()
>2018-06-25 19:43:30.931 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 19:43:30.931 1 ERROR cinder     service.wait()
>2018-06-25 19:43:30.931 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 19:43:30.931 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 19:43:30.931 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 19:43:30.931 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 19:43:30.931 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 19:43:30.931 1 ERROR cinder     post_fn = fn()
>2018-06-25 19:43:30.931 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 19:43:30.931 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 19:43:30.931 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 19:43:30.931 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 19:43:30.931 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 19:43:30.931 1 ERROR cinder 
>2018-06-25 19:43:33.692 1 WARNING cinder.scheduler.host_manager [req-6ff71676-a0a8-4f90-952b-c676b4bdac47 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 19:43:33.698 1 INFO cinder.rpc [req-6ff71676-a0a8-4f90-952b-c676b4bdac47 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 19:43:33.703 1 INFO cinder.rpc [req-6ff71676-a0a8-4f90-952b-c676b4bdac47 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 19:43:33.718 1 INFO cinder.rpc [req-6ff71676-a0a8-4f90-952b-c676b4bdac47 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 19:43:33.726 1 INFO cinder.rpc [req-6ff71676-a0a8-4f90-952b-c676b4bdac47 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 19:43:33.757 1 WARNING oslo_config.cfg [req-6ff71676-a0a8-4f90-952b-c676b4bdac47 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 19:43:33.760 1 WARNING oslo_config.cfg [req-6ff71676-a0a8-4f90-952b-c676b4bdac47 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:43:33.760 1 WARNING oslo_config.cfg [req-6ff71676-a0a8-4f90-952b-c676b4bdac47 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:43:33.761 1 WARNING oslo_config.cfg [req-6ff71676-a0a8-4f90-952b-c676b4bdac47 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:43:33.768 1 WARNING oslo_config.cfg [req-6ff71676-a0a8-4f90-952b-c676b4bdac47 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 19:43:33.770 1 WARNING oslo_config.cfg [req-6ff71676-a0a8-4f90-952b-c676b4bdac47 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 19:43:33.775 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 19:43:33.783 1 INFO cinder.manager [req-ade307a6-0404-43c8-a68a-b044749b060b - - - - -] Initiating service 5 cleanup
>2018-06-25 19:43:33.789 1 INFO cinder.manager [req-ade307a6-0404-43c8-a68a-b044749b060b - - - - -] Service 5 cleanup completed.
>2018-06-25 19:45:38.173 1 ERROR oslo.messaging._drivers.impl_rabbit [req-ade307a6-0404-43c8-a68a-b044749b060b - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:45:38.175 1 ERROR oslo.messaging._drivers.impl_rabbit [req-ade307a6-0404-43c8-a68a-b044749b060b - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:45:38.175 1 ERROR oslo_service.service [req-ade307a6-0404-43c8-a68a-b044749b060b - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:45:38.175 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 19:45:38.175 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 19:45:38.175 1 ERROR oslo_service.service     service.start()
>2018-06-25 19:45:38.175 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 19:45:38.175 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 19:45:38.175 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 19:45:38.175 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 19:45:38.175 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 19:45:38.175 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 19:45:38.175 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 19:45:38.175 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 19:45:38.175 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 19:45:38.175 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 19:45:38.175 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 19:45:38.175 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 19:45:38.175 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 19:45:38.175 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 19:45:38.175 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 19:45:38.175 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 19:45:38.175 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 19:45:38.175 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 19:45:38.175 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 19:45:38.175 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 19:45:38.175 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 19:45:38.175 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 19:45:38.175 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:45:38.175 1 ERROR oslo_service.service 
>2018-06-25 19:45:38.178 1 CRITICAL cinder [req-6ff71676-a0a8-4f90-952b-c676b4bdac47 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 19:45:38.178 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 19:45:38.178 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 19:45:38.178 1 ERROR cinder     sys.exit(main())
>2018-06-25 19:45:38.178 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 19:45:38.178 1 ERROR cinder     service.wait()
>2018-06-25 19:45:38.178 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 19:45:38.178 1 ERROR cinder     _launcher.wait()
>2018-06-25 19:45:38.178 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 19:45:38.178 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 19:45:38.178 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 19:45:38.178 1 ERROR cinder     self.services.wait()
>2018-06-25 19:45:38.178 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 19:45:38.178 1 ERROR cinder     service.wait()
>2018-06-25 19:45:38.178 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 19:45:38.178 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 19:45:38.178 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 19:45:38.178 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 19:45:38.178 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 19:45:38.178 1 ERROR cinder     post_fn = fn()
>2018-06-25 19:45:38.178 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 19:45:38.178 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 19:45:38.178 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 19:45:38.178 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 19:45:38.178 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 19:45:38.178 1 ERROR cinder 
>2018-06-25 19:45:40.833 1 WARNING cinder.scheduler.host_manager [req-c81ec3fa-27a7-4c04-8d72-cf64468d8e0e - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 19:45:40.841 1 INFO cinder.rpc [req-c81ec3fa-27a7-4c04-8d72-cf64468d8e0e - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 19:45:40.850 1 INFO cinder.rpc [req-c81ec3fa-27a7-4c04-8d72-cf64468d8e0e - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 19:45:40.861 1 INFO cinder.rpc [req-c81ec3fa-27a7-4c04-8d72-cf64468d8e0e - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 19:45:40.868 1 INFO cinder.rpc [req-c81ec3fa-27a7-4c04-8d72-cf64468d8e0e - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 19:45:40.894 1 WARNING oslo_config.cfg [req-c81ec3fa-27a7-4c04-8d72-cf64468d8e0e - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 19:45:40.897 1 WARNING oslo_config.cfg [req-c81ec3fa-27a7-4c04-8d72-cf64468d8e0e - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:45:40.897 1 WARNING oslo_config.cfg [req-c81ec3fa-27a7-4c04-8d72-cf64468d8e0e - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:45:40.898 1 WARNING oslo_config.cfg [req-c81ec3fa-27a7-4c04-8d72-cf64468d8e0e - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:45:40.904 1 WARNING oslo_config.cfg [req-c81ec3fa-27a7-4c04-8d72-cf64468d8e0e - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 19:45:40.905 1 WARNING oslo_config.cfg [req-c81ec3fa-27a7-4c04-8d72-cf64468d8e0e - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 19:45:40.908 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 19:45:40.914 1 INFO cinder.manager [req-9a81862c-bb58-4d6e-b6d9-dfa965d2decd - - - - -] Initiating service 5 cleanup
>2018-06-25 19:45:40.918 1 INFO cinder.manager [req-9a81862c-bb58-4d6e-b6d9-dfa965d2decd - - - - -] Service 5 cleanup completed.
>2018-06-25 19:47:47.035 1 ERROR oslo.messaging._drivers.impl_rabbit [req-9a81862c-bb58-4d6e-b6d9-dfa965d2decd - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:47:47.037 1 ERROR oslo.messaging._drivers.impl_rabbit [req-9a81862c-bb58-4d6e-b6d9-dfa965d2decd - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:47:47.037 1 ERROR oslo_service.service [req-9a81862c-bb58-4d6e-b6d9-dfa965d2decd - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:47:47.037 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 19:47:47.037 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 19:47:47.037 1 ERROR oslo_service.service     service.start()
>2018-06-25 19:47:47.037 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 19:47:47.037 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 19:47:47.037 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 19:47:47.037 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 19:47:47.037 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 19:47:47.037 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 19:47:47.037 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 19:47:47.037 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 19:47:47.037 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 19:47:47.037 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 19:47:47.037 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 19:47:47.037 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 19:47:47.037 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 19:47:47.037 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 19:47:47.037 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 19:47:47.037 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 19:47:47.037 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 19:47:47.037 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 19:47:47.037 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 19:47:47.037 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 19:47:47.037 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 19:47:47.037 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 19:47:47.037 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:47:47.037 1 ERROR oslo_service.service 
>2018-06-25 19:47:47.040 1 CRITICAL cinder [req-c81ec3fa-27a7-4c04-8d72-cf64468d8e0e - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 19:47:47.040 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 19:47:47.040 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 19:47:47.040 1 ERROR cinder     sys.exit(main())
>2018-06-25 19:47:47.040 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 19:47:47.040 1 ERROR cinder     service.wait()
>2018-06-25 19:47:47.040 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 19:47:47.040 1 ERROR cinder     _launcher.wait()
>2018-06-25 19:47:47.040 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 19:47:47.040 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 19:47:47.040 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 19:47:47.040 1 ERROR cinder     self.services.wait()
>2018-06-25 19:47:47.040 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 19:47:47.040 1 ERROR cinder     service.wait()
>2018-06-25 19:47:47.040 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 19:47:47.040 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 19:47:47.040 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 19:47:47.040 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 19:47:47.040 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 19:47:47.040 1 ERROR cinder     post_fn = fn()
>2018-06-25 19:47:47.040 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 19:47:47.040 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 19:47:47.040 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 19:47:47.040 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 19:47:47.040 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 19:47:47.040 1 ERROR cinder 
>2018-06-25 19:47:49.764 1 WARNING cinder.scheduler.host_manager [req-59d9ff3b-4764-4087-9dc0-ff56b0edd501 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 19:47:49.770 1 INFO cinder.rpc [req-59d9ff3b-4764-4087-9dc0-ff56b0edd501 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 19:47:49.775 1 INFO cinder.rpc [req-59d9ff3b-4764-4087-9dc0-ff56b0edd501 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 19:47:49.787 1 INFO cinder.rpc [req-59d9ff3b-4764-4087-9dc0-ff56b0edd501 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 19:47:49.793 1 INFO cinder.rpc [req-59d9ff3b-4764-4087-9dc0-ff56b0edd501 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 19:47:49.815 1 WARNING oslo_config.cfg [req-59d9ff3b-4764-4087-9dc0-ff56b0edd501 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 19:47:49.817 1 WARNING oslo_config.cfg [req-59d9ff3b-4764-4087-9dc0-ff56b0edd501 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:47:49.818 1 WARNING oslo_config.cfg [req-59d9ff3b-4764-4087-9dc0-ff56b0edd501 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:47:49.818 1 WARNING oslo_config.cfg [req-59d9ff3b-4764-4087-9dc0-ff56b0edd501 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:47:49.823 1 WARNING oslo_config.cfg [req-59d9ff3b-4764-4087-9dc0-ff56b0edd501 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 19:47:49.825 1 WARNING oslo_config.cfg [req-59d9ff3b-4764-4087-9dc0-ff56b0edd501 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 19:47:49.827 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 19:47:49.833 1 INFO cinder.manager [req-20160f0e-7b2e-4ace-bf0c-c59adcced27b - - - - -] Initiating service 5 cleanup
>2018-06-25 19:47:49.838 1 INFO cinder.manager [req-20160f0e-7b2e-4ace-bf0c-c59adcced27b - - - - -] Service 5 cleanup completed.
>2018-06-25 19:49:55.853 1 ERROR oslo.messaging._drivers.impl_rabbit [req-20160f0e-7b2e-4ace-bf0c-c59adcced27b - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:49:55.854 1 ERROR oslo.messaging._drivers.impl_rabbit [req-20160f0e-7b2e-4ace-bf0c-c59adcced27b - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:49:55.855 1 ERROR oslo_service.service [req-20160f0e-7b2e-4ace-bf0c-c59adcced27b - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:49:55.855 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 19:49:55.855 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 19:49:55.855 1 ERROR oslo_service.service     service.start()
>2018-06-25 19:49:55.855 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 19:49:55.855 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 19:49:55.855 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 19:49:55.855 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 19:49:55.855 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 19:49:55.855 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 19:49:55.855 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 19:49:55.855 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 19:49:55.855 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 19:49:55.855 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 19:49:55.855 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 19:49:55.855 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 19:49:55.855 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 19:49:55.855 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 19:49:55.855 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 19:49:55.855 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 19:49:55.855 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 19:49:55.855 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 19:49:55.855 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 19:49:55.855 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 19:49:55.855 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 19:49:55.855 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 19:49:55.855 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:49:55.855 1 ERROR oslo_service.service 
>2018-06-25 19:49:55.857 1 CRITICAL cinder [req-59d9ff3b-4764-4087-9dc0-ff56b0edd501 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 19:49:55.857 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 19:49:55.857 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 19:49:55.857 1 ERROR cinder     sys.exit(main())
>2018-06-25 19:49:55.857 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 19:49:55.857 1 ERROR cinder     service.wait()
>2018-06-25 19:49:55.857 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 19:49:55.857 1 ERROR cinder     _launcher.wait()
>2018-06-25 19:49:55.857 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 19:49:55.857 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 19:49:55.857 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 19:49:55.857 1 ERROR cinder     self.services.wait()
>2018-06-25 19:49:55.857 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 19:49:55.857 1 ERROR cinder     service.wait()
>2018-06-25 19:49:55.857 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 19:49:55.857 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 19:49:55.857 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 19:49:55.857 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 19:49:55.857 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 19:49:55.857 1 ERROR cinder     post_fn = fn()
>2018-06-25 19:49:55.857 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 19:49:55.857 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 19:49:55.857 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 19:49:55.857 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 19:49:55.857 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 19:49:55.857 1 ERROR cinder 
>2018-06-25 19:49:58.517 1 WARNING cinder.scheduler.host_manager [req-bac86c04-aa50-47e9-bba6-4623f8a29599 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 19:49:58.523 1 INFO cinder.rpc [req-bac86c04-aa50-47e9-bba6-4623f8a29599 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 19:49:58.529 1 INFO cinder.rpc [req-bac86c04-aa50-47e9-bba6-4623f8a29599 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 19:49:58.540 1 INFO cinder.rpc [req-bac86c04-aa50-47e9-bba6-4623f8a29599 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 19:49:58.548 1 INFO cinder.rpc [req-bac86c04-aa50-47e9-bba6-4623f8a29599 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 19:49:58.577 1 WARNING oslo_config.cfg [req-bac86c04-aa50-47e9-bba6-4623f8a29599 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 19:49:58.579 1 WARNING oslo_config.cfg [req-bac86c04-aa50-47e9-bba6-4623f8a29599 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:49:58.580 1 WARNING oslo_config.cfg [req-bac86c04-aa50-47e9-bba6-4623f8a29599 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:49:58.580 1 WARNING oslo_config.cfg [req-bac86c04-aa50-47e9-bba6-4623f8a29599 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:49:58.585 1 WARNING oslo_config.cfg [req-bac86c04-aa50-47e9-bba6-4623f8a29599 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 19:49:58.586 1 WARNING oslo_config.cfg [req-bac86c04-aa50-47e9-bba6-4623f8a29599 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 19:49:58.589 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 19:49:58.597 1 INFO cinder.manager [req-f784cf09-1c17-44c5-9d34-439bde282762 - - - - -] Initiating service 5 cleanup
>2018-06-25 19:49:58.602 1 INFO cinder.manager [req-f784cf09-1c17-44c5-9d34-439bde282762 - - - - -] Service 5 cleanup completed.
>2018-06-25 19:52:04.489 1 ERROR oslo.messaging._drivers.impl_rabbit [req-f784cf09-1c17-44c5-9d34-439bde282762 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:52:04.491 1 ERROR oslo.messaging._drivers.impl_rabbit [req-f784cf09-1c17-44c5-9d34-439bde282762 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:52:04.491 1 ERROR oslo_service.service [req-f784cf09-1c17-44c5-9d34-439bde282762 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:52:04.491 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 19:52:04.491 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 19:52:04.491 1 ERROR oslo_service.service     service.start()
>2018-06-25 19:52:04.491 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 19:52:04.491 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 19:52:04.491 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 19:52:04.491 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 19:52:04.491 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 19:52:04.491 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 19:52:04.491 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 19:52:04.491 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 19:52:04.491 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 19:52:04.491 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 19:52:04.491 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 19:52:04.491 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 19:52:04.491 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 19:52:04.491 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 19:52:04.491 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 19:52:04.491 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 19:52:04.491 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 19:52:04.491 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 19:52:04.491 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 19:52:04.491 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 19:52:04.491 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 19:52:04.491 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 19:52:04.491 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:52:04.491 1 ERROR oslo_service.service 
>2018-06-25 19:52:04.494 1 CRITICAL cinder [req-bac86c04-aa50-47e9-bba6-4623f8a29599 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 19:52:04.494 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 19:52:04.494 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 19:52:04.494 1 ERROR cinder     sys.exit(main())
>2018-06-25 19:52:04.494 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 19:52:04.494 1 ERROR cinder     service.wait()
>2018-06-25 19:52:04.494 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 19:52:04.494 1 ERROR cinder     _launcher.wait()
>2018-06-25 19:52:04.494 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 19:52:04.494 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 19:52:04.494 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 19:52:04.494 1 ERROR cinder     self.services.wait()
>2018-06-25 19:52:04.494 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 19:52:04.494 1 ERROR cinder     service.wait()
>2018-06-25 19:52:04.494 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 19:52:04.494 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 19:52:04.494 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 19:52:04.494 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 19:52:04.494 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 19:52:04.494 1 ERROR cinder     post_fn = fn()
>2018-06-25 19:52:04.494 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 19:52:04.494 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 19:52:04.494 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 19:52:04.494 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 19:52:04.494 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 19:52:04.494 1 ERROR cinder 
>2018-06-25 19:52:07.197 1 WARNING cinder.scheduler.host_manager [req-bb1dcbee-0254-47c0-8727-a85106cac293 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 19:52:07.203 1 INFO cinder.rpc [req-bb1dcbee-0254-47c0-8727-a85106cac293 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 19:52:07.210 1 INFO cinder.rpc [req-bb1dcbee-0254-47c0-8727-a85106cac293 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 19:52:07.225 1 INFO cinder.rpc [req-bb1dcbee-0254-47c0-8727-a85106cac293 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 19:52:07.232 1 INFO cinder.rpc [req-bb1dcbee-0254-47c0-8727-a85106cac293 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 19:52:07.259 1 WARNING oslo_config.cfg [req-bb1dcbee-0254-47c0-8727-a85106cac293 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 19:52:07.262 1 WARNING oslo_config.cfg [req-bb1dcbee-0254-47c0-8727-a85106cac293 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:52:07.263 1 WARNING oslo_config.cfg [req-bb1dcbee-0254-47c0-8727-a85106cac293 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:52:07.263 1 WARNING oslo_config.cfg [req-bb1dcbee-0254-47c0-8727-a85106cac293 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:52:07.270 1 WARNING oslo_config.cfg [req-bb1dcbee-0254-47c0-8727-a85106cac293 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 19:52:07.272 1 WARNING oslo_config.cfg [req-bb1dcbee-0254-47c0-8727-a85106cac293 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 19:52:07.274 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 19:52:07.282 1 INFO cinder.manager [req-44b94ce2-1f09-4c62-91c3-c9691473a83c - - - - -] Initiating service 5 cleanup
>2018-06-25 19:52:07.287 1 INFO cinder.manager [req-44b94ce2-1f09-4c62-91c3-c9691473a83c - - - - -] Service 5 cleanup completed.
>2018-06-25 19:54:13.427 1 ERROR oslo.messaging._drivers.impl_rabbit [req-44b94ce2-1f09-4c62-91c3-c9691473a83c - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:54:13.431 1 ERROR oslo.messaging._drivers.impl_rabbit [req-44b94ce2-1f09-4c62-91c3-c9691473a83c - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:54:13.431 1 ERROR oslo_service.service [req-44b94ce2-1f09-4c62-91c3-c9691473a83c - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:54:13.431 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 19:54:13.431 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 19:54:13.431 1 ERROR oslo_service.service     service.start()
>2018-06-25 19:54:13.431 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 19:54:13.431 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 19:54:13.431 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 19:54:13.431 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 19:54:13.431 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 19:54:13.431 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 19:54:13.431 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 19:54:13.431 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 19:54:13.431 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 19:54:13.431 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 19:54:13.431 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 19:54:13.431 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 19:54:13.431 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 19:54:13.431 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 19:54:13.431 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 19:54:13.431 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 19:54:13.431 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 19:54:13.431 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 19:54:13.431 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 19:54:13.431 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 19:54:13.431 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 19:54:13.431 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 19:54:13.431 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:54:13.431 1 ERROR oslo_service.service 
>2018-06-25 19:54:13.436 1 CRITICAL cinder [req-bb1dcbee-0254-47c0-8727-a85106cac293 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 19:54:13.436 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 19:54:13.436 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 19:54:13.436 1 ERROR cinder     sys.exit(main())
>2018-06-25 19:54:13.436 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 19:54:13.436 1 ERROR cinder     service.wait()
>2018-06-25 19:54:13.436 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 19:54:13.436 1 ERROR cinder     _launcher.wait()
>2018-06-25 19:54:13.436 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 19:54:13.436 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 19:54:13.436 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 19:54:13.436 1 ERROR cinder     self.services.wait()
>2018-06-25 19:54:13.436 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 19:54:13.436 1 ERROR cinder     service.wait()
>2018-06-25 19:54:13.436 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 19:54:13.436 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 19:54:13.436 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 19:54:13.436 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 19:54:13.436 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 19:54:13.436 1 ERROR cinder     post_fn = fn()
>2018-06-25 19:54:13.436 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 19:54:13.436 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 19:54:13.436 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 19:54:13.436 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 19:54:13.436 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 19:54:13.436 1 ERROR cinder 
>2018-06-25 19:54:16.215 1 WARNING cinder.scheduler.host_manager [req-6bc121b7-78f2-48d6-8ca3-9f93c1fd849c - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 19:54:16.225 1 INFO cinder.rpc [req-6bc121b7-78f2-48d6-8ca3-9f93c1fd849c - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 19:54:16.235 1 INFO cinder.rpc [req-6bc121b7-78f2-48d6-8ca3-9f93c1fd849c - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 19:54:16.251 1 INFO cinder.rpc [req-6bc121b7-78f2-48d6-8ca3-9f93c1fd849c - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 19:54:16.259 1 INFO cinder.rpc [req-6bc121b7-78f2-48d6-8ca3-9f93c1fd849c - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 19:54:16.289 1 WARNING oslo_config.cfg [req-6bc121b7-78f2-48d6-8ca3-9f93c1fd849c - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 19:54:16.292 1 WARNING oslo_config.cfg [req-6bc121b7-78f2-48d6-8ca3-9f93c1fd849c - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:54:16.293 1 WARNING oslo_config.cfg [req-6bc121b7-78f2-48d6-8ca3-9f93c1fd849c - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:54:16.294 1 WARNING oslo_config.cfg [req-6bc121b7-78f2-48d6-8ca3-9f93c1fd849c - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:54:16.301 1 WARNING oslo_config.cfg [req-6bc121b7-78f2-48d6-8ca3-9f93c1fd849c - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 19:54:16.302 1 WARNING oslo_config.cfg [req-6bc121b7-78f2-48d6-8ca3-9f93c1fd849c - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 19:54:16.305 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 19:54:16.313 1 INFO cinder.manager [req-163a8c83-fff5-4389-a761-7b000dec7191 - - - - -] Initiating service 5 cleanup
>2018-06-25 19:54:16.318 1 INFO cinder.manager [req-163a8c83-fff5-4389-a761-7b000dec7191 - - - - -] Service 5 cleanup completed.
>2018-06-25 19:56:28.612 1 ERROR oslo.messaging._drivers.impl_rabbit [req-163a8c83-fff5-4389-a761-7b000dec7191 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:56:28.614 1 ERROR oslo.messaging._drivers.impl_rabbit [req-163a8c83-fff5-4389-a761-7b000dec7191 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:56:28.615 1 ERROR oslo_service.service [req-163a8c83-fff5-4389-a761-7b000dec7191 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:56:28.615 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 19:56:28.615 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 19:56:28.615 1 ERROR oslo_service.service     service.start()
>2018-06-25 19:56:28.615 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 19:56:28.615 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 19:56:28.615 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 19:56:28.615 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 19:56:28.615 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 19:56:28.615 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 19:56:28.615 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 19:56:28.615 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 19:56:28.615 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 19:56:28.615 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 19:56:28.615 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 19:56:28.615 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 19:56:28.615 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 19:56:28.615 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 19:56:28.615 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 19:56:28.615 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 19:56:28.615 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 19:56:28.615 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 19:56:28.615 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 19:56:28.615 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 19:56:28.615 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 19:56:28.615 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 19:56:28.615 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:56:28.615 1 ERROR oslo_service.service 
>2018-06-25 19:56:28.618 1 CRITICAL cinder [req-6bc121b7-78f2-48d6-8ca3-9f93c1fd849c - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 19:56:28.618 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 19:56:28.618 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 19:56:28.618 1 ERROR cinder     sys.exit(main())
>2018-06-25 19:56:28.618 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 19:56:28.618 1 ERROR cinder     service.wait()
>2018-06-25 19:56:28.618 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 19:56:28.618 1 ERROR cinder     _launcher.wait()
>2018-06-25 19:56:28.618 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 19:56:28.618 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 19:56:28.618 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 19:56:28.618 1 ERROR cinder     self.services.wait()
>2018-06-25 19:56:28.618 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 19:56:28.618 1 ERROR cinder     service.wait()
>2018-06-25 19:56:28.618 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 19:56:28.618 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 19:56:28.618 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 19:56:28.618 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 19:56:28.618 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 19:56:28.618 1 ERROR cinder     post_fn = fn()
>2018-06-25 19:56:28.618 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 19:56:28.618 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 19:56:28.618 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 19:56:28.618 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 19:56:28.618 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 19:56:28.618 1 ERROR cinder 
>2018-06-25 19:56:31.365 1 WARNING cinder.scheduler.host_manager [req-08a34f4a-1732-46b7-a9ce-a3cc3443adb2 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 19:56:31.374 1 INFO cinder.rpc [req-08a34f4a-1732-46b7-a9ce-a3cc3443adb2 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 19:56:31.379 1 INFO cinder.rpc [req-08a34f4a-1732-46b7-a9ce-a3cc3443adb2 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 19:56:31.392 1 INFO cinder.rpc [req-08a34f4a-1732-46b7-a9ce-a3cc3443adb2 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 19:56:31.398 1 INFO cinder.rpc [req-08a34f4a-1732-46b7-a9ce-a3cc3443adb2 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 19:56:31.422 1 WARNING oslo_config.cfg [req-08a34f4a-1732-46b7-a9ce-a3cc3443adb2 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 19:56:31.425 1 WARNING oslo_config.cfg [req-08a34f4a-1732-46b7-a9ce-a3cc3443adb2 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:56:31.425 1 WARNING oslo_config.cfg [req-08a34f4a-1732-46b7-a9ce-a3cc3443adb2 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:56:31.426 1 WARNING oslo_config.cfg [req-08a34f4a-1732-46b7-a9ce-a3cc3443adb2 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:56:31.431 1 WARNING oslo_config.cfg [req-08a34f4a-1732-46b7-a9ce-a3cc3443adb2 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 19:56:31.433 1 WARNING oslo_config.cfg [req-08a34f4a-1732-46b7-a9ce-a3cc3443adb2 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 19:56:31.435 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 19:56:31.442 1 INFO cinder.manager [req-0d1f9302-8092-45a2-b9a1-a83d7fe29e1a - - - - -] Initiating service 5 cleanup
>2018-06-25 19:56:31.446 1 INFO cinder.manager [req-0d1f9302-8092-45a2-b9a1-a83d7fe29e1a - - - - -] Service 5 cleanup completed.
>2018-06-25 19:58:37.601 1 ERROR oslo.messaging._drivers.impl_rabbit [req-0d1f9302-8092-45a2-b9a1-a83d7fe29e1a - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:58:37.604 1 ERROR oslo.messaging._drivers.impl_rabbit [req-0d1f9302-8092-45a2-b9a1-a83d7fe29e1a - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:58:37.605 1 ERROR oslo_service.service [req-0d1f9302-8092-45a2-b9a1-a83d7fe29e1a - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:58:37.605 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 19:58:37.605 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 19:58:37.605 1 ERROR oslo_service.service     service.start()
>2018-06-25 19:58:37.605 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 19:58:37.605 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 19:58:37.605 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 19:58:37.605 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 19:58:37.605 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 19:58:37.605 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 19:58:37.605 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 19:58:37.605 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 19:58:37.605 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 19:58:37.605 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 19:58:37.605 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 19:58:37.605 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 19:58:37.605 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 19:58:37.605 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 19:58:37.605 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 19:58:37.605 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 19:58:37.605 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 19:58:37.605 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 19:58:37.605 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 19:58:37.605 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 19:58:37.605 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 19:58:37.605 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 19:58:37.605 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 19:58:37.605 1 ERROR oslo_service.service 
>2018-06-25 19:58:37.609 1 CRITICAL cinder [req-08a34f4a-1732-46b7-a9ce-a3cc3443adb2 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 19:58:37.609 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 19:58:37.609 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 19:58:37.609 1 ERROR cinder     sys.exit(main())
>2018-06-25 19:58:37.609 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 19:58:37.609 1 ERROR cinder     service.wait()
>2018-06-25 19:58:37.609 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 19:58:37.609 1 ERROR cinder     _launcher.wait()
>2018-06-25 19:58:37.609 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 19:58:37.609 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 19:58:37.609 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 19:58:37.609 1 ERROR cinder     self.services.wait()
>2018-06-25 19:58:37.609 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 19:58:37.609 1 ERROR cinder     service.wait()
>2018-06-25 19:58:37.609 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 19:58:37.609 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 19:58:37.609 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 19:58:37.609 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 19:58:37.609 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 19:58:37.609 1 ERROR cinder     post_fn = fn()
>2018-06-25 19:58:37.609 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 19:58:37.609 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 19:58:37.609 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 19:58:37.609 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 19:58:37.609 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 19:58:37.609 1 ERROR cinder 
>2018-06-25 19:58:40.325 1 WARNING cinder.scheduler.host_manager [req-e4de949f-03a5-49e9-addd-cb58afe13b04 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 19:58:40.331 1 INFO cinder.rpc [req-e4de949f-03a5-49e9-addd-cb58afe13b04 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 19:58:40.338 1 INFO cinder.rpc [req-e4de949f-03a5-49e9-addd-cb58afe13b04 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 19:58:40.351 1 INFO cinder.rpc [req-e4de949f-03a5-49e9-addd-cb58afe13b04 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 19:58:40.357 1 INFO cinder.rpc [req-e4de949f-03a5-49e9-addd-cb58afe13b04 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 19:58:40.388 1 WARNING oslo_config.cfg [req-e4de949f-03a5-49e9-addd-cb58afe13b04 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 19:58:40.390 1 WARNING oslo_config.cfg [req-e4de949f-03a5-49e9-addd-cb58afe13b04 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:58:40.391 1 WARNING oslo_config.cfg [req-e4de949f-03a5-49e9-addd-cb58afe13b04 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:58:40.391 1 WARNING oslo_config.cfg [req-e4de949f-03a5-49e9-addd-cb58afe13b04 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 19:58:40.396 1 WARNING oslo_config.cfg [req-e4de949f-03a5-49e9-addd-cb58afe13b04 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 19:58:40.397 1 WARNING oslo_config.cfg [req-e4de949f-03a5-49e9-addd-cb58afe13b04 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 19:58:40.400 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 19:58:40.408 1 INFO cinder.manager [req-180d2a95-a296-4fe3-aa7b-9430e4b3f458 - - - - -] Initiating service 5 cleanup
>2018-06-25 19:58:40.416 1 INFO cinder.manager [req-180d2a95-a296-4fe3-aa7b-9430e4b3f458 - - - - -] Service 5 cleanup completed.
>2018-06-25 20:00:46.384 1 ERROR oslo.messaging._drivers.impl_rabbit [req-180d2a95-a296-4fe3-aa7b-9430e4b3f458 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:00:46.386 1 ERROR oslo.messaging._drivers.impl_rabbit [req-180d2a95-a296-4fe3-aa7b-9430e4b3f458 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:00:46.386 1 ERROR oslo_service.service [req-180d2a95-a296-4fe3-aa7b-9430e4b3f458 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:00:46.386 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 20:00:46.386 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 20:00:46.386 1 ERROR oslo_service.service     service.start()
>2018-06-25 20:00:46.386 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 20:00:46.386 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 20:00:46.386 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 20:00:46.386 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 20:00:46.386 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 20:00:46.386 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 20:00:46.386 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 20:00:46.386 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 20:00:46.386 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 20:00:46.386 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 20:00:46.386 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 20:00:46.386 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 20:00:46.386 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 20:00:46.386 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 20:00:46.386 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 20:00:46.386 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 20:00:46.386 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 20:00:46.386 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 20:00:46.386 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 20:00:46.386 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 20:00:46.386 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 20:00:46.386 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 20:00:46.386 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:00:46.386 1 ERROR oslo_service.service 
>2018-06-25 20:00:46.390 1 CRITICAL cinder [req-e4de949f-03a5-49e9-addd-cb58afe13b04 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 20:00:46.390 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 20:00:46.390 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 20:00:46.390 1 ERROR cinder     sys.exit(main())
>2018-06-25 20:00:46.390 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 20:00:46.390 1 ERROR cinder     service.wait()
>2018-06-25 20:00:46.390 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 20:00:46.390 1 ERROR cinder     _launcher.wait()
>2018-06-25 20:00:46.390 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 20:00:46.390 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 20:00:46.390 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 20:00:46.390 1 ERROR cinder     self.services.wait()
>2018-06-25 20:00:46.390 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 20:00:46.390 1 ERROR cinder     service.wait()
>2018-06-25 20:00:46.390 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 20:00:46.390 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 20:00:46.390 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 20:00:46.390 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 20:00:46.390 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 20:00:46.390 1 ERROR cinder     post_fn = fn()
>2018-06-25 20:00:46.390 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 20:00:46.390 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 20:00:46.390 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 20:00:46.390 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 20:00:46.390 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 20:00:46.390 1 ERROR cinder 
>2018-06-25 20:00:49.182 1 WARNING cinder.scheduler.host_manager [req-1829a398-b378-4fcf-b029-9f7d61226c8b - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 20:00:49.188 1 INFO cinder.rpc [req-1829a398-b378-4fcf-b029-9f7d61226c8b - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 20:00:49.195 1 INFO cinder.rpc [req-1829a398-b378-4fcf-b029-9f7d61226c8b - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 20:00:49.221 1 INFO cinder.rpc [req-1829a398-b378-4fcf-b029-9f7d61226c8b - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 20:00:49.231 1 INFO cinder.rpc [req-1829a398-b378-4fcf-b029-9f7d61226c8b - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 20:00:49.261 1 WARNING oslo_config.cfg [req-1829a398-b378-4fcf-b029-9f7d61226c8b - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 20:00:49.264 1 WARNING oslo_config.cfg [req-1829a398-b378-4fcf-b029-9f7d61226c8b - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:00:49.264 1 WARNING oslo_config.cfg [req-1829a398-b378-4fcf-b029-9f7d61226c8b - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:00:49.265 1 WARNING oslo_config.cfg [req-1829a398-b378-4fcf-b029-9f7d61226c8b - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:00:49.270 1 WARNING oslo_config.cfg [req-1829a398-b378-4fcf-b029-9f7d61226c8b - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 20:00:49.271 1 WARNING oslo_config.cfg [req-1829a398-b378-4fcf-b029-9f7d61226c8b - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 20:00:49.273 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 20:00:49.280 1 INFO cinder.manager [req-c5e5a193-d173-43dd-9793-0b2c343b7f2c - - - - -] Initiating service 5 cleanup
>2018-06-25 20:00:49.285 1 INFO cinder.manager [req-c5e5a193-d173-43dd-9793-0b2c343b7f2c - - - - -] Service 5 cleanup completed.
>2018-06-25 20:03:01.702 1 ERROR oslo.messaging._drivers.impl_rabbit [req-c5e5a193-d173-43dd-9793-0b2c343b7f2c - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:03:01.704 1 ERROR oslo.messaging._drivers.impl_rabbit [req-c5e5a193-d173-43dd-9793-0b2c343b7f2c - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:03:01.704 1 ERROR oslo_service.service [req-c5e5a193-d173-43dd-9793-0b2c343b7f2c - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:03:01.704 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 20:03:01.704 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 20:03:01.704 1 ERROR oslo_service.service     service.start()
>2018-06-25 20:03:01.704 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 20:03:01.704 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 20:03:01.704 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 20:03:01.704 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 20:03:01.704 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 20:03:01.704 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 20:03:01.704 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 20:03:01.704 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 20:03:01.704 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 20:03:01.704 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 20:03:01.704 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 20:03:01.704 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 20:03:01.704 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 20:03:01.704 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 20:03:01.704 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 20:03:01.704 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 20:03:01.704 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 20:03:01.704 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 20:03:01.704 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 20:03:01.704 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 20:03:01.704 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 20:03:01.704 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 20:03:01.704 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:03:01.704 1 ERROR oslo_service.service 
>2018-06-25 20:03:01.707 1 CRITICAL cinder [req-1829a398-b378-4fcf-b029-9f7d61226c8b - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 20:03:01.707 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 20:03:01.707 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 20:03:01.707 1 ERROR cinder     sys.exit(main())
>2018-06-25 20:03:01.707 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 20:03:01.707 1 ERROR cinder     service.wait()
>2018-06-25 20:03:01.707 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 20:03:01.707 1 ERROR cinder     _launcher.wait()
>2018-06-25 20:03:01.707 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 20:03:01.707 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 20:03:01.707 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 20:03:01.707 1 ERROR cinder     self.services.wait()
>2018-06-25 20:03:01.707 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 20:03:01.707 1 ERROR cinder     service.wait()
>2018-06-25 20:03:01.707 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 20:03:01.707 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 20:03:01.707 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 20:03:01.707 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 20:03:01.707 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 20:03:01.707 1 ERROR cinder     post_fn = fn()
>2018-06-25 20:03:01.707 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 20:03:01.707 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 20:03:01.707 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 20:03:01.707 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 20:03:01.707 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 20:03:01.707 1 ERROR cinder 
>2018-06-25 20:03:04.418 1 WARNING cinder.scheduler.host_manager [req-a1c723c0-2b39-4568-ae20-07c2ce62649e - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 20:03:04.427 1 INFO cinder.rpc [req-a1c723c0-2b39-4568-ae20-07c2ce62649e - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 20:03:04.433 1 INFO cinder.rpc [req-a1c723c0-2b39-4568-ae20-07c2ce62649e - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 20:03:04.446 1 INFO cinder.rpc [req-a1c723c0-2b39-4568-ae20-07c2ce62649e - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 20:03:04.452 1 INFO cinder.rpc [req-a1c723c0-2b39-4568-ae20-07c2ce62649e - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 20:03:04.482 1 WARNING oslo_config.cfg [req-a1c723c0-2b39-4568-ae20-07c2ce62649e - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 20:03:04.485 1 WARNING oslo_config.cfg [req-a1c723c0-2b39-4568-ae20-07c2ce62649e - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:03:04.486 1 WARNING oslo_config.cfg [req-a1c723c0-2b39-4568-ae20-07c2ce62649e - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:03:04.486 1 WARNING oslo_config.cfg [req-a1c723c0-2b39-4568-ae20-07c2ce62649e - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:03:04.492 1 WARNING oslo_config.cfg [req-a1c723c0-2b39-4568-ae20-07c2ce62649e - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 20:03:04.493 1 WARNING oslo_config.cfg [req-a1c723c0-2b39-4568-ae20-07c2ce62649e - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 20:03:04.496 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 20:03:04.504 1 INFO cinder.manager [req-544af5e7-b2ef-44ea-98d0-88782c3f9d8d - - - - -] Initiating service 5 cleanup
>2018-06-25 20:03:04.509 1 INFO cinder.manager [req-544af5e7-b2ef-44ea-98d0-88782c3f9d8d - - - - -] Service 5 cleanup completed.
>2018-06-25 20:05:08.917 1 ERROR oslo.messaging._drivers.impl_rabbit [req-544af5e7-b2ef-44ea-98d0-88782c3f9d8d - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:05:08.919 1 ERROR oslo.messaging._drivers.impl_rabbit [req-544af5e7-b2ef-44ea-98d0-88782c3f9d8d - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:05:08.920 1 ERROR oslo_service.service [req-544af5e7-b2ef-44ea-98d0-88782c3f9d8d - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:05:08.920 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 20:05:08.920 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 20:05:08.920 1 ERROR oslo_service.service     service.start()
>2018-06-25 20:05:08.920 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 20:05:08.920 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 20:05:08.920 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 20:05:08.920 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 20:05:08.920 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 20:05:08.920 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 20:05:08.920 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 20:05:08.920 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 20:05:08.920 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 20:05:08.920 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 20:05:08.920 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 20:05:08.920 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 20:05:08.920 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 20:05:08.920 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 20:05:08.920 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 20:05:08.920 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 20:05:08.920 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 20:05:08.920 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 20:05:08.920 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 20:05:08.920 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 20:05:08.920 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 20:05:08.920 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 20:05:08.920 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:05:08.920 1 ERROR oslo_service.service 
>2018-06-25 20:05:08.923 1 CRITICAL cinder [req-a1c723c0-2b39-4568-ae20-07c2ce62649e - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 20:05:08.923 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 20:05:08.923 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 20:05:08.923 1 ERROR cinder     sys.exit(main())
>2018-06-25 20:05:08.923 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 20:05:08.923 1 ERROR cinder     service.wait()
>2018-06-25 20:05:08.923 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 20:05:08.923 1 ERROR cinder     _launcher.wait()
>2018-06-25 20:05:08.923 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 20:05:08.923 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 20:05:08.923 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 20:05:08.923 1 ERROR cinder     self.services.wait()
>2018-06-25 20:05:08.923 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 20:05:08.923 1 ERROR cinder     service.wait()
>2018-06-25 20:05:08.923 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 20:05:08.923 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 20:05:08.923 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 20:05:08.923 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 20:05:08.923 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 20:05:08.923 1 ERROR cinder     post_fn = fn()
>2018-06-25 20:05:08.923 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 20:05:08.923 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 20:05:08.923 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 20:05:08.923 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 20:05:08.923 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 20:05:08.923 1 ERROR cinder 
>2018-06-25 20:05:11.638 1 WARNING cinder.scheduler.host_manager [req-918d170e-0b3c-493f-9a6c-79f439180857 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 20:05:11.645 1 INFO cinder.rpc [req-918d170e-0b3c-493f-9a6c-79f439180857 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 20:05:11.651 1 INFO cinder.rpc [req-918d170e-0b3c-493f-9a6c-79f439180857 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 20:05:11.664 1 INFO cinder.rpc [req-918d170e-0b3c-493f-9a6c-79f439180857 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 20:05:11.671 1 INFO cinder.rpc [req-918d170e-0b3c-493f-9a6c-79f439180857 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 20:05:11.695 1 WARNING oslo_config.cfg [req-918d170e-0b3c-493f-9a6c-79f439180857 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 20:05:11.698 1 WARNING oslo_config.cfg [req-918d170e-0b3c-493f-9a6c-79f439180857 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:05:11.698 1 WARNING oslo_config.cfg [req-918d170e-0b3c-493f-9a6c-79f439180857 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:05:11.699 1 WARNING oslo_config.cfg [req-918d170e-0b3c-493f-9a6c-79f439180857 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:05:11.707 1 WARNING oslo_config.cfg [req-918d170e-0b3c-493f-9a6c-79f439180857 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 20:05:11.709 1 WARNING oslo_config.cfg [req-918d170e-0b3c-493f-9a6c-79f439180857 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 20:05:11.713 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 20:05:11.721 1 INFO cinder.manager [req-e8c13524-d341-458c-8d98-3761238f4dd4 - - - - -] Initiating service 5 cleanup
>2018-06-25 20:05:11.726 1 INFO cinder.manager [req-e8c13524-d341-458c-8d98-3761238f4dd4 - - - - -] Service 5 cleanup completed.
>2018-06-25 20:07:16.118 1 ERROR oslo.messaging._drivers.impl_rabbit [req-e8c13524-d341-458c-8d98-3761238f4dd4 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:07:16.120 1 ERROR oslo.messaging._drivers.impl_rabbit [req-e8c13524-d341-458c-8d98-3761238f4dd4 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:07:16.120 1 ERROR oslo_service.service [req-e8c13524-d341-458c-8d98-3761238f4dd4 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:07:16.120 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 20:07:16.120 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 20:07:16.120 1 ERROR oslo_service.service     service.start()
>2018-06-25 20:07:16.120 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 20:07:16.120 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 20:07:16.120 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 20:07:16.120 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 20:07:16.120 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 20:07:16.120 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 20:07:16.120 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 20:07:16.120 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 20:07:16.120 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 20:07:16.120 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 20:07:16.120 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 20:07:16.120 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 20:07:16.120 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 20:07:16.120 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 20:07:16.120 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 20:07:16.120 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 20:07:16.120 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 20:07:16.120 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 20:07:16.120 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 20:07:16.120 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 20:07:16.120 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 20:07:16.120 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 20:07:16.120 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:07:16.120 1 ERROR oslo_service.service 
>2018-06-25 20:07:16.123 1 CRITICAL cinder [req-918d170e-0b3c-493f-9a6c-79f439180857 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 20:07:16.123 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 20:07:16.123 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 20:07:16.123 1 ERROR cinder     sys.exit(main())
>2018-06-25 20:07:16.123 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 20:07:16.123 1 ERROR cinder     service.wait()
>2018-06-25 20:07:16.123 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 20:07:16.123 1 ERROR cinder     _launcher.wait()
>2018-06-25 20:07:16.123 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 20:07:16.123 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 20:07:16.123 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 20:07:16.123 1 ERROR cinder     self.services.wait()
>2018-06-25 20:07:16.123 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 20:07:16.123 1 ERROR cinder     service.wait()
>2018-06-25 20:07:16.123 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 20:07:16.123 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 20:07:16.123 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 20:07:16.123 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 20:07:16.123 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 20:07:16.123 1 ERROR cinder     post_fn = fn()
>2018-06-25 20:07:16.123 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 20:07:16.123 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 20:07:16.123 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 20:07:16.123 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 20:07:16.123 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 20:07:16.123 1 ERROR cinder 
>2018-06-25 20:07:18.810 1 WARNING cinder.scheduler.host_manager [req-77212722-2879-431f-97ad-65d520ec9ec7 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 20:07:18.816 1 INFO cinder.rpc [req-77212722-2879-431f-97ad-65d520ec9ec7 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 20:07:18.829 1 INFO cinder.rpc [req-77212722-2879-431f-97ad-65d520ec9ec7 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 20:07:18.843 1 INFO cinder.rpc [req-77212722-2879-431f-97ad-65d520ec9ec7 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 20:07:18.850 1 INFO cinder.rpc [req-77212722-2879-431f-97ad-65d520ec9ec7 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 20:07:18.896 1 WARNING oslo_config.cfg [req-77212722-2879-431f-97ad-65d520ec9ec7 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 20:07:18.898 1 WARNING oslo_config.cfg [req-77212722-2879-431f-97ad-65d520ec9ec7 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:07:18.899 1 WARNING oslo_config.cfg [req-77212722-2879-431f-97ad-65d520ec9ec7 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:07:18.899 1 WARNING oslo_config.cfg [req-77212722-2879-431f-97ad-65d520ec9ec7 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:07:18.904 1 WARNING oslo_config.cfg [req-77212722-2879-431f-97ad-65d520ec9ec7 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 20:07:18.906 1 WARNING oslo_config.cfg [req-77212722-2879-431f-97ad-65d520ec9ec7 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 20:07:18.909 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 20:07:18.921 1 INFO cinder.manager [req-d1a359ac-e149-4a0a-b5df-ff1095e2836f - - - - -] Initiating service 5 cleanup
>2018-06-25 20:07:18.932 1 INFO cinder.manager [req-d1a359ac-e149-4a0a-b5df-ff1095e2836f - - - - -] Service 5 cleanup completed.
>2018-06-25 20:09:25.052 1 ERROR oslo.messaging._drivers.impl_rabbit [req-d1a359ac-e149-4a0a-b5df-ff1095e2836f - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:09:25.054 1 ERROR oslo.messaging._drivers.impl_rabbit [req-d1a359ac-e149-4a0a-b5df-ff1095e2836f - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:09:25.055 1 ERROR oslo_service.service [req-d1a359ac-e149-4a0a-b5df-ff1095e2836f - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:09:25.055 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 20:09:25.055 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 20:09:25.055 1 ERROR oslo_service.service     service.start()
>2018-06-25 20:09:25.055 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 20:09:25.055 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 20:09:25.055 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 20:09:25.055 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 20:09:25.055 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 20:09:25.055 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 20:09:25.055 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 20:09:25.055 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 20:09:25.055 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 20:09:25.055 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 20:09:25.055 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 20:09:25.055 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 20:09:25.055 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 20:09:25.055 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 20:09:25.055 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 20:09:25.055 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 20:09:25.055 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 20:09:25.055 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 20:09:25.055 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 20:09:25.055 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 20:09:25.055 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 20:09:25.055 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 20:09:25.055 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:09:25.055 1 ERROR oslo_service.service 
>2018-06-25 20:09:25.058 1 CRITICAL cinder [req-77212722-2879-431f-97ad-65d520ec9ec7 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 20:09:25.058 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 20:09:25.058 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 20:09:25.058 1 ERROR cinder     sys.exit(main())
>2018-06-25 20:09:25.058 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 20:09:25.058 1 ERROR cinder     service.wait()
>2018-06-25 20:09:25.058 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 20:09:25.058 1 ERROR cinder     _launcher.wait()
>2018-06-25 20:09:25.058 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 20:09:25.058 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 20:09:25.058 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 20:09:25.058 1 ERROR cinder     self.services.wait()
>2018-06-25 20:09:25.058 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 20:09:25.058 1 ERROR cinder     service.wait()
>2018-06-25 20:09:25.058 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 20:09:25.058 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 20:09:25.058 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 20:09:25.058 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 20:09:25.058 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 20:09:25.058 1 ERROR cinder     post_fn = fn()
>2018-06-25 20:09:25.058 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 20:09:25.058 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 20:09:25.058 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 20:09:25.058 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 20:09:25.058 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 20:09:25.058 1 ERROR cinder 
>2018-06-25 20:09:27.839 1 WARNING cinder.scheduler.host_manager [req-671f78cc-fff0-4087-8384-fd2270dc859b - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 20:09:27.845 1 INFO cinder.rpc [req-671f78cc-fff0-4087-8384-fd2270dc859b - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 20:09:27.858 1 INFO cinder.rpc [req-671f78cc-fff0-4087-8384-fd2270dc859b - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 20:09:27.874 1 INFO cinder.rpc [req-671f78cc-fff0-4087-8384-fd2270dc859b - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 20:09:27.881 1 INFO cinder.rpc [req-671f78cc-fff0-4087-8384-fd2270dc859b - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 20:09:27.908 1 WARNING oslo_config.cfg [req-671f78cc-fff0-4087-8384-fd2270dc859b - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 20:09:27.910 1 WARNING oslo_config.cfg [req-671f78cc-fff0-4087-8384-fd2270dc859b - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:09:27.911 1 WARNING oslo_config.cfg [req-671f78cc-fff0-4087-8384-fd2270dc859b - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:09:27.912 1 WARNING oslo_config.cfg [req-671f78cc-fff0-4087-8384-fd2270dc859b - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:09:27.917 1 WARNING oslo_config.cfg [req-671f78cc-fff0-4087-8384-fd2270dc859b - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 20:09:27.918 1 WARNING oslo_config.cfg [req-671f78cc-fff0-4087-8384-fd2270dc859b - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 20:09:27.921 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 20:09:27.928 1 INFO cinder.manager [req-2ae41bc3-68ea-4f43-8e8a-75595f340ba6 - - - - -] Initiating service 5 cleanup
>2018-06-25 20:09:27.933 1 INFO cinder.manager [req-2ae41bc3-68ea-4f43-8e8a-75595f340ba6 - - - - -] Service 5 cleanup completed.
>2018-06-25 20:11:34.184 1 ERROR oslo.messaging._drivers.impl_rabbit [req-2ae41bc3-68ea-4f43-8e8a-75595f340ba6 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:11:34.186 1 ERROR oslo.messaging._drivers.impl_rabbit [req-2ae41bc3-68ea-4f43-8e8a-75595f340ba6 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:11:34.186 1 ERROR oslo_service.service [req-2ae41bc3-68ea-4f43-8e8a-75595f340ba6 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:11:34.186 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 20:11:34.186 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 20:11:34.186 1 ERROR oslo_service.service     service.start()
>2018-06-25 20:11:34.186 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 20:11:34.186 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 20:11:34.186 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 20:11:34.186 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 20:11:34.186 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 20:11:34.186 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 20:11:34.186 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 20:11:34.186 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 20:11:34.186 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 20:11:34.186 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 20:11:34.186 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 20:11:34.186 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 20:11:34.186 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 20:11:34.186 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 20:11:34.186 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 20:11:34.186 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 20:11:34.186 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 20:11:34.186 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 20:11:34.186 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 20:11:34.186 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 20:11:34.186 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 20:11:34.186 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 20:11:34.186 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:11:34.186 1 ERROR oslo_service.service 
>2018-06-25 20:11:34.189 1 CRITICAL cinder [req-671f78cc-fff0-4087-8384-fd2270dc859b - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 20:11:34.189 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 20:11:34.189 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 20:11:34.189 1 ERROR cinder     sys.exit(main())
>2018-06-25 20:11:34.189 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 20:11:34.189 1 ERROR cinder     service.wait()
>2018-06-25 20:11:34.189 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 20:11:34.189 1 ERROR cinder     _launcher.wait()
>2018-06-25 20:11:34.189 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 20:11:34.189 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 20:11:34.189 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 20:11:34.189 1 ERROR cinder     self.services.wait()
>2018-06-25 20:11:34.189 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 20:11:34.189 1 ERROR cinder     service.wait()
>2018-06-25 20:11:34.189 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 20:11:34.189 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 20:11:34.189 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 20:11:34.189 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 20:11:34.189 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 20:11:34.189 1 ERROR cinder     post_fn = fn()
>2018-06-25 20:11:34.189 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 20:11:34.189 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 20:11:34.189 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 20:11:34.189 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 20:11:34.189 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 20:11:34.189 1 ERROR cinder 
>2018-06-25 20:11:36.747 1 WARNING cinder.scheduler.host_manager [req-59df5550-7bfd-4def-adcb-4a9aff35d1ff - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 20:11:36.752 1 INFO cinder.rpc [req-59df5550-7bfd-4def-adcb-4a9aff35d1ff - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 20:11:36.757 1 INFO cinder.rpc [req-59df5550-7bfd-4def-adcb-4a9aff35d1ff - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 20:11:36.771 1 INFO cinder.rpc [req-59df5550-7bfd-4def-adcb-4a9aff35d1ff - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 20:11:36.777 1 INFO cinder.rpc [req-59df5550-7bfd-4def-adcb-4a9aff35d1ff - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 20:11:36.801 1 WARNING oslo_config.cfg [req-59df5550-7bfd-4def-adcb-4a9aff35d1ff - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 20:11:36.804 1 WARNING oslo_config.cfg [req-59df5550-7bfd-4def-adcb-4a9aff35d1ff - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:11:36.804 1 WARNING oslo_config.cfg [req-59df5550-7bfd-4def-adcb-4a9aff35d1ff - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:11:36.805 1 WARNING oslo_config.cfg [req-59df5550-7bfd-4def-adcb-4a9aff35d1ff - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:11:36.810 1 WARNING oslo_config.cfg [req-59df5550-7bfd-4def-adcb-4a9aff35d1ff - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 20:11:36.811 1 WARNING oslo_config.cfg [req-59df5550-7bfd-4def-adcb-4a9aff35d1ff - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 20:11:36.814 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 20:11:36.820 1 INFO cinder.manager [req-a3e65c20-20d6-487b-ad2a-b78b18754b72 - - - - -] Initiating service 5 cleanup
>2018-06-25 20:11:36.824 1 INFO cinder.manager [req-a3e65c20-20d6-487b-ad2a-b78b18754b72 - - - - -] Service 5 cleanup completed.
>2018-06-25 20:13:42.889 1 ERROR oslo.messaging._drivers.impl_rabbit [req-a3e65c20-20d6-487b-ad2a-b78b18754b72 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:13:42.890 1 ERROR oslo.messaging._drivers.impl_rabbit [req-a3e65c20-20d6-487b-ad2a-b78b18754b72 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:13:42.891 1 ERROR oslo_service.service [req-a3e65c20-20d6-487b-ad2a-b78b18754b72 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:13:42.891 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 20:13:42.891 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 20:13:42.891 1 ERROR oslo_service.service     service.start()
>2018-06-25 20:13:42.891 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 20:13:42.891 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 20:13:42.891 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 20:13:42.891 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 20:13:42.891 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 20:13:42.891 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 20:13:42.891 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 20:13:42.891 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 20:13:42.891 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 20:13:42.891 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 20:13:42.891 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 20:13:42.891 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 20:13:42.891 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 20:13:42.891 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 20:13:42.891 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 20:13:42.891 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 20:13:42.891 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 20:13:42.891 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 20:13:42.891 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 20:13:42.891 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 20:13:42.891 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 20:13:42.891 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 20:13:42.891 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:13:42.891 1 ERROR oslo_service.service 
>2018-06-25 20:13:42.894 1 CRITICAL cinder [req-59df5550-7bfd-4def-adcb-4a9aff35d1ff - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 20:13:42.894 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 20:13:42.894 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 20:13:42.894 1 ERROR cinder     sys.exit(main())
>2018-06-25 20:13:42.894 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 20:13:42.894 1 ERROR cinder     service.wait()
>2018-06-25 20:13:42.894 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 20:13:42.894 1 ERROR cinder     _launcher.wait()
>2018-06-25 20:13:42.894 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 20:13:42.894 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 20:13:42.894 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 20:13:42.894 1 ERROR cinder     self.services.wait()
>2018-06-25 20:13:42.894 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 20:13:42.894 1 ERROR cinder     service.wait()
>2018-06-25 20:13:42.894 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 20:13:42.894 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 20:13:42.894 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 20:13:42.894 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 20:13:42.894 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 20:13:42.894 1 ERROR cinder     post_fn = fn()
>2018-06-25 20:13:42.894 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 20:13:42.894 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 20:13:42.894 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 20:13:42.894 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 20:13:42.894 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 20:13:42.894 1 ERROR cinder 
>2018-06-25 20:13:45.541 1 WARNING cinder.scheduler.host_manager [req-91222af2-d78a-4059-a85e-97464314b56c - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 20:13:45.547 1 INFO cinder.rpc [req-91222af2-d78a-4059-a85e-97464314b56c - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 20:13:45.554 1 INFO cinder.rpc [req-91222af2-d78a-4059-a85e-97464314b56c - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 20:13:45.570 1 INFO cinder.rpc [req-91222af2-d78a-4059-a85e-97464314b56c - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 20:13:45.576 1 INFO cinder.rpc [req-91222af2-d78a-4059-a85e-97464314b56c - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 20:13:45.604 1 WARNING oslo_config.cfg [req-91222af2-d78a-4059-a85e-97464314b56c - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 20:13:45.607 1 WARNING oslo_config.cfg [req-91222af2-d78a-4059-a85e-97464314b56c - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:13:45.607 1 WARNING oslo_config.cfg [req-91222af2-d78a-4059-a85e-97464314b56c - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:13:45.608 1 WARNING oslo_config.cfg [req-91222af2-d78a-4059-a85e-97464314b56c - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:13:45.613 1 WARNING oslo_config.cfg [req-91222af2-d78a-4059-a85e-97464314b56c - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 20:13:45.614 1 WARNING oslo_config.cfg [req-91222af2-d78a-4059-a85e-97464314b56c - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 20:13:45.617 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 20:13:45.624 1 INFO cinder.manager [req-b36731a5-7e35-4b64-97b9-9594361978a6 - - - - -] Initiating service 5 cleanup
>2018-06-25 20:13:45.631 1 INFO cinder.manager [req-b36731a5-7e35-4b64-97b9-9594361978a6 - - - - -] Service 5 cleanup completed.
>2018-06-25 20:15:57.250 1 ERROR oslo.messaging._drivers.impl_rabbit [req-b36731a5-7e35-4b64-97b9-9594361978a6 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:15:57.252 1 ERROR oslo.messaging._drivers.impl_rabbit [req-b36731a5-7e35-4b64-97b9-9594361978a6 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:15:57.252 1 ERROR oslo_service.service [req-b36731a5-7e35-4b64-97b9-9594361978a6 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:15:57.252 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 20:15:57.252 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 20:15:57.252 1 ERROR oslo_service.service     service.start()
>2018-06-25 20:15:57.252 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 20:15:57.252 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 20:15:57.252 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 20:15:57.252 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 20:15:57.252 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 20:15:57.252 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 20:15:57.252 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 20:15:57.252 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 20:15:57.252 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 20:15:57.252 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 20:15:57.252 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 20:15:57.252 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 20:15:57.252 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 20:15:57.252 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 20:15:57.252 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 20:15:57.252 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 20:15:57.252 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 20:15:57.252 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 20:15:57.252 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 20:15:57.252 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 20:15:57.252 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 20:15:57.252 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 20:15:57.252 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:15:57.252 1 ERROR oslo_service.service 
>2018-06-25 20:15:57.255 1 CRITICAL cinder [req-91222af2-d78a-4059-a85e-97464314b56c - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 20:15:57.255 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 20:15:57.255 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 20:15:57.255 1 ERROR cinder     sys.exit(main())
>2018-06-25 20:15:57.255 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 20:15:57.255 1 ERROR cinder     service.wait()
>2018-06-25 20:15:57.255 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 20:15:57.255 1 ERROR cinder     _launcher.wait()
>2018-06-25 20:15:57.255 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 20:15:57.255 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 20:15:57.255 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 20:15:57.255 1 ERROR cinder     self.services.wait()
>2018-06-25 20:15:57.255 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 20:15:57.255 1 ERROR cinder     service.wait()
>2018-06-25 20:15:57.255 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 20:15:57.255 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 20:15:57.255 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 20:15:57.255 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 20:15:57.255 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 20:15:57.255 1 ERROR cinder     post_fn = fn()
>2018-06-25 20:15:57.255 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 20:15:57.255 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 20:15:57.255 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 20:15:57.255 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 20:15:57.255 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 20:15:57.255 1 ERROR cinder 
>2018-06-25 20:16:00.083 1 WARNING cinder.scheduler.host_manager [req-d2aceb81-b364-4bad-8936-f55d67f14802 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 20:16:00.089 1 INFO cinder.rpc [req-d2aceb81-b364-4bad-8936-f55d67f14802 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 20:16:00.094 1 INFO cinder.rpc [req-d2aceb81-b364-4bad-8936-f55d67f14802 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 20:16:00.108 1 INFO cinder.rpc [req-d2aceb81-b364-4bad-8936-f55d67f14802 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 20:16:00.114 1 INFO cinder.rpc [req-d2aceb81-b364-4bad-8936-f55d67f14802 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 20:16:00.136 1 WARNING oslo_config.cfg [req-d2aceb81-b364-4bad-8936-f55d67f14802 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 20:16:00.138 1 WARNING oslo_config.cfg [req-d2aceb81-b364-4bad-8936-f55d67f14802 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:16:00.139 1 WARNING oslo_config.cfg [req-d2aceb81-b364-4bad-8936-f55d67f14802 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:16:00.139 1 WARNING oslo_config.cfg [req-d2aceb81-b364-4bad-8936-f55d67f14802 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:16:00.144 1 WARNING oslo_config.cfg [req-d2aceb81-b364-4bad-8936-f55d67f14802 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 20:16:00.145 1 WARNING oslo_config.cfg [req-d2aceb81-b364-4bad-8936-f55d67f14802 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 20:16:00.148 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 20:16:00.154 1 INFO cinder.manager [req-b7156b1a-86d3-4d15-9b94-1a409549e994 - - - - -] Initiating service 5 cleanup
>2018-06-25 20:16:00.159 1 INFO cinder.manager [req-b7156b1a-86d3-4d15-9b94-1a409549e994 - - - - -] Service 5 cleanup completed.
>2018-06-25 20:18:11.793 1 ERROR oslo.messaging._drivers.impl_rabbit [req-b7156b1a-86d3-4d15-9b94-1a409549e994 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:18:11.795 1 ERROR oslo.messaging._drivers.impl_rabbit [req-b7156b1a-86d3-4d15-9b94-1a409549e994 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:18:11.795 1 ERROR oslo_service.service [req-b7156b1a-86d3-4d15-9b94-1a409549e994 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:18:11.795 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 20:18:11.795 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 20:18:11.795 1 ERROR oslo_service.service     service.start()
>2018-06-25 20:18:11.795 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 20:18:11.795 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 20:18:11.795 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 20:18:11.795 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 20:18:11.795 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 20:18:11.795 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 20:18:11.795 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 20:18:11.795 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 20:18:11.795 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 20:18:11.795 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 20:18:11.795 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 20:18:11.795 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 20:18:11.795 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 20:18:11.795 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 20:18:11.795 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 20:18:11.795 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 20:18:11.795 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 20:18:11.795 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 20:18:11.795 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 20:18:11.795 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 20:18:11.795 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 20:18:11.795 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 20:18:11.795 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:18:11.795 1 ERROR oslo_service.service 
>2018-06-25 20:18:11.798 1 CRITICAL cinder [req-d2aceb81-b364-4bad-8936-f55d67f14802 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 20:18:11.798 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 20:18:11.798 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 20:18:11.798 1 ERROR cinder     sys.exit(main())
>2018-06-25 20:18:11.798 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 20:18:11.798 1 ERROR cinder     service.wait()
>2018-06-25 20:18:11.798 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 20:18:11.798 1 ERROR cinder     _launcher.wait()
>2018-06-25 20:18:11.798 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 20:18:11.798 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 20:18:11.798 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 20:18:11.798 1 ERROR cinder     self.services.wait()
>2018-06-25 20:18:11.798 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 20:18:11.798 1 ERROR cinder     service.wait()
>2018-06-25 20:18:11.798 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 20:18:11.798 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 20:18:11.798 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 20:18:11.798 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 20:18:11.798 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 20:18:11.798 1 ERROR cinder     post_fn = fn()
>2018-06-25 20:18:11.798 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 20:18:11.798 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 20:18:11.798 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 20:18:11.798 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 20:18:11.798 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 20:18:11.798 1 ERROR cinder 
>2018-06-25 20:18:14.565 1 WARNING cinder.scheduler.host_manager [req-0c48dde0-3b55-484a-a32c-b6794ff22006 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 20:18:14.571 1 INFO cinder.rpc [req-0c48dde0-3b55-484a-a32c-b6794ff22006 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 20:18:14.577 1 INFO cinder.rpc [req-0c48dde0-3b55-484a-a32c-b6794ff22006 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 20:18:14.590 1 INFO cinder.rpc [req-0c48dde0-3b55-484a-a32c-b6794ff22006 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 20:18:14.597 1 INFO cinder.rpc [req-0c48dde0-3b55-484a-a32c-b6794ff22006 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 20:18:14.624 1 WARNING oslo_config.cfg [req-0c48dde0-3b55-484a-a32c-b6794ff22006 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 20:18:14.627 1 WARNING oslo_config.cfg [req-0c48dde0-3b55-484a-a32c-b6794ff22006 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:18:14.627 1 WARNING oslo_config.cfg [req-0c48dde0-3b55-484a-a32c-b6794ff22006 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:18:14.628 1 WARNING oslo_config.cfg [req-0c48dde0-3b55-484a-a32c-b6794ff22006 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:18:14.634 1 WARNING oslo_config.cfg [req-0c48dde0-3b55-484a-a32c-b6794ff22006 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 20:18:14.635 1 WARNING oslo_config.cfg [req-0c48dde0-3b55-484a-a32c-b6794ff22006 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 20:18:14.638 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 20:18:14.646 1 INFO cinder.manager [req-6896e7a3-7462-4246-a83b-4292f50d33f6 - - - - -] Initiating service 5 cleanup
>2018-06-25 20:18:14.651 1 INFO cinder.manager [req-6896e7a3-7462-4246-a83b-4292f50d33f6 - - - - -] Service 5 cleanup completed.
>2018-06-25 20:20:19.098 1 ERROR oslo.messaging._drivers.impl_rabbit [req-6896e7a3-7462-4246-a83b-4292f50d33f6 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:20:19.101 1 ERROR oslo.messaging._drivers.impl_rabbit [req-6896e7a3-7462-4246-a83b-4292f50d33f6 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:20:19.101 1 ERROR oslo_service.service [req-6896e7a3-7462-4246-a83b-4292f50d33f6 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:20:19.101 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 20:20:19.101 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 20:20:19.101 1 ERROR oslo_service.service     service.start()
>2018-06-25 20:20:19.101 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 20:20:19.101 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 20:20:19.101 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 20:20:19.101 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 20:20:19.101 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 20:20:19.101 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 20:20:19.101 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 20:20:19.101 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 20:20:19.101 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 20:20:19.101 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 20:20:19.101 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 20:20:19.101 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 20:20:19.101 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 20:20:19.101 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 20:20:19.101 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 20:20:19.101 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 20:20:19.101 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 20:20:19.101 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 20:20:19.101 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 20:20:19.101 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 20:20:19.101 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 20:20:19.101 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 20:20:19.101 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:20:19.101 1 ERROR oslo_service.service 
>2018-06-25 20:20:19.104 1 CRITICAL cinder [req-0c48dde0-3b55-484a-a32c-b6794ff22006 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 20:20:19.104 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 20:20:19.104 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 20:20:19.104 1 ERROR cinder     sys.exit(main())
>2018-06-25 20:20:19.104 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 20:20:19.104 1 ERROR cinder     service.wait()
>2018-06-25 20:20:19.104 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 20:20:19.104 1 ERROR cinder     _launcher.wait()
>2018-06-25 20:20:19.104 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 20:20:19.104 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 20:20:19.104 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 20:20:19.104 1 ERROR cinder     self.services.wait()
>2018-06-25 20:20:19.104 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 20:20:19.104 1 ERROR cinder     service.wait()
>2018-06-25 20:20:19.104 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 20:20:19.104 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 20:20:19.104 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 20:20:19.104 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 20:20:19.104 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 20:20:19.104 1 ERROR cinder     post_fn = fn()
>2018-06-25 20:20:19.104 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 20:20:19.104 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 20:20:19.104 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 20:20:19.104 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 20:20:19.104 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 20:20:19.104 1 ERROR cinder 
>2018-06-25 20:20:21.895 1 WARNING cinder.scheduler.host_manager [req-677c7b78-e5bf-40c0-af81-a014a9b617cd - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 20:20:21.902 1 INFO cinder.rpc [req-677c7b78-e5bf-40c0-af81-a014a9b617cd - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 20:20:21.908 1 INFO cinder.rpc [req-677c7b78-e5bf-40c0-af81-a014a9b617cd - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 20:20:21.922 1 INFO cinder.rpc [req-677c7b78-e5bf-40c0-af81-a014a9b617cd - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 20:20:21.933 1 INFO cinder.rpc [req-677c7b78-e5bf-40c0-af81-a014a9b617cd - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 20:20:21.962 1 WARNING oslo_config.cfg [req-677c7b78-e5bf-40c0-af81-a014a9b617cd - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 20:20:21.964 1 WARNING oslo_config.cfg [req-677c7b78-e5bf-40c0-af81-a014a9b617cd - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:20:21.965 1 WARNING oslo_config.cfg [req-677c7b78-e5bf-40c0-af81-a014a9b617cd - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:20:21.966 1 WARNING oslo_config.cfg [req-677c7b78-e5bf-40c0-af81-a014a9b617cd - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:20:21.971 1 WARNING oslo_config.cfg [req-677c7b78-e5bf-40c0-af81-a014a9b617cd - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 20:20:21.972 1 WARNING oslo_config.cfg [req-677c7b78-e5bf-40c0-af81-a014a9b617cd - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 20:20:21.975 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 20:20:21.984 1 INFO cinder.manager [req-510bcb41-02a0-4b3b-8c7d-d2627b7fe436 - - - - -] Initiating service 5 cleanup
>2018-06-25 20:20:21.991 1 INFO cinder.manager [req-510bcb41-02a0-4b3b-8c7d-d2627b7fe436 - - - - -] Service 5 cleanup completed.
>2018-06-25 20:22:26.355 1 ERROR oslo.messaging._drivers.impl_rabbit [req-510bcb41-02a0-4b3b-8c7d-d2627b7fe436 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:22:26.357 1 ERROR oslo.messaging._drivers.impl_rabbit [req-510bcb41-02a0-4b3b-8c7d-d2627b7fe436 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:22:26.357 1 ERROR oslo_service.service [req-510bcb41-02a0-4b3b-8c7d-d2627b7fe436 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:22:26.357 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 20:22:26.357 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 20:22:26.357 1 ERROR oslo_service.service     service.start()
>2018-06-25 20:22:26.357 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 20:22:26.357 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 20:22:26.357 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 20:22:26.357 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 20:22:26.357 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 20:22:26.357 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 20:22:26.357 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 20:22:26.357 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 20:22:26.357 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 20:22:26.357 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 20:22:26.357 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 20:22:26.357 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 20:22:26.357 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 20:22:26.357 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 20:22:26.357 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 20:22:26.357 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 20:22:26.357 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 20:22:26.357 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 20:22:26.357 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 20:22:26.357 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 20:22:26.357 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 20:22:26.357 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 20:22:26.357 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:22:26.357 1 ERROR oslo_service.service 
>2018-06-25 20:22:26.360 1 CRITICAL cinder [req-677c7b78-e5bf-40c0-af81-a014a9b617cd - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 20:22:26.360 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 20:22:26.360 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 20:22:26.360 1 ERROR cinder     sys.exit(main())
>2018-06-25 20:22:26.360 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 20:22:26.360 1 ERROR cinder     service.wait()
>2018-06-25 20:22:26.360 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 20:22:26.360 1 ERROR cinder     _launcher.wait()
>2018-06-25 20:22:26.360 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 20:22:26.360 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 20:22:26.360 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 20:22:26.360 1 ERROR cinder     self.services.wait()
>2018-06-25 20:22:26.360 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 20:22:26.360 1 ERROR cinder     service.wait()
>2018-06-25 20:22:26.360 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 20:22:26.360 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 20:22:26.360 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 20:22:26.360 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 20:22:26.360 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 20:22:26.360 1 ERROR cinder     post_fn = fn()
>2018-06-25 20:22:26.360 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 20:22:26.360 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 20:22:26.360 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 20:22:26.360 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 20:22:26.360 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 20:22:26.360 1 ERROR cinder 
>2018-06-25 20:22:28.964 1 WARNING cinder.scheduler.host_manager [req-1f509181-9f05-4332-8f42-383f8e6f2d14 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 20:22:28.970 1 INFO cinder.rpc [req-1f509181-9f05-4332-8f42-383f8e6f2d14 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 20:22:28.975 1 INFO cinder.rpc [req-1f509181-9f05-4332-8f42-383f8e6f2d14 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 20:22:28.987 1 INFO cinder.rpc [req-1f509181-9f05-4332-8f42-383f8e6f2d14 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 20:22:28.995 1 INFO cinder.rpc [req-1f509181-9f05-4332-8f42-383f8e6f2d14 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 20:22:29.022 1 WARNING oslo_config.cfg [req-1f509181-9f05-4332-8f42-383f8e6f2d14 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 20:22:29.024 1 WARNING oslo_config.cfg [req-1f509181-9f05-4332-8f42-383f8e6f2d14 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:22:29.024 1 WARNING oslo_config.cfg [req-1f509181-9f05-4332-8f42-383f8e6f2d14 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:22:29.025 1 WARNING oslo_config.cfg [req-1f509181-9f05-4332-8f42-383f8e6f2d14 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:22:29.030 1 WARNING oslo_config.cfg [req-1f509181-9f05-4332-8f42-383f8e6f2d14 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 20:22:29.032 1 WARNING oslo_config.cfg [req-1f509181-9f05-4332-8f42-383f8e6f2d14 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 20:22:29.034 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 20:22:29.041 1 INFO cinder.manager [req-af4f0bbf-73b3-4da8-838a-b11a8549ea67 - - - - -] Initiating service 5 cleanup
>2018-06-25 20:22:29.049 1 INFO cinder.manager [req-af4f0bbf-73b3-4da8-838a-b11a8549ea67 - - - - -] Service 5 cleanup completed.
>2018-06-25 20:24:33.418 1 ERROR oslo.messaging._drivers.impl_rabbit [req-af4f0bbf-73b3-4da8-838a-b11a8549ea67 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:24:33.420 1 ERROR oslo.messaging._drivers.impl_rabbit [req-af4f0bbf-73b3-4da8-838a-b11a8549ea67 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:24:33.421 1 ERROR oslo_service.service [req-af4f0bbf-73b3-4da8-838a-b11a8549ea67 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:24:33.421 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 20:24:33.421 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 20:24:33.421 1 ERROR oslo_service.service     service.start()
>2018-06-25 20:24:33.421 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 20:24:33.421 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 20:24:33.421 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 20:24:33.421 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 20:24:33.421 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 20:24:33.421 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 20:24:33.421 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 20:24:33.421 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 20:24:33.421 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 20:24:33.421 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 20:24:33.421 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 20:24:33.421 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 20:24:33.421 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 20:24:33.421 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 20:24:33.421 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 20:24:33.421 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 20:24:33.421 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 20:24:33.421 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 20:24:33.421 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 20:24:33.421 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 20:24:33.421 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 20:24:33.421 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 20:24:33.421 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:24:33.421 1 ERROR oslo_service.service 
>2018-06-25 20:24:33.424 1 CRITICAL cinder [req-1f509181-9f05-4332-8f42-383f8e6f2d14 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 20:24:33.424 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 20:24:33.424 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 20:24:33.424 1 ERROR cinder     sys.exit(main())
>2018-06-25 20:24:33.424 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 20:24:33.424 1 ERROR cinder     service.wait()
>2018-06-25 20:24:33.424 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 20:24:33.424 1 ERROR cinder     _launcher.wait()
>2018-06-25 20:24:33.424 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 20:24:33.424 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 20:24:33.424 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 20:24:33.424 1 ERROR cinder     self.services.wait()
>2018-06-25 20:24:33.424 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 20:24:33.424 1 ERROR cinder     service.wait()
>2018-06-25 20:24:33.424 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 20:24:33.424 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 20:24:33.424 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 20:24:33.424 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 20:24:33.424 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 20:24:33.424 1 ERROR cinder     post_fn = fn()
>2018-06-25 20:24:33.424 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 20:24:33.424 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 20:24:33.424 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 20:24:33.424 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 20:24:33.424 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 20:24:33.424 1 ERROR cinder 
>2018-06-25 20:24:36.289 1 WARNING cinder.scheduler.host_manager [req-a123d988-e981-4b62-bc8e-8d0dd451a48d - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 20:24:36.294 1 INFO cinder.rpc [req-a123d988-e981-4b62-bc8e-8d0dd451a48d - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 20:24:36.301 1 INFO cinder.rpc [req-a123d988-e981-4b62-bc8e-8d0dd451a48d - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 20:24:36.313 1 INFO cinder.rpc [req-a123d988-e981-4b62-bc8e-8d0dd451a48d - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 20:24:36.320 1 INFO cinder.rpc [req-a123d988-e981-4b62-bc8e-8d0dd451a48d - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 20:24:36.343 1 WARNING oslo_config.cfg [req-a123d988-e981-4b62-bc8e-8d0dd451a48d - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 20:24:36.345 1 WARNING oslo_config.cfg [req-a123d988-e981-4b62-bc8e-8d0dd451a48d - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:24:36.346 1 WARNING oslo_config.cfg [req-a123d988-e981-4b62-bc8e-8d0dd451a48d - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:24:36.347 1 WARNING oslo_config.cfg [req-a123d988-e981-4b62-bc8e-8d0dd451a48d - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:24:36.352 1 WARNING oslo_config.cfg [req-a123d988-e981-4b62-bc8e-8d0dd451a48d - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 20:24:36.353 1 WARNING oslo_config.cfg [req-a123d988-e981-4b62-bc8e-8d0dd451a48d - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 20:24:36.355 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 20:24:36.362 1 INFO cinder.manager [req-aba466a3-a940-4a36-9fe0-9dbe9a12e129 - - - - -] Initiating service 5 cleanup
>2018-06-25 20:24:36.368 1 INFO cinder.manager [req-aba466a3-a940-4a36-9fe0-9dbe9a12e129 - - - - -] Service 5 cleanup completed.
>2018-06-25 20:26:40.815 1 ERROR oslo.messaging._drivers.impl_rabbit [req-aba466a3-a940-4a36-9fe0-9dbe9a12e129 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:26:40.817 1 ERROR oslo.messaging._drivers.impl_rabbit [req-aba466a3-a940-4a36-9fe0-9dbe9a12e129 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:26:40.817 1 ERROR oslo_service.service [req-aba466a3-a940-4a36-9fe0-9dbe9a12e129 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:26:40.817 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 20:26:40.817 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 20:26:40.817 1 ERROR oslo_service.service     service.start()
>2018-06-25 20:26:40.817 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 20:26:40.817 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 20:26:40.817 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 20:26:40.817 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 20:26:40.817 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 20:26:40.817 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 20:26:40.817 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 20:26:40.817 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 20:26:40.817 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 20:26:40.817 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 20:26:40.817 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 20:26:40.817 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 20:26:40.817 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 20:26:40.817 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 20:26:40.817 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 20:26:40.817 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 20:26:40.817 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 20:26:40.817 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 20:26:40.817 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 20:26:40.817 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 20:26:40.817 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 20:26:40.817 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 20:26:40.817 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:26:40.817 1 ERROR oslo_service.service 
>2018-06-25 20:26:40.820 1 CRITICAL cinder [req-a123d988-e981-4b62-bc8e-8d0dd451a48d - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 20:26:40.820 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 20:26:40.820 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 20:26:40.820 1 ERROR cinder     sys.exit(main())
>2018-06-25 20:26:40.820 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 20:26:40.820 1 ERROR cinder     service.wait()
>2018-06-25 20:26:40.820 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 20:26:40.820 1 ERROR cinder     _launcher.wait()
>2018-06-25 20:26:40.820 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 20:26:40.820 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 20:26:40.820 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 20:26:40.820 1 ERROR cinder     self.services.wait()
>2018-06-25 20:26:40.820 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 20:26:40.820 1 ERROR cinder     service.wait()
>2018-06-25 20:26:40.820 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 20:26:40.820 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 20:26:40.820 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 20:26:40.820 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 20:26:40.820 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 20:26:40.820 1 ERROR cinder     post_fn = fn()
>2018-06-25 20:26:40.820 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 20:26:40.820 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 20:26:40.820 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 20:26:40.820 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 20:26:40.820 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 20:26:40.820 1 ERROR cinder 
>2018-06-25 20:26:43.491 1 WARNING cinder.scheduler.host_manager [req-72b63eaa-6624-4f9c-8dc2-ec28172cf3bc - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 20:26:43.501 1 INFO cinder.rpc [req-72b63eaa-6624-4f9c-8dc2-ec28172cf3bc - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 20:26:43.506 1 INFO cinder.rpc [req-72b63eaa-6624-4f9c-8dc2-ec28172cf3bc - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 20:26:43.528 1 INFO cinder.rpc [req-72b63eaa-6624-4f9c-8dc2-ec28172cf3bc - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 20:26:43.534 1 INFO cinder.rpc [req-72b63eaa-6624-4f9c-8dc2-ec28172cf3bc - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 20:26:43.573 1 WARNING oslo_config.cfg [req-72b63eaa-6624-4f9c-8dc2-ec28172cf3bc - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 20:26:43.575 1 WARNING oslo_config.cfg [req-72b63eaa-6624-4f9c-8dc2-ec28172cf3bc - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:26:43.576 1 WARNING oslo_config.cfg [req-72b63eaa-6624-4f9c-8dc2-ec28172cf3bc - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:26:43.576 1 WARNING oslo_config.cfg [req-72b63eaa-6624-4f9c-8dc2-ec28172cf3bc - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:26:43.581 1 WARNING oslo_config.cfg [req-72b63eaa-6624-4f9c-8dc2-ec28172cf3bc - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 20:26:43.582 1 WARNING oslo_config.cfg [req-72b63eaa-6624-4f9c-8dc2-ec28172cf3bc - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 20:26:43.585 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 20:26:43.594 1 INFO cinder.manager [req-7e68b7c4-26b0-42d5-a033-e9d77608b773 - - - - -] Initiating service 5 cleanup
>2018-06-25 20:26:43.598 1 INFO cinder.manager [req-7e68b7c4-26b0-42d5-a033-e9d77608b773 - - - - -] Service 5 cleanup completed.
>2018-06-25 20:28:54.986 1 ERROR oslo.messaging._drivers.impl_rabbit [req-7e68b7c4-26b0-42d5-a033-e9d77608b773 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:28:54.989 1 ERROR oslo.messaging._drivers.impl_rabbit [req-7e68b7c4-26b0-42d5-a033-e9d77608b773 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:28:54.989 1 ERROR oslo_service.service [req-7e68b7c4-26b0-42d5-a033-e9d77608b773 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:28:54.989 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 20:28:54.989 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 20:28:54.989 1 ERROR oslo_service.service     service.start()
>2018-06-25 20:28:54.989 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 20:28:54.989 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 20:28:54.989 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 20:28:54.989 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 20:28:54.989 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 20:28:54.989 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 20:28:54.989 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 20:28:54.989 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 20:28:54.989 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 20:28:54.989 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 20:28:54.989 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 20:28:54.989 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 20:28:54.989 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 20:28:54.989 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 20:28:54.989 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 20:28:54.989 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 20:28:54.989 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 20:28:54.989 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 20:28:54.989 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 20:28:54.989 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 20:28:54.989 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 20:28:54.989 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 20:28:54.989 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:28:54.989 1 ERROR oslo_service.service 
>2018-06-25 20:28:54.993 1 CRITICAL cinder [req-72b63eaa-6624-4f9c-8dc2-ec28172cf3bc - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 20:28:54.993 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 20:28:54.993 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 20:28:54.993 1 ERROR cinder     sys.exit(main())
>2018-06-25 20:28:54.993 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 20:28:54.993 1 ERROR cinder     service.wait()
>2018-06-25 20:28:54.993 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 20:28:54.993 1 ERROR cinder     _launcher.wait()
>2018-06-25 20:28:54.993 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 20:28:54.993 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 20:28:54.993 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 20:28:54.993 1 ERROR cinder     self.services.wait()
>2018-06-25 20:28:54.993 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 20:28:54.993 1 ERROR cinder     service.wait()
>2018-06-25 20:28:54.993 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 20:28:54.993 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 20:28:54.993 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 20:28:54.993 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 20:28:54.993 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 20:28:54.993 1 ERROR cinder     post_fn = fn()
>2018-06-25 20:28:54.993 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 20:28:54.993 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 20:28:54.993 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 20:28:54.993 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 20:28:54.993 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 20:28:54.993 1 ERROR cinder 
>2018-06-25 20:28:57.842 1 WARNING cinder.scheduler.host_manager [req-b5d382d0-21fc-4826-8f22-b3e377fe8857 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 20:28:57.858 1 INFO cinder.rpc [req-b5d382d0-21fc-4826-8f22-b3e377fe8857 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 20:28:57.870 1 INFO cinder.rpc [req-b5d382d0-21fc-4826-8f22-b3e377fe8857 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 20:28:57.882 1 INFO cinder.rpc [req-b5d382d0-21fc-4826-8f22-b3e377fe8857 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 20:28:57.894 1 INFO cinder.rpc [req-b5d382d0-21fc-4826-8f22-b3e377fe8857 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 20:28:57.944 1 WARNING oslo_config.cfg [req-b5d382d0-21fc-4826-8f22-b3e377fe8857 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 20:28:57.947 1 WARNING oslo_config.cfg [req-b5d382d0-21fc-4826-8f22-b3e377fe8857 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:28:57.947 1 WARNING oslo_config.cfg [req-b5d382d0-21fc-4826-8f22-b3e377fe8857 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:28:57.948 1 WARNING oslo_config.cfg [req-b5d382d0-21fc-4826-8f22-b3e377fe8857 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:28:57.954 1 WARNING oslo_config.cfg [req-b5d382d0-21fc-4826-8f22-b3e377fe8857 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 20:28:57.955 1 WARNING oslo_config.cfg [req-b5d382d0-21fc-4826-8f22-b3e377fe8857 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 20:28:57.958 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 20:28:57.970 1 INFO cinder.manager [req-47c77d72-ef50-48d1-9bb2-0ad379e3b951 - - - - -] Initiating service 5 cleanup
>2018-06-25 20:28:57.976 1 INFO cinder.manager [req-47c77d72-ef50-48d1-9bb2-0ad379e3b951 - - - - -] Service 5 cleanup completed.
>2018-06-25 20:31:02.360 1 ERROR oslo.messaging._drivers.impl_rabbit [req-47c77d72-ef50-48d1-9bb2-0ad379e3b951 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:31:02.363 1 ERROR oslo.messaging._drivers.impl_rabbit [req-47c77d72-ef50-48d1-9bb2-0ad379e3b951 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:31:02.364 1 ERROR oslo_service.service [req-47c77d72-ef50-48d1-9bb2-0ad379e3b951 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:31:02.364 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 20:31:02.364 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 20:31:02.364 1 ERROR oslo_service.service     service.start()
>2018-06-25 20:31:02.364 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 20:31:02.364 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 20:31:02.364 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 20:31:02.364 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 20:31:02.364 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 20:31:02.364 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 20:31:02.364 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 20:31:02.364 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 20:31:02.364 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 20:31:02.364 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 20:31:02.364 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 20:31:02.364 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 20:31:02.364 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 20:31:02.364 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 20:31:02.364 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 20:31:02.364 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 20:31:02.364 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 20:31:02.364 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 20:31:02.364 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 20:31:02.364 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 20:31:02.364 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 20:31:02.364 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 20:31:02.364 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:31:02.364 1 ERROR oslo_service.service 
>2018-06-25 20:31:02.369 1 CRITICAL cinder [req-b5d382d0-21fc-4826-8f22-b3e377fe8857 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 20:31:02.369 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 20:31:02.369 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 20:31:02.369 1 ERROR cinder     sys.exit(main())
>2018-06-25 20:31:02.369 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 20:31:02.369 1 ERROR cinder     service.wait()
>2018-06-25 20:31:02.369 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 20:31:02.369 1 ERROR cinder     _launcher.wait()
>2018-06-25 20:31:02.369 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 20:31:02.369 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 20:31:02.369 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 20:31:02.369 1 ERROR cinder     self.services.wait()
>2018-06-25 20:31:02.369 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 20:31:02.369 1 ERROR cinder     service.wait()
>2018-06-25 20:31:02.369 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 20:31:02.369 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 20:31:02.369 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 20:31:02.369 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 20:31:02.369 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 20:31:02.369 1 ERROR cinder     post_fn = fn()
>2018-06-25 20:31:02.369 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 20:31:02.369 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 20:31:02.369 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 20:31:02.369 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 20:31:02.369 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 20:31:02.369 1 ERROR cinder 
>2018-06-25 20:31:05.301 1 WARNING cinder.scheduler.host_manager [req-17aa3ebe-17df-458e-950c-ee4d2d063ec2 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 20:31:05.308 1 INFO cinder.rpc [req-17aa3ebe-17df-458e-950c-ee4d2d063ec2 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 20:31:05.314 1 INFO cinder.rpc [req-17aa3ebe-17df-458e-950c-ee4d2d063ec2 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 20:31:05.328 1 INFO cinder.rpc [req-17aa3ebe-17df-458e-950c-ee4d2d063ec2 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 20:31:05.335 1 INFO cinder.rpc [req-17aa3ebe-17df-458e-950c-ee4d2d063ec2 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 20:31:05.369 1 WARNING oslo_config.cfg [req-17aa3ebe-17df-458e-950c-ee4d2d063ec2 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 20:31:05.371 1 WARNING oslo_config.cfg [req-17aa3ebe-17df-458e-950c-ee4d2d063ec2 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:31:05.372 1 WARNING oslo_config.cfg [req-17aa3ebe-17df-458e-950c-ee4d2d063ec2 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:31:05.372 1 WARNING oslo_config.cfg [req-17aa3ebe-17df-458e-950c-ee4d2d063ec2 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:31:05.377 1 WARNING oslo_config.cfg [req-17aa3ebe-17df-458e-950c-ee4d2d063ec2 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 20:31:05.379 1 WARNING oslo_config.cfg [req-17aa3ebe-17df-458e-950c-ee4d2d063ec2 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 20:31:05.382 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 20:31:05.392 1 INFO cinder.manager [req-0505e982-753b-41e4-9741-115c1f41fbea - - - - -] Initiating service 5 cleanup
>2018-06-25 20:31:05.399 1 INFO cinder.manager [req-0505e982-753b-41e4-9741-115c1f41fbea - - - - -] Service 5 cleanup completed.
>2018-06-25 20:33:17.915 1 ERROR oslo.messaging._drivers.impl_rabbit [req-0505e982-753b-41e4-9741-115c1f41fbea - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:33:17.917 1 ERROR oslo.messaging._drivers.impl_rabbit [req-0505e982-753b-41e4-9741-115c1f41fbea - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:33:17.918 1 ERROR oslo_service.service [req-0505e982-753b-41e4-9741-115c1f41fbea - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:33:17.918 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 20:33:17.918 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 20:33:17.918 1 ERROR oslo_service.service     service.start()
>2018-06-25 20:33:17.918 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 20:33:17.918 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 20:33:17.918 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 20:33:17.918 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 20:33:17.918 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 20:33:17.918 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 20:33:17.918 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 20:33:17.918 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 20:33:17.918 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 20:33:17.918 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 20:33:17.918 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 20:33:17.918 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 20:33:17.918 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 20:33:17.918 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 20:33:17.918 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 20:33:17.918 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 20:33:17.918 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 20:33:17.918 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 20:33:17.918 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 20:33:17.918 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 20:33:17.918 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 20:33:17.918 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 20:33:17.918 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:33:17.918 1 ERROR oslo_service.service 
>2018-06-25 20:33:17.921 1 CRITICAL cinder [req-17aa3ebe-17df-458e-950c-ee4d2d063ec2 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 20:33:17.921 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 20:33:17.921 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 20:33:17.921 1 ERROR cinder     sys.exit(main())
>2018-06-25 20:33:17.921 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 20:33:17.921 1 ERROR cinder     service.wait()
>2018-06-25 20:33:17.921 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 20:33:17.921 1 ERROR cinder     _launcher.wait()
>2018-06-25 20:33:17.921 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 20:33:17.921 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 20:33:17.921 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 20:33:17.921 1 ERROR cinder     self.services.wait()
>2018-06-25 20:33:17.921 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 20:33:17.921 1 ERROR cinder     service.wait()
>2018-06-25 20:33:17.921 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 20:33:17.921 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 20:33:17.921 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 20:33:17.921 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 20:33:17.921 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 20:33:17.921 1 ERROR cinder     post_fn = fn()
>2018-06-25 20:33:17.921 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 20:33:17.921 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 20:33:17.921 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 20:33:17.921 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 20:33:17.921 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 20:33:17.921 1 ERROR cinder 
>2018-06-25 20:33:20.689 1 WARNING cinder.scheduler.host_manager [req-dead856b-1093-44ab-bece-c8b4a2a7ee62 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 20:33:20.696 1 INFO cinder.rpc [req-dead856b-1093-44ab-bece-c8b4a2a7ee62 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 20:33:20.703 1 INFO cinder.rpc [req-dead856b-1093-44ab-bece-c8b4a2a7ee62 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 20:33:20.718 1 INFO cinder.rpc [req-dead856b-1093-44ab-bece-c8b4a2a7ee62 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 20:33:20.727 1 INFO cinder.rpc [req-dead856b-1093-44ab-bece-c8b4a2a7ee62 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 20:33:20.761 1 WARNING oslo_config.cfg [req-dead856b-1093-44ab-bece-c8b4a2a7ee62 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 20:33:20.764 1 WARNING oslo_config.cfg [req-dead856b-1093-44ab-bece-c8b4a2a7ee62 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:33:20.764 1 WARNING oslo_config.cfg [req-dead856b-1093-44ab-bece-c8b4a2a7ee62 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:33:20.765 1 WARNING oslo_config.cfg [req-dead856b-1093-44ab-bece-c8b4a2a7ee62 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:33:20.771 1 WARNING oslo_config.cfg [req-dead856b-1093-44ab-bece-c8b4a2a7ee62 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 20:33:20.772 1 WARNING oslo_config.cfg [req-dead856b-1093-44ab-bece-c8b4a2a7ee62 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 20:33:20.775 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 20:33:20.782 1 INFO cinder.manager [req-25aabd89-f019-4bd5-80fe-5b19f7f93587 - - - - -] Initiating service 5 cleanup
>2018-06-25 20:33:20.787 1 INFO cinder.manager [req-25aabd89-f019-4bd5-80fe-5b19f7f93587 - - - - -] Service 5 cleanup completed.
>2018-06-25 20:35:26.899 1 ERROR oslo.messaging._drivers.impl_rabbit [req-25aabd89-f019-4bd5-80fe-5b19f7f93587 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:35:26.901 1 ERROR oslo.messaging._drivers.impl_rabbit [req-25aabd89-f019-4bd5-80fe-5b19f7f93587 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:35:26.901 1 ERROR oslo_service.service [req-25aabd89-f019-4bd5-80fe-5b19f7f93587 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:35:26.901 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 20:35:26.901 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 20:35:26.901 1 ERROR oslo_service.service     service.start()
>2018-06-25 20:35:26.901 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 20:35:26.901 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 20:35:26.901 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 20:35:26.901 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 20:35:26.901 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 20:35:26.901 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 20:35:26.901 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 20:35:26.901 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 20:35:26.901 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 20:35:26.901 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 20:35:26.901 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 20:35:26.901 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 20:35:26.901 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 20:35:26.901 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 20:35:26.901 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 20:35:26.901 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 20:35:26.901 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 20:35:26.901 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 20:35:26.901 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 20:35:26.901 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 20:35:26.901 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 20:35:26.901 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 20:35:26.901 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:35:26.901 1 ERROR oslo_service.service 
>2018-06-25 20:35:26.904 1 CRITICAL cinder [req-dead856b-1093-44ab-bece-c8b4a2a7ee62 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 20:35:26.904 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 20:35:26.904 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 20:35:26.904 1 ERROR cinder     sys.exit(main())
>2018-06-25 20:35:26.904 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 20:35:26.904 1 ERROR cinder     service.wait()
>2018-06-25 20:35:26.904 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 20:35:26.904 1 ERROR cinder     _launcher.wait()
>2018-06-25 20:35:26.904 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 20:35:26.904 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 20:35:26.904 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 20:35:26.904 1 ERROR cinder     self.services.wait()
>2018-06-25 20:35:26.904 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 20:35:26.904 1 ERROR cinder     service.wait()
>2018-06-25 20:35:26.904 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 20:35:26.904 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 20:35:26.904 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 20:35:26.904 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 20:35:26.904 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 20:35:26.904 1 ERROR cinder     post_fn = fn()
>2018-06-25 20:35:26.904 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 20:35:26.904 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 20:35:26.904 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 20:35:26.904 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 20:35:26.904 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 20:35:26.904 1 ERROR cinder 
>2018-06-25 20:35:29.628 1 WARNING cinder.scheduler.host_manager [req-e5edf2e9-b9ea-473c-9218-440e5f1c1a8c - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 20:35:29.634 1 INFO cinder.rpc [req-e5edf2e9-b9ea-473c-9218-440e5f1c1a8c - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 20:35:29.639 1 INFO cinder.rpc [req-e5edf2e9-b9ea-473c-9218-440e5f1c1a8c - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 20:35:29.650 1 INFO cinder.rpc [req-e5edf2e9-b9ea-473c-9218-440e5f1c1a8c - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 20:35:29.657 1 INFO cinder.rpc [req-e5edf2e9-b9ea-473c-9218-440e5f1c1a8c - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 20:35:29.681 1 WARNING oslo_config.cfg [req-e5edf2e9-b9ea-473c-9218-440e5f1c1a8c - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 20:35:29.684 1 WARNING oslo_config.cfg [req-e5edf2e9-b9ea-473c-9218-440e5f1c1a8c - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:35:29.684 1 WARNING oslo_config.cfg [req-e5edf2e9-b9ea-473c-9218-440e5f1c1a8c - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:35:29.685 1 WARNING oslo_config.cfg [req-e5edf2e9-b9ea-473c-9218-440e5f1c1a8c - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:35:29.690 1 WARNING oslo_config.cfg [req-e5edf2e9-b9ea-473c-9218-440e5f1c1a8c - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 20:35:29.691 1 WARNING oslo_config.cfg [req-e5edf2e9-b9ea-473c-9218-440e5f1c1a8c - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 20:35:29.693 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 20:35:29.699 1 INFO cinder.manager [req-20892a30-e495-410b-8bb2-340b09441450 - - - - -] Initiating service 5 cleanup
>2018-06-25 20:35:29.703 1 INFO cinder.manager [req-20892a30-e495-410b-8bb2-340b09441450 - - - - -] Service 5 cleanup completed.
>2018-06-25 20:37:41.868 1 ERROR oslo.messaging._drivers.impl_rabbit [req-20892a30-e495-410b-8bb2-340b09441450 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:37:41.870 1 ERROR oslo.messaging._drivers.impl_rabbit [req-20892a30-e495-410b-8bb2-340b09441450 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:37:41.870 1 ERROR oslo_service.service [req-20892a30-e495-410b-8bb2-340b09441450 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:37:41.870 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 20:37:41.870 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 20:37:41.870 1 ERROR oslo_service.service     service.start()
>2018-06-25 20:37:41.870 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 20:37:41.870 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 20:37:41.870 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 20:37:41.870 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 20:37:41.870 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 20:37:41.870 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 20:37:41.870 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 20:37:41.870 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 20:37:41.870 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 20:37:41.870 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 20:37:41.870 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 20:37:41.870 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 20:37:41.870 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 20:37:41.870 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 20:37:41.870 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 20:37:41.870 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 20:37:41.870 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 20:37:41.870 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 20:37:41.870 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 20:37:41.870 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 20:37:41.870 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 20:37:41.870 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 20:37:41.870 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:37:41.870 1 ERROR oslo_service.service 
>2018-06-25 20:37:41.873 1 CRITICAL cinder [req-e5edf2e9-b9ea-473c-9218-440e5f1c1a8c - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 20:37:41.873 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 20:37:41.873 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 20:37:41.873 1 ERROR cinder     sys.exit(main())
>2018-06-25 20:37:41.873 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 20:37:41.873 1 ERROR cinder     service.wait()
>2018-06-25 20:37:41.873 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 20:37:41.873 1 ERROR cinder     _launcher.wait()
>2018-06-25 20:37:41.873 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 20:37:41.873 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 20:37:41.873 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 20:37:41.873 1 ERROR cinder     self.services.wait()
>2018-06-25 20:37:41.873 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 20:37:41.873 1 ERROR cinder     service.wait()
>2018-06-25 20:37:41.873 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 20:37:41.873 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 20:37:41.873 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 20:37:41.873 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 20:37:41.873 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 20:37:41.873 1 ERROR cinder     post_fn = fn()
>2018-06-25 20:37:41.873 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 20:37:41.873 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 20:37:41.873 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 20:37:41.873 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 20:37:41.873 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 20:37:41.873 1 ERROR cinder 
>2018-06-25 20:37:44.609 1 WARNING cinder.scheduler.host_manager [req-56b22e9c-5b98-49ab-8c31-ab8d41aff4e2 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 20:37:44.615 1 INFO cinder.rpc [req-56b22e9c-5b98-49ab-8c31-ab8d41aff4e2 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 20:37:44.620 1 INFO cinder.rpc [req-56b22e9c-5b98-49ab-8c31-ab8d41aff4e2 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 20:37:44.631 1 INFO cinder.rpc [req-56b22e9c-5b98-49ab-8c31-ab8d41aff4e2 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 20:37:44.637 1 INFO cinder.rpc [req-56b22e9c-5b98-49ab-8c31-ab8d41aff4e2 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 20:37:44.660 1 WARNING oslo_config.cfg [req-56b22e9c-5b98-49ab-8c31-ab8d41aff4e2 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 20:37:44.662 1 WARNING oslo_config.cfg [req-56b22e9c-5b98-49ab-8c31-ab8d41aff4e2 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:37:44.663 1 WARNING oslo_config.cfg [req-56b22e9c-5b98-49ab-8c31-ab8d41aff4e2 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:37:44.663 1 WARNING oslo_config.cfg [req-56b22e9c-5b98-49ab-8c31-ab8d41aff4e2 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:37:44.669 1 WARNING oslo_config.cfg [req-56b22e9c-5b98-49ab-8c31-ab8d41aff4e2 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 20:37:44.670 1 WARNING oslo_config.cfg [req-56b22e9c-5b98-49ab-8c31-ab8d41aff4e2 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 20:37:44.673 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 20:37:44.679 1 INFO cinder.manager [req-33a951db-6a4d-4006-a9ff-55ec9ed75196 - - - - -] Initiating service 5 cleanup
>2018-06-25 20:37:44.683 1 INFO cinder.manager [req-33a951db-6a4d-4006-a9ff-55ec9ed75196 - - - - -] Service 5 cleanup completed.
>2018-06-25 20:39:56.725 1 ERROR oslo.messaging._drivers.impl_rabbit [req-33a951db-6a4d-4006-a9ff-55ec9ed75196 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:39:56.727 1 ERROR oslo.messaging._drivers.impl_rabbit [req-33a951db-6a4d-4006-a9ff-55ec9ed75196 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:39:56.728 1 ERROR oslo_service.service [req-33a951db-6a4d-4006-a9ff-55ec9ed75196 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:39:56.728 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 20:39:56.728 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 20:39:56.728 1 ERROR oslo_service.service     service.start()
>2018-06-25 20:39:56.728 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 20:39:56.728 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 20:39:56.728 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 20:39:56.728 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 20:39:56.728 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 20:39:56.728 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 20:39:56.728 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 20:39:56.728 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 20:39:56.728 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 20:39:56.728 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 20:39:56.728 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 20:39:56.728 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 20:39:56.728 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 20:39:56.728 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 20:39:56.728 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 20:39:56.728 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 20:39:56.728 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 20:39:56.728 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 20:39:56.728 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 20:39:56.728 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 20:39:56.728 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 20:39:56.728 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 20:39:56.728 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:39:56.728 1 ERROR oslo_service.service 
>2018-06-25 20:39:56.731 1 CRITICAL cinder [req-56b22e9c-5b98-49ab-8c31-ab8d41aff4e2 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 20:39:56.731 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 20:39:56.731 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 20:39:56.731 1 ERROR cinder     sys.exit(main())
>2018-06-25 20:39:56.731 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 20:39:56.731 1 ERROR cinder     service.wait()
>2018-06-25 20:39:56.731 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 20:39:56.731 1 ERROR cinder     _launcher.wait()
>2018-06-25 20:39:56.731 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 20:39:56.731 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 20:39:56.731 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 20:39:56.731 1 ERROR cinder     self.services.wait()
>2018-06-25 20:39:56.731 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 20:39:56.731 1 ERROR cinder     service.wait()
>2018-06-25 20:39:56.731 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 20:39:56.731 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 20:39:56.731 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 20:39:56.731 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 20:39:56.731 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 20:39:56.731 1 ERROR cinder     post_fn = fn()
>2018-06-25 20:39:56.731 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 20:39:56.731 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 20:39:56.731 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 20:39:56.731 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 20:39:56.731 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 20:39:56.731 1 ERROR cinder 
>2018-06-25 20:39:59.550 1 WARNING cinder.scheduler.host_manager [req-8102afc4-a14f-41c5-a547-ae6e0b89a71d - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 20:39:59.557 1 INFO cinder.rpc [req-8102afc4-a14f-41c5-a547-ae6e0b89a71d - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 20:39:59.564 1 INFO cinder.rpc [req-8102afc4-a14f-41c5-a547-ae6e0b89a71d - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 20:39:59.584 1 INFO cinder.rpc [req-8102afc4-a14f-41c5-a547-ae6e0b89a71d - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 20:39:59.590 1 INFO cinder.rpc [req-8102afc4-a14f-41c5-a547-ae6e0b89a71d - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 20:39:59.619 1 WARNING oslo_config.cfg [req-8102afc4-a14f-41c5-a547-ae6e0b89a71d - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 20:39:59.621 1 WARNING oslo_config.cfg [req-8102afc4-a14f-41c5-a547-ae6e0b89a71d - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:39:59.622 1 WARNING oslo_config.cfg [req-8102afc4-a14f-41c5-a547-ae6e0b89a71d - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:39:59.622 1 WARNING oslo_config.cfg [req-8102afc4-a14f-41c5-a547-ae6e0b89a71d - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:39:59.627 1 WARNING oslo_config.cfg [req-8102afc4-a14f-41c5-a547-ae6e0b89a71d - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 20:39:59.628 1 WARNING oslo_config.cfg [req-8102afc4-a14f-41c5-a547-ae6e0b89a71d - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 20:39:59.631 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 20:39:59.638 1 INFO cinder.manager [req-26441068-af25-4f8c-ad14-3c78e923d5c4 - - - - -] Initiating service 5 cleanup
>2018-06-25 20:39:59.646 1 INFO cinder.manager [req-26441068-af25-4f8c-ad14-3c78e923d5c4 - - - - -] Service 5 cleanup completed.
>2018-06-25 20:42:04.093 1 ERROR oslo.messaging._drivers.impl_rabbit [req-26441068-af25-4f8c-ad14-3c78e923d5c4 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:42:04.095 1 ERROR oslo.messaging._drivers.impl_rabbit [req-26441068-af25-4f8c-ad14-3c78e923d5c4 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:42:04.095 1 ERROR oslo_service.service [req-26441068-af25-4f8c-ad14-3c78e923d5c4 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:42:04.095 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 20:42:04.095 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 20:42:04.095 1 ERROR oslo_service.service     service.start()
>2018-06-25 20:42:04.095 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 20:42:04.095 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 20:42:04.095 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 20:42:04.095 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 20:42:04.095 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 20:42:04.095 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 20:42:04.095 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 20:42:04.095 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 20:42:04.095 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 20:42:04.095 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 20:42:04.095 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 20:42:04.095 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 20:42:04.095 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 20:42:04.095 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 20:42:04.095 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 20:42:04.095 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 20:42:04.095 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 20:42:04.095 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 20:42:04.095 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 20:42:04.095 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 20:42:04.095 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 20:42:04.095 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 20:42:04.095 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:42:04.095 1 ERROR oslo_service.service 
>2018-06-25 20:42:04.098 1 CRITICAL cinder [req-8102afc4-a14f-41c5-a547-ae6e0b89a71d - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 20:42:04.098 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 20:42:04.098 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 20:42:04.098 1 ERROR cinder     sys.exit(main())
>2018-06-25 20:42:04.098 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 20:42:04.098 1 ERROR cinder     service.wait()
>2018-06-25 20:42:04.098 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 20:42:04.098 1 ERROR cinder     _launcher.wait()
>2018-06-25 20:42:04.098 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 20:42:04.098 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 20:42:04.098 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 20:42:04.098 1 ERROR cinder     self.services.wait()
>2018-06-25 20:42:04.098 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 20:42:04.098 1 ERROR cinder     service.wait()
>2018-06-25 20:42:04.098 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 20:42:04.098 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 20:42:04.098 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 20:42:04.098 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 20:42:04.098 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 20:42:04.098 1 ERROR cinder     post_fn = fn()
>2018-06-25 20:42:04.098 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 20:42:04.098 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 20:42:04.098 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 20:42:04.098 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 20:42:04.098 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 20:42:04.098 1 ERROR cinder 
>2018-06-25 20:42:06.664 1 WARNING cinder.scheduler.host_manager [req-42a99708-b310-4173-9e30-2f3c3366baf5 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 20:42:06.671 1 INFO cinder.rpc [req-42a99708-b310-4173-9e30-2f3c3366baf5 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 20:42:06.676 1 INFO cinder.rpc [req-42a99708-b310-4173-9e30-2f3c3366baf5 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 20:42:06.687 1 INFO cinder.rpc [req-42a99708-b310-4173-9e30-2f3c3366baf5 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 20:42:06.694 1 INFO cinder.rpc [req-42a99708-b310-4173-9e30-2f3c3366baf5 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 20:42:06.721 1 WARNING oslo_config.cfg [req-42a99708-b310-4173-9e30-2f3c3366baf5 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 20:42:06.723 1 WARNING oslo_config.cfg [req-42a99708-b310-4173-9e30-2f3c3366baf5 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:42:06.724 1 WARNING oslo_config.cfg [req-42a99708-b310-4173-9e30-2f3c3366baf5 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:42:06.724 1 WARNING oslo_config.cfg [req-42a99708-b310-4173-9e30-2f3c3366baf5 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:42:06.730 1 WARNING oslo_config.cfg [req-42a99708-b310-4173-9e30-2f3c3366baf5 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 20:42:06.732 1 WARNING oslo_config.cfg [req-42a99708-b310-4173-9e30-2f3c3366baf5 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 20:42:06.735 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 20:42:06.741 1 INFO cinder.manager [req-7c48617d-01a9-4fb1-8c04-39cbe1f21cd5 - - - - -] Initiating service 5 cleanup
>2018-06-25 20:42:06.747 1 INFO cinder.manager [req-7c48617d-01a9-4fb1-8c04-39cbe1f21cd5 - - - - -] Service 5 cleanup completed.
>2018-06-25 20:44:18.373 1 ERROR oslo.messaging._drivers.impl_rabbit [req-7c48617d-01a9-4fb1-8c04-39cbe1f21cd5 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:44:18.376 1 ERROR oslo.messaging._drivers.impl_rabbit [req-7c48617d-01a9-4fb1-8c04-39cbe1f21cd5 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:44:18.376 1 ERROR oslo_service.service [req-7c48617d-01a9-4fb1-8c04-39cbe1f21cd5 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:44:18.376 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 20:44:18.376 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 20:44:18.376 1 ERROR oslo_service.service     service.start()
>2018-06-25 20:44:18.376 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 20:44:18.376 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 20:44:18.376 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 20:44:18.376 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 20:44:18.376 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 20:44:18.376 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 20:44:18.376 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 20:44:18.376 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 20:44:18.376 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 20:44:18.376 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 20:44:18.376 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 20:44:18.376 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 20:44:18.376 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 20:44:18.376 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 20:44:18.376 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 20:44:18.376 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 20:44:18.376 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 20:44:18.376 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 20:44:18.376 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 20:44:18.376 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 20:44:18.376 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 20:44:18.376 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 20:44:18.376 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:44:18.376 1 ERROR oslo_service.service 
>2018-06-25 20:44:18.379 1 CRITICAL cinder [req-42a99708-b310-4173-9e30-2f3c3366baf5 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 20:44:18.379 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 20:44:18.379 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 20:44:18.379 1 ERROR cinder     sys.exit(main())
>2018-06-25 20:44:18.379 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 20:44:18.379 1 ERROR cinder     service.wait()
>2018-06-25 20:44:18.379 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 20:44:18.379 1 ERROR cinder     _launcher.wait()
>2018-06-25 20:44:18.379 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 20:44:18.379 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 20:44:18.379 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 20:44:18.379 1 ERROR cinder     self.services.wait()
>2018-06-25 20:44:18.379 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 20:44:18.379 1 ERROR cinder     service.wait()
>2018-06-25 20:44:18.379 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 20:44:18.379 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 20:44:18.379 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 20:44:18.379 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 20:44:18.379 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 20:44:18.379 1 ERROR cinder     post_fn = fn()
>2018-06-25 20:44:18.379 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 20:44:18.379 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 20:44:18.379 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 20:44:18.379 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 20:44:18.379 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 20:44:18.379 1 ERROR cinder 
>2018-06-25 20:44:21.229 1 WARNING cinder.scheduler.host_manager [req-3910e97e-cf43-462f-8b83-76446f6308d5 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 20:44:21.236 1 INFO cinder.rpc [req-3910e97e-cf43-462f-8b83-76446f6308d5 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 20:44:21.242 1 INFO cinder.rpc [req-3910e97e-cf43-462f-8b83-76446f6308d5 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 20:44:21.255 1 INFO cinder.rpc [req-3910e97e-cf43-462f-8b83-76446f6308d5 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 20:44:21.261 1 INFO cinder.rpc [req-3910e97e-cf43-462f-8b83-76446f6308d5 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 20:44:21.287 1 WARNING oslo_config.cfg [req-3910e97e-cf43-462f-8b83-76446f6308d5 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 20:44:21.289 1 WARNING oslo_config.cfg [req-3910e97e-cf43-462f-8b83-76446f6308d5 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:44:21.290 1 WARNING oslo_config.cfg [req-3910e97e-cf43-462f-8b83-76446f6308d5 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:44:21.290 1 WARNING oslo_config.cfg [req-3910e97e-cf43-462f-8b83-76446f6308d5 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:44:21.296 1 WARNING oslo_config.cfg [req-3910e97e-cf43-462f-8b83-76446f6308d5 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 20:44:21.297 1 WARNING oslo_config.cfg [req-3910e97e-cf43-462f-8b83-76446f6308d5 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 20:44:21.300 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 20:44:21.307 1 INFO cinder.manager [req-5eee739a-b451-40d7-a9ab-64bc2d06bd87 - - - - -] Initiating service 5 cleanup
>2018-06-25 20:44:21.312 1 INFO cinder.manager [req-5eee739a-b451-40d7-a9ab-64bc2d06bd87 - - - - -] Service 5 cleanup completed.
>2018-06-25 20:46:33.103 1 ERROR oslo.messaging._drivers.impl_rabbit [req-5eee739a-b451-40d7-a9ab-64bc2d06bd87 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:46:33.105 1 ERROR oslo.messaging._drivers.impl_rabbit [req-5eee739a-b451-40d7-a9ab-64bc2d06bd87 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:46:33.105 1 ERROR oslo_service.service [req-5eee739a-b451-40d7-a9ab-64bc2d06bd87 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:46:33.105 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 20:46:33.105 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 20:46:33.105 1 ERROR oslo_service.service     service.start()
>2018-06-25 20:46:33.105 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 20:46:33.105 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 20:46:33.105 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 20:46:33.105 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 20:46:33.105 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 20:46:33.105 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 20:46:33.105 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 20:46:33.105 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 20:46:33.105 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 20:46:33.105 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 20:46:33.105 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 20:46:33.105 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 20:46:33.105 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 20:46:33.105 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 20:46:33.105 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 20:46:33.105 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 20:46:33.105 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 20:46:33.105 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 20:46:33.105 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 20:46:33.105 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 20:46:33.105 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 20:46:33.105 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 20:46:33.105 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:46:33.105 1 ERROR oslo_service.service 
>2018-06-25 20:46:33.109 1 CRITICAL cinder [req-3910e97e-cf43-462f-8b83-76446f6308d5 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 20:46:33.109 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 20:46:33.109 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 20:46:33.109 1 ERROR cinder     sys.exit(main())
>2018-06-25 20:46:33.109 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 20:46:33.109 1 ERROR cinder     service.wait()
>2018-06-25 20:46:33.109 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 20:46:33.109 1 ERROR cinder     _launcher.wait()
>2018-06-25 20:46:33.109 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 20:46:33.109 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 20:46:33.109 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 20:46:33.109 1 ERROR cinder     self.services.wait()
>2018-06-25 20:46:33.109 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 20:46:33.109 1 ERROR cinder     service.wait()
>2018-06-25 20:46:33.109 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 20:46:33.109 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 20:46:33.109 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 20:46:33.109 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 20:46:33.109 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 20:46:33.109 1 ERROR cinder     post_fn = fn()
>2018-06-25 20:46:33.109 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 20:46:33.109 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 20:46:33.109 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 20:46:33.109 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 20:46:33.109 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 20:46:33.109 1 ERROR cinder 
>2018-06-25 20:46:35.806 1 WARNING cinder.scheduler.host_manager [req-46f4343c-7526-4a60-a86f-47a4c068759f - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 20:46:35.812 1 INFO cinder.rpc [req-46f4343c-7526-4a60-a86f-47a4c068759f - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 20:46:35.817 1 INFO cinder.rpc [req-46f4343c-7526-4a60-a86f-47a4c068759f - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 20:46:35.829 1 INFO cinder.rpc [req-46f4343c-7526-4a60-a86f-47a4c068759f - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 20:46:35.835 1 INFO cinder.rpc [req-46f4343c-7526-4a60-a86f-47a4c068759f - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 20:46:35.862 1 WARNING oslo_config.cfg [req-46f4343c-7526-4a60-a86f-47a4c068759f - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 20:46:35.865 1 WARNING oslo_config.cfg [req-46f4343c-7526-4a60-a86f-47a4c068759f - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:46:35.865 1 WARNING oslo_config.cfg [req-46f4343c-7526-4a60-a86f-47a4c068759f - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:46:35.866 1 WARNING oslo_config.cfg [req-46f4343c-7526-4a60-a86f-47a4c068759f - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:46:35.871 1 WARNING oslo_config.cfg [req-46f4343c-7526-4a60-a86f-47a4c068759f - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 20:46:35.872 1 WARNING oslo_config.cfg [req-46f4343c-7526-4a60-a86f-47a4c068759f - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 20:46:35.875 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 20:46:35.881 1 INFO cinder.manager [req-56beca3d-f603-4e57-8b3c-bb72a31b31b0 - - - - -] Initiating service 5 cleanup
>2018-06-25 20:46:35.886 1 INFO cinder.manager [req-56beca3d-f603-4e57-8b3c-bb72a31b31b0 - - - - -] Service 5 cleanup completed.
>2018-06-25 20:48:42.058 1 ERROR oslo.messaging._drivers.impl_rabbit [req-56beca3d-f603-4e57-8b3c-bb72a31b31b0 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:48:42.060 1 ERROR oslo.messaging._drivers.impl_rabbit [req-56beca3d-f603-4e57-8b3c-bb72a31b31b0 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:48:42.061 1 ERROR oslo_service.service [req-56beca3d-f603-4e57-8b3c-bb72a31b31b0 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:48:42.061 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 20:48:42.061 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 20:48:42.061 1 ERROR oslo_service.service     service.start()
>2018-06-25 20:48:42.061 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 20:48:42.061 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 20:48:42.061 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 20:48:42.061 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 20:48:42.061 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 20:48:42.061 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 20:48:42.061 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 20:48:42.061 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 20:48:42.061 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 20:48:42.061 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 20:48:42.061 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 20:48:42.061 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 20:48:42.061 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 20:48:42.061 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 20:48:42.061 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 20:48:42.061 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 20:48:42.061 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 20:48:42.061 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 20:48:42.061 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 20:48:42.061 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 20:48:42.061 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 20:48:42.061 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 20:48:42.061 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:48:42.061 1 ERROR oslo_service.service 
>2018-06-25 20:48:42.064 1 CRITICAL cinder [req-46f4343c-7526-4a60-a86f-47a4c068759f - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 20:48:42.064 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 20:48:42.064 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 20:48:42.064 1 ERROR cinder     sys.exit(main())
>2018-06-25 20:48:42.064 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 20:48:42.064 1 ERROR cinder     service.wait()
>2018-06-25 20:48:42.064 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 20:48:42.064 1 ERROR cinder     _launcher.wait()
>2018-06-25 20:48:42.064 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 20:48:42.064 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 20:48:42.064 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 20:48:42.064 1 ERROR cinder     self.services.wait()
>2018-06-25 20:48:42.064 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 20:48:42.064 1 ERROR cinder     service.wait()
>2018-06-25 20:48:42.064 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 20:48:42.064 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 20:48:42.064 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 20:48:42.064 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 20:48:42.064 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 20:48:42.064 1 ERROR cinder     post_fn = fn()
>2018-06-25 20:48:42.064 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 20:48:42.064 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 20:48:42.064 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 20:48:42.064 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 20:48:42.064 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 20:48:42.064 1 ERROR cinder 
>2018-06-25 20:48:44.793 1 WARNING cinder.scheduler.host_manager [req-b2fa804a-f90b-46d2-a35e-32ac44d473a5 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 20:48:44.801 1 INFO cinder.rpc [req-b2fa804a-f90b-46d2-a35e-32ac44d473a5 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 20:48:44.807 1 INFO cinder.rpc [req-b2fa804a-f90b-46d2-a35e-32ac44d473a5 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 20:48:44.819 1 INFO cinder.rpc [req-b2fa804a-f90b-46d2-a35e-32ac44d473a5 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 20:48:44.825 1 INFO cinder.rpc [req-b2fa804a-f90b-46d2-a35e-32ac44d473a5 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 20:48:44.847 1 WARNING oslo_config.cfg [req-b2fa804a-f90b-46d2-a35e-32ac44d473a5 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 20:48:44.849 1 WARNING oslo_config.cfg [req-b2fa804a-f90b-46d2-a35e-32ac44d473a5 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:48:44.849 1 WARNING oslo_config.cfg [req-b2fa804a-f90b-46d2-a35e-32ac44d473a5 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:48:44.850 1 WARNING oslo_config.cfg [req-b2fa804a-f90b-46d2-a35e-32ac44d473a5 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:48:44.855 1 WARNING oslo_config.cfg [req-b2fa804a-f90b-46d2-a35e-32ac44d473a5 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 20:48:44.856 1 WARNING oslo_config.cfg [req-b2fa804a-f90b-46d2-a35e-32ac44d473a5 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 20:48:44.859 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 20:48:44.866 1 INFO cinder.manager [req-1a02d885-1770-4af8-a9de-d9c909672a70 - - - - -] Initiating service 5 cleanup
>2018-06-25 20:48:44.875 1 INFO cinder.manager [req-1a02d885-1770-4af8-a9de-d9c909672a70 - - - - -] Service 5 cleanup completed.
>2018-06-25 20:50:56.476 1 ERROR oslo.messaging._drivers.impl_rabbit [req-1a02d885-1770-4af8-a9de-d9c909672a70 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:50:56.478 1 ERROR oslo.messaging._drivers.impl_rabbit [req-1a02d885-1770-4af8-a9de-d9c909672a70 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:50:56.479 1 ERROR oslo_service.service [req-1a02d885-1770-4af8-a9de-d9c909672a70 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:50:56.479 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 20:50:56.479 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 20:50:56.479 1 ERROR oslo_service.service     service.start()
>2018-06-25 20:50:56.479 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 20:50:56.479 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 20:50:56.479 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 20:50:56.479 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 20:50:56.479 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 20:50:56.479 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 20:50:56.479 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 20:50:56.479 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 20:50:56.479 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 20:50:56.479 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 20:50:56.479 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 20:50:56.479 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 20:50:56.479 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 20:50:56.479 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 20:50:56.479 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 20:50:56.479 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 20:50:56.479 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 20:50:56.479 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 20:50:56.479 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 20:50:56.479 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 20:50:56.479 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 20:50:56.479 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 20:50:56.479 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:50:56.479 1 ERROR oslo_service.service 
>2018-06-25 20:50:56.481 1 CRITICAL cinder [req-b2fa804a-f90b-46d2-a35e-32ac44d473a5 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 20:50:56.481 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 20:50:56.481 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 20:50:56.481 1 ERROR cinder     sys.exit(main())
>2018-06-25 20:50:56.481 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 20:50:56.481 1 ERROR cinder     service.wait()
>2018-06-25 20:50:56.481 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 20:50:56.481 1 ERROR cinder     _launcher.wait()
>2018-06-25 20:50:56.481 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 20:50:56.481 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 20:50:56.481 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 20:50:56.481 1 ERROR cinder     self.services.wait()
>2018-06-25 20:50:56.481 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 20:50:56.481 1 ERROR cinder     service.wait()
>2018-06-25 20:50:56.481 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 20:50:56.481 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 20:50:56.481 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 20:50:56.481 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 20:50:56.481 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 20:50:56.481 1 ERROR cinder     post_fn = fn()
>2018-06-25 20:50:56.481 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 20:50:56.481 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 20:50:56.481 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 20:50:56.481 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 20:50:56.481 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 20:50:56.481 1 ERROR cinder 
>2018-06-25 20:50:59.209 1 WARNING cinder.scheduler.host_manager [req-fc10eb39-5fbd-4835-aed0-edf9d6098ae4 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 20:50:59.215 1 INFO cinder.rpc [req-fc10eb39-5fbd-4835-aed0-edf9d6098ae4 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 20:50:59.221 1 INFO cinder.rpc [req-fc10eb39-5fbd-4835-aed0-edf9d6098ae4 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 20:50:59.233 1 INFO cinder.rpc [req-fc10eb39-5fbd-4835-aed0-edf9d6098ae4 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 20:50:59.239 1 INFO cinder.rpc [req-fc10eb39-5fbd-4835-aed0-edf9d6098ae4 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 20:50:59.263 1 WARNING oslo_config.cfg [req-fc10eb39-5fbd-4835-aed0-edf9d6098ae4 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 20:50:59.265 1 WARNING oslo_config.cfg [req-fc10eb39-5fbd-4835-aed0-edf9d6098ae4 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:50:59.265 1 WARNING oslo_config.cfg [req-fc10eb39-5fbd-4835-aed0-edf9d6098ae4 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:50:59.266 1 WARNING oslo_config.cfg [req-fc10eb39-5fbd-4835-aed0-edf9d6098ae4 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:50:59.271 1 WARNING oslo_config.cfg [req-fc10eb39-5fbd-4835-aed0-edf9d6098ae4 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 20:50:59.272 1 WARNING oslo_config.cfg [req-fc10eb39-5fbd-4835-aed0-edf9d6098ae4 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 20:50:59.275 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 20:50:59.282 1 INFO cinder.manager [req-9929c7c4-4419-4790-92d1-94891cfe1813 - - - - -] Initiating service 5 cleanup
>2018-06-25 20:50:59.286 1 INFO cinder.manager [req-9929c7c4-4419-4790-92d1-94891cfe1813 - - - - -] Service 5 cleanup completed.
>2018-06-25 20:53:03.776 1 ERROR oslo.messaging._drivers.impl_rabbit [req-9929c7c4-4419-4790-92d1-94891cfe1813 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:53:03.778 1 ERROR oslo.messaging._drivers.impl_rabbit [req-9929c7c4-4419-4790-92d1-94891cfe1813 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:53:03.778 1 ERROR oslo_service.service [req-9929c7c4-4419-4790-92d1-94891cfe1813 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:53:03.778 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 20:53:03.778 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 20:53:03.778 1 ERROR oslo_service.service     service.start()
>2018-06-25 20:53:03.778 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 20:53:03.778 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 20:53:03.778 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 20:53:03.778 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 20:53:03.778 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 20:53:03.778 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 20:53:03.778 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 20:53:03.778 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 20:53:03.778 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 20:53:03.778 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 20:53:03.778 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 20:53:03.778 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 20:53:03.778 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 20:53:03.778 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 20:53:03.778 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 20:53:03.778 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 20:53:03.778 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 20:53:03.778 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 20:53:03.778 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 20:53:03.778 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 20:53:03.778 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 20:53:03.778 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 20:53:03.778 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:53:03.778 1 ERROR oslo_service.service 
>2018-06-25 20:53:03.781 1 CRITICAL cinder [req-fc10eb39-5fbd-4835-aed0-edf9d6098ae4 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 20:53:03.781 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 20:53:03.781 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 20:53:03.781 1 ERROR cinder     sys.exit(main())
>2018-06-25 20:53:03.781 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 20:53:03.781 1 ERROR cinder     service.wait()
>2018-06-25 20:53:03.781 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 20:53:03.781 1 ERROR cinder     _launcher.wait()
>2018-06-25 20:53:03.781 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 20:53:03.781 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 20:53:03.781 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 20:53:03.781 1 ERROR cinder     self.services.wait()
>2018-06-25 20:53:03.781 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 20:53:03.781 1 ERROR cinder     service.wait()
>2018-06-25 20:53:03.781 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 20:53:03.781 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 20:53:03.781 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 20:53:03.781 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 20:53:03.781 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 20:53:03.781 1 ERROR cinder     post_fn = fn()
>2018-06-25 20:53:03.781 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 20:53:03.781 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 20:53:03.781 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 20:53:03.781 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 20:53:03.781 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 20:53:03.781 1 ERROR cinder 
>2018-06-25 20:53:06.584 1 WARNING cinder.scheduler.host_manager [req-61018c6d-927e-4e1f-b241-15ed912b655e - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 20:53:06.590 1 INFO cinder.rpc [req-61018c6d-927e-4e1f-b241-15ed912b655e - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 20:53:06.597 1 INFO cinder.rpc [req-61018c6d-927e-4e1f-b241-15ed912b655e - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 20:53:06.608 1 INFO cinder.rpc [req-61018c6d-927e-4e1f-b241-15ed912b655e - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 20:53:06.615 1 INFO cinder.rpc [req-61018c6d-927e-4e1f-b241-15ed912b655e - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 20:53:06.638 1 WARNING oslo_config.cfg [req-61018c6d-927e-4e1f-b241-15ed912b655e - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 20:53:06.640 1 WARNING oslo_config.cfg [req-61018c6d-927e-4e1f-b241-15ed912b655e - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:53:06.640 1 WARNING oslo_config.cfg [req-61018c6d-927e-4e1f-b241-15ed912b655e - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:53:06.641 1 WARNING oslo_config.cfg [req-61018c6d-927e-4e1f-b241-15ed912b655e - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:53:06.646 1 WARNING oslo_config.cfg [req-61018c6d-927e-4e1f-b241-15ed912b655e - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 20:53:06.647 1 WARNING oslo_config.cfg [req-61018c6d-927e-4e1f-b241-15ed912b655e - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 20:53:06.650 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 20:53:06.656 1 INFO cinder.manager [req-194e6645-2c17-463a-afe7-4e15fa00d90a - - - - -] Initiating service 5 cleanup
>2018-06-25 20:53:06.661 1 INFO cinder.manager [req-194e6645-2c17-463a-afe7-4e15fa00d90a - - - - -] Service 5 cleanup completed.
>2018-06-25 20:55:11.125 1 ERROR oslo.messaging._drivers.impl_rabbit [req-194e6645-2c17-463a-afe7-4e15fa00d90a - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:55:11.127 1 ERROR oslo.messaging._drivers.impl_rabbit [req-194e6645-2c17-463a-afe7-4e15fa00d90a - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:55:11.128 1 ERROR oslo_service.service [req-194e6645-2c17-463a-afe7-4e15fa00d90a - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:55:11.128 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 20:55:11.128 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 20:55:11.128 1 ERROR oslo_service.service     service.start()
>2018-06-25 20:55:11.128 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 20:55:11.128 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 20:55:11.128 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 20:55:11.128 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 20:55:11.128 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 20:55:11.128 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 20:55:11.128 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 20:55:11.128 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 20:55:11.128 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 20:55:11.128 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 20:55:11.128 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 20:55:11.128 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 20:55:11.128 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 20:55:11.128 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 20:55:11.128 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 20:55:11.128 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 20:55:11.128 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 20:55:11.128 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 20:55:11.128 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 20:55:11.128 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 20:55:11.128 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 20:55:11.128 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 20:55:11.128 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:55:11.128 1 ERROR oslo_service.service 
>2018-06-25 20:55:11.131 1 CRITICAL cinder [req-61018c6d-927e-4e1f-b241-15ed912b655e - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 20:55:11.131 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 20:55:11.131 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 20:55:11.131 1 ERROR cinder     sys.exit(main())
>2018-06-25 20:55:11.131 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 20:55:11.131 1 ERROR cinder     service.wait()
>2018-06-25 20:55:11.131 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 20:55:11.131 1 ERROR cinder     _launcher.wait()
>2018-06-25 20:55:11.131 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 20:55:11.131 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 20:55:11.131 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 20:55:11.131 1 ERROR cinder     self.services.wait()
>2018-06-25 20:55:11.131 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 20:55:11.131 1 ERROR cinder     service.wait()
>2018-06-25 20:55:11.131 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 20:55:11.131 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 20:55:11.131 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 20:55:11.131 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 20:55:11.131 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 20:55:11.131 1 ERROR cinder     post_fn = fn()
>2018-06-25 20:55:11.131 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 20:55:11.131 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 20:55:11.131 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 20:55:11.131 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 20:55:11.131 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 20:55:11.131 1 ERROR cinder 
>2018-06-25 20:55:14.209 1 WARNING cinder.scheduler.host_manager [req-389350ca-3797-43a8-b860-e1d1f1af982a - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 20:55:14.216 1 INFO cinder.rpc [req-389350ca-3797-43a8-b860-e1d1f1af982a - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 20:55:14.224 1 INFO cinder.rpc [req-389350ca-3797-43a8-b860-e1d1f1af982a - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 20:55:14.246 1 INFO cinder.rpc [req-389350ca-3797-43a8-b860-e1d1f1af982a - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 20:55:14.254 1 INFO cinder.rpc [req-389350ca-3797-43a8-b860-e1d1f1af982a - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 20:55:14.282 1 WARNING oslo_config.cfg [req-389350ca-3797-43a8-b860-e1d1f1af982a - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 20:55:14.284 1 WARNING oslo_config.cfg [req-389350ca-3797-43a8-b860-e1d1f1af982a - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:55:14.285 1 WARNING oslo_config.cfg [req-389350ca-3797-43a8-b860-e1d1f1af982a - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:55:14.285 1 WARNING oslo_config.cfg [req-389350ca-3797-43a8-b860-e1d1f1af982a - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:55:14.290 1 WARNING oslo_config.cfg [req-389350ca-3797-43a8-b860-e1d1f1af982a - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 20:55:14.292 1 WARNING oslo_config.cfg [req-389350ca-3797-43a8-b860-e1d1f1af982a - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 20:55:14.294 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 20:55:14.302 1 INFO cinder.manager [req-ef94cedf-608a-4465-a178-f6efc2b9f659 - - - - -] Initiating service 5 cleanup
>2018-06-25 20:55:14.307 1 INFO cinder.manager [req-ef94cedf-608a-4465-a178-f6efc2b9f659 - - - - -] Service 5 cleanup completed.
>2018-06-25 20:57:26.394 1 ERROR oslo.messaging._drivers.impl_rabbit [req-ef94cedf-608a-4465-a178-f6efc2b9f659 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:57:26.396 1 ERROR oslo.messaging._drivers.impl_rabbit [req-ef94cedf-608a-4465-a178-f6efc2b9f659 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:57:26.397 1 ERROR oslo_service.service [req-ef94cedf-608a-4465-a178-f6efc2b9f659 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:57:26.397 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 20:57:26.397 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 20:57:26.397 1 ERROR oslo_service.service     service.start()
>2018-06-25 20:57:26.397 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 20:57:26.397 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 20:57:26.397 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 20:57:26.397 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 20:57:26.397 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 20:57:26.397 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 20:57:26.397 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 20:57:26.397 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 20:57:26.397 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 20:57:26.397 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 20:57:26.397 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 20:57:26.397 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 20:57:26.397 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 20:57:26.397 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 20:57:26.397 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 20:57:26.397 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 20:57:26.397 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 20:57:26.397 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 20:57:26.397 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 20:57:26.397 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 20:57:26.397 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 20:57:26.397 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 20:57:26.397 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:57:26.397 1 ERROR oslo_service.service 
>2018-06-25 20:57:26.400 1 CRITICAL cinder [req-389350ca-3797-43a8-b860-e1d1f1af982a - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 20:57:26.400 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 20:57:26.400 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 20:57:26.400 1 ERROR cinder     sys.exit(main())
>2018-06-25 20:57:26.400 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 20:57:26.400 1 ERROR cinder     service.wait()
>2018-06-25 20:57:26.400 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 20:57:26.400 1 ERROR cinder     _launcher.wait()
>2018-06-25 20:57:26.400 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 20:57:26.400 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 20:57:26.400 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 20:57:26.400 1 ERROR cinder     self.services.wait()
>2018-06-25 20:57:26.400 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 20:57:26.400 1 ERROR cinder     service.wait()
>2018-06-25 20:57:26.400 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 20:57:26.400 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 20:57:26.400 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 20:57:26.400 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 20:57:26.400 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 20:57:26.400 1 ERROR cinder     post_fn = fn()
>2018-06-25 20:57:26.400 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 20:57:26.400 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 20:57:26.400 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 20:57:26.400 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 20:57:26.400 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 20:57:26.400 1 ERROR cinder 
>2018-06-25 20:57:29.019 1 WARNING cinder.scheduler.host_manager [req-a759bee6-11be-4cfe-af8c-7be1bc844c97 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 20:57:29.025 1 INFO cinder.rpc [req-a759bee6-11be-4cfe-af8c-7be1bc844c97 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 20:57:29.030 1 INFO cinder.rpc [req-a759bee6-11be-4cfe-af8c-7be1bc844c97 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 20:57:29.041 1 INFO cinder.rpc [req-a759bee6-11be-4cfe-af8c-7be1bc844c97 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 20:57:29.046 1 INFO cinder.rpc [req-a759bee6-11be-4cfe-af8c-7be1bc844c97 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 20:57:29.071 1 WARNING oslo_config.cfg [req-a759bee6-11be-4cfe-af8c-7be1bc844c97 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 20:57:29.073 1 WARNING oslo_config.cfg [req-a759bee6-11be-4cfe-af8c-7be1bc844c97 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:57:29.073 1 WARNING oslo_config.cfg [req-a759bee6-11be-4cfe-af8c-7be1bc844c97 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:57:29.074 1 WARNING oslo_config.cfg [req-a759bee6-11be-4cfe-af8c-7be1bc844c97 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:57:29.079 1 WARNING oslo_config.cfg [req-a759bee6-11be-4cfe-af8c-7be1bc844c97 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 20:57:29.080 1 WARNING oslo_config.cfg [req-a759bee6-11be-4cfe-af8c-7be1bc844c97 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 20:57:29.083 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 20:57:29.088 1 INFO cinder.manager [req-1e236b92-a6b0-401a-9dff-d5ef81225618 - - - - -] Initiating service 5 cleanup
>2018-06-25 20:57:29.093 1 INFO cinder.manager [req-1e236b92-a6b0-401a-9dff-d5ef81225618 - - - - -] Service 5 cleanup completed.
>2018-06-25 20:59:35.375 1 ERROR oslo.messaging._drivers.impl_rabbit [req-1e236b92-a6b0-401a-9dff-d5ef81225618 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:59:35.376 1 ERROR oslo.messaging._drivers.impl_rabbit [req-1e236b92-a6b0-401a-9dff-d5ef81225618 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:59:35.377 1 ERROR oslo_service.service [req-1e236b92-a6b0-401a-9dff-d5ef81225618 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:59:35.377 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 20:59:35.377 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 20:59:35.377 1 ERROR oslo_service.service     service.start()
>2018-06-25 20:59:35.377 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 20:59:35.377 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 20:59:35.377 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 20:59:35.377 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 20:59:35.377 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 20:59:35.377 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 20:59:35.377 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 20:59:35.377 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 20:59:35.377 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 20:59:35.377 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 20:59:35.377 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 20:59:35.377 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 20:59:35.377 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 20:59:35.377 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 20:59:35.377 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 20:59:35.377 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 20:59:35.377 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 20:59:35.377 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 20:59:35.377 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 20:59:35.377 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 20:59:35.377 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 20:59:35.377 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 20:59:35.377 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 20:59:35.377 1 ERROR oslo_service.service 
>2018-06-25 20:59:35.380 1 CRITICAL cinder [req-a759bee6-11be-4cfe-af8c-7be1bc844c97 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 20:59:35.380 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 20:59:35.380 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 20:59:35.380 1 ERROR cinder     sys.exit(main())
>2018-06-25 20:59:35.380 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 20:59:35.380 1 ERROR cinder     service.wait()
>2018-06-25 20:59:35.380 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 20:59:35.380 1 ERROR cinder     _launcher.wait()
>2018-06-25 20:59:35.380 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 20:59:35.380 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 20:59:35.380 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 20:59:35.380 1 ERROR cinder     self.services.wait()
>2018-06-25 20:59:35.380 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 20:59:35.380 1 ERROR cinder     service.wait()
>2018-06-25 20:59:35.380 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 20:59:35.380 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 20:59:35.380 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 20:59:35.380 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 20:59:35.380 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 20:59:35.380 1 ERROR cinder     post_fn = fn()
>2018-06-25 20:59:35.380 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 20:59:35.380 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 20:59:35.380 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 20:59:35.380 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 20:59:35.380 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 20:59:35.380 1 ERROR cinder 
>2018-06-25 20:59:38.062 1 WARNING cinder.scheduler.host_manager [req-02fc26a9-118f-49dc-bb03-4575c5511503 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 20:59:38.068 1 INFO cinder.rpc [req-02fc26a9-118f-49dc-bb03-4575c5511503 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 20:59:38.075 1 INFO cinder.rpc [req-02fc26a9-118f-49dc-bb03-4575c5511503 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 20:59:38.087 1 INFO cinder.rpc [req-02fc26a9-118f-49dc-bb03-4575c5511503 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 20:59:38.092 1 INFO cinder.rpc [req-02fc26a9-118f-49dc-bb03-4575c5511503 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 20:59:38.122 1 WARNING oslo_config.cfg [req-02fc26a9-118f-49dc-bb03-4575c5511503 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 20:59:38.124 1 WARNING oslo_config.cfg [req-02fc26a9-118f-49dc-bb03-4575c5511503 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:59:38.124 1 WARNING oslo_config.cfg [req-02fc26a9-118f-49dc-bb03-4575c5511503 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:59:38.125 1 WARNING oslo_config.cfg [req-02fc26a9-118f-49dc-bb03-4575c5511503 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 20:59:38.129 1 WARNING oslo_config.cfg [req-02fc26a9-118f-49dc-bb03-4575c5511503 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 20:59:38.131 1 WARNING oslo_config.cfg [req-02fc26a9-118f-49dc-bb03-4575c5511503 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 20:59:38.133 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 20:59:38.139 1 INFO cinder.manager [req-13794a2b-45d2-42e3-815e-e004b5545fee - - - - -] Initiating service 5 cleanup
>2018-06-25 20:59:38.146 1 INFO cinder.manager [req-13794a2b-45d2-42e3-815e-e004b5545fee - - - - -] Service 5 cleanup completed.
>2018-06-25 21:01:42.556 1 ERROR oslo.messaging._drivers.impl_rabbit [req-13794a2b-45d2-42e3-815e-e004b5545fee - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:01:42.558 1 ERROR oslo.messaging._drivers.impl_rabbit [req-13794a2b-45d2-42e3-815e-e004b5545fee - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:01:42.559 1 ERROR oslo_service.service [req-13794a2b-45d2-42e3-815e-e004b5545fee - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:01:42.559 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 21:01:42.559 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 21:01:42.559 1 ERROR oslo_service.service     service.start()
>2018-06-25 21:01:42.559 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 21:01:42.559 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 21:01:42.559 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 21:01:42.559 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 21:01:42.559 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 21:01:42.559 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 21:01:42.559 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 21:01:42.559 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 21:01:42.559 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 21:01:42.559 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 21:01:42.559 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 21:01:42.559 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 21:01:42.559 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 21:01:42.559 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 21:01:42.559 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 21:01:42.559 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 21:01:42.559 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 21:01:42.559 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 21:01:42.559 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 21:01:42.559 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 21:01:42.559 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 21:01:42.559 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 21:01:42.559 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:01:42.559 1 ERROR oslo_service.service 
>2018-06-25 21:01:42.562 1 CRITICAL cinder [req-02fc26a9-118f-49dc-bb03-4575c5511503 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 21:01:42.562 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 21:01:42.562 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 21:01:42.562 1 ERROR cinder     sys.exit(main())
>2018-06-25 21:01:42.562 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 21:01:42.562 1 ERROR cinder     service.wait()
>2018-06-25 21:01:42.562 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 21:01:42.562 1 ERROR cinder     _launcher.wait()
>2018-06-25 21:01:42.562 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 21:01:42.562 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 21:01:42.562 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 21:01:42.562 1 ERROR cinder     self.services.wait()
>2018-06-25 21:01:42.562 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 21:01:42.562 1 ERROR cinder     service.wait()
>2018-06-25 21:01:42.562 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 21:01:42.562 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 21:01:42.562 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 21:01:42.562 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 21:01:42.562 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 21:01:42.562 1 ERROR cinder     post_fn = fn()
>2018-06-25 21:01:42.562 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 21:01:42.562 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 21:01:42.562 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 21:01:42.562 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 21:01:42.562 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 21:01:42.562 1 ERROR cinder 
>2018-06-25 21:01:45.272 1 WARNING cinder.scheduler.host_manager [req-9cc878b8-73ec-40f7-8f52-f7273d027372 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 21:01:45.277 1 INFO cinder.rpc [req-9cc878b8-73ec-40f7-8f52-f7273d027372 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 21:01:45.282 1 INFO cinder.rpc [req-9cc878b8-73ec-40f7-8f52-f7273d027372 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 21:01:45.293 1 INFO cinder.rpc [req-9cc878b8-73ec-40f7-8f52-f7273d027372 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 21:01:45.299 1 INFO cinder.rpc [req-9cc878b8-73ec-40f7-8f52-f7273d027372 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 21:01:45.324 1 WARNING oslo_config.cfg [req-9cc878b8-73ec-40f7-8f52-f7273d027372 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 21:01:45.326 1 WARNING oslo_config.cfg [req-9cc878b8-73ec-40f7-8f52-f7273d027372 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:01:45.326 1 WARNING oslo_config.cfg [req-9cc878b8-73ec-40f7-8f52-f7273d027372 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:01:45.327 1 WARNING oslo_config.cfg [req-9cc878b8-73ec-40f7-8f52-f7273d027372 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:01:45.332 1 WARNING oslo_config.cfg [req-9cc878b8-73ec-40f7-8f52-f7273d027372 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 21:01:45.333 1 WARNING oslo_config.cfg [req-9cc878b8-73ec-40f7-8f52-f7273d027372 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 21:01:45.335 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 21:01:45.343 1 INFO cinder.manager [req-2c46fdbb-a646-4c16-9e89-62e9a600f9f9 - - - - -] Initiating service 5 cleanup
>2018-06-25 21:01:45.347 1 INFO cinder.manager [req-2c46fdbb-a646-4c16-9e89-62e9a600f9f9 - - - - -] Service 5 cleanup completed.
>2018-06-25 21:03:49.760 1 ERROR oslo.messaging._drivers.impl_rabbit [req-2c46fdbb-a646-4c16-9e89-62e9a600f9f9 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:03:49.762 1 ERROR oslo.messaging._drivers.impl_rabbit [req-2c46fdbb-a646-4c16-9e89-62e9a600f9f9 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:03:49.762 1 ERROR oslo_service.service [req-2c46fdbb-a646-4c16-9e89-62e9a600f9f9 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:03:49.762 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 21:03:49.762 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 21:03:49.762 1 ERROR oslo_service.service     service.start()
>2018-06-25 21:03:49.762 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 21:03:49.762 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 21:03:49.762 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 21:03:49.762 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 21:03:49.762 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 21:03:49.762 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 21:03:49.762 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 21:03:49.762 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 21:03:49.762 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 21:03:49.762 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 21:03:49.762 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 21:03:49.762 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 21:03:49.762 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 21:03:49.762 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 21:03:49.762 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 21:03:49.762 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 21:03:49.762 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 21:03:49.762 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 21:03:49.762 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 21:03:49.762 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 21:03:49.762 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 21:03:49.762 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 21:03:49.762 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:03:49.762 1 ERROR oslo_service.service 
>2018-06-25 21:03:49.765 1 CRITICAL cinder [req-9cc878b8-73ec-40f7-8f52-f7273d027372 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 21:03:49.765 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 21:03:49.765 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 21:03:49.765 1 ERROR cinder     sys.exit(main())
>2018-06-25 21:03:49.765 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 21:03:49.765 1 ERROR cinder     service.wait()
>2018-06-25 21:03:49.765 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 21:03:49.765 1 ERROR cinder     _launcher.wait()
>2018-06-25 21:03:49.765 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 21:03:49.765 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 21:03:49.765 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 21:03:49.765 1 ERROR cinder     self.services.wait()
>2018-06-25 21:03:49.765 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 21:03:49.765 1 ERROR cinder     service.wait()
>2018-06-25 21:03:49.765 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 21:03:49.765 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 21:03:49.765 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 21:03:49.765 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 21:03:49.765 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 21:03:49.765 1 ERROR cinder     post_fn = fn()
>2018-06-25 21:03:49.765 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 21:03:49.765 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 21:03:49.765 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 21:03:49.765 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 21:03:49.765 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 21:03:49.765 1 ERROR cinder 
>2018-06-25 21:03:52.435 1 WARNING cinder.scheduler.host_manager [req-229d4b8a-f7a3-457c-bc06-24a56366dc86 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 21:03:52.442 1 INFO cinder.rpc [req-229d4b8a-f7a3-457c-bc06-24a56366dc86 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 21:03:52.447 1 INFO cinder.rpc [req-229d4b8a-f7a3-457c-bc06-24a56366dc86 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 21:03:52.461 1 INFO cinder.rpc [req-229d4b8a-f7a3-457c-bc06-24a56366dc86 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 21:03:52.468 1 INFO cinder.rpc [req-229d4b8a-f7a3-457c-bc06-24a56366dc86 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 21:03:52.490 1 WARNING oslo_config.cfg [req-229d4b8a-f7a3-457c-bc06-24a56366dc86 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 21:03:52.492 1 WARNING oslo_config.cfg [req-229d4b8a-f7a3-457c-bc06-24a56366dc86 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:03:52.492 1 WARNING oslo_config.cfg [req-229d4b8a-f7a3-457c-bc06-24a56366dc86 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:03:52.493 1 WARNING oslo_config.cfg [req-229d4b8a-f7a3-457c-bc06-24a56366dc86 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:03:52.498 1 WARNING oslo_config.cfg [req-229d4b8a-f7a3-457c-bc06-24a56366dc86 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 21:03:52.499 1 WARNING oslo_config.cfg [req-229d4b8a-f7a3-457c-bc06-24a56366dc86 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 21:03:52.502 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 21:03:52.509 1 INFO cinder.manager [req-20649b2e-0f91-4b8f-9e69-4f69c9e0a211 - - - - -] Initiating service 5 cleanup
>2018-06-25 21:03:52.515 1 INFO cinder.manager [req-20649b2e-0f91-4b8f-9e69-4f69c9e0a211 - - - - -] Service 5 cleanup completed.
>2018-06-25 21:05:56.897 1 ERROR oslo.messaging._drivers.impl_rabbit [req-20649b2e-0f91-4b8f-9e69-4f69c9e0a211 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:05:56.899 1 ERROR oslo.messaging._drivers.impl_rabbit [req-20649b2e-0f91-4b8f-9e69-4f69c9e0a211 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:05:56.899 1 ERROR oslo_service.service [req-20649b2e-0f91-4b8f-9e69-4f69c9e0a211 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:05:56.899 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 21:05:56.899 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 21:05:56.899 1 ERROR oslo_service.service     service.start()
>2018-06-25 21:05:56.899 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 21:05:56.899 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 21:05:56.899 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 21:05:56.899 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 21:05:56.899 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 21:05:56.899 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 21:05:56.899 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 21:05:56.899 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 21:05:56.899 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 21:05:56.899 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 21:05:56.899 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 21:05:56.899 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 21:05:56.899 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 21:05:56.899 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 21:05:56.899 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 21:05:56.899 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 21:05:56.899 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 21:05:56.899 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 21:05:56.899 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 21:05:56.899 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 21:05:56.899 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 21:05:56.899 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 21:05:56.899 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:05:56.899 1 ERROR oslo_service.service 
>2018-06-25 21:05:56.902 1 CRITICAL cinder [req-229d4b8a-f7a3-457c-bc06-24a56366dc86 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 21:05:56.902 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 21:05:56.902 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 21:05:56.902 1 ERROR cinder     sys.exit(main())
>2018-06-25 21:05:56.902 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 21:05:56.902 1 ERROR cinder     service.wait()
>2018-06-25 21:05:56.902 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 21:05:56.902 1 ERROR cinder     _launcher.wait()
>2018-06-25 21:05:56.902 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 21:05:56.902 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 21:05:56.902 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 21:05:56.902 1 ERROR cinder     self.services.wait()
>2018-06-25 21:05:56.902 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 21:05:56.902 1 ERROR cinder     service.wait()
>2018-06-25 21:05:56.902 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 21:05:56.902 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 21:05:56.902 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 21:05:56.902 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 21:05:56.902 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 21:05:56.902 1 ERROR cinder     post_fn = fn()
>2018-06-25 21:05:56.902 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 21:05:56.902 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 21:05:56.902 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 21:05:56.902 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 21:05:56.902 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 21:05:56.902 1 ERROR cinder 
>2018-06-25 21:05:59.668 1 WARNING cinder.scheduler.host_manager [req-f262aa82-7a3d-4b94-a9d3-8612ab2eb7ef - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 21:05:59.674 1 INFO cinder.rpc [req-f262aa82-7a3d-4b94-a9d3-8612ab2eb7ef - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 21:05:59.679 1 INFO cinder.rpc [req-f262aa82-7a3d-4b94-a9d3-8612ab2eb7ef - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 21:05:59.691 1 INFO cinder.rpc [req-f262aa82-7a3d-4b94-a9d3-8612ab2eb7ef - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 21:05:59.697 1 INFO cinder.rpc [req-f262aa82-7a3d-4b94-a9d3-8612ab2eb7ef - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 21:05:59.722 1 WARNING oslo_config.cfg [req-f262aa82-7a3d-4b94-a9d3-8612ab2eb7ef - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 21:05:59.724 1 WARNING oslo_config.cfg [req-f262aa82-7a3d-4b94-a9d3-8612ab2eb7ef - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:05:59.724 1 WARNING oslo_config.cfg [req-f262aa82-7a3d-4b94-a9d3-8612ab2eb7ef - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:05:59.725 1 WARNING oslo_config.cfg [req-f262aa82-7a3d-4b94-a9d3-8612ab2eb7ef - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:05:59.730 1 WARNING oslo_config.cfg [req-f262aa82-7a3d-4b94-a9d3-8612ab2eb7ef - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 21:05:59.731 1 WARNING oslo_config.cfg [req-f262aa82-7a3d-4b94-a9d3-8612ab2eb7ef - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 21:05:59.734 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 21:05:59.741 1 INFO cinder.manager [req-d870c57b-9d45-44c9-a003-fa3b6c7b0578 - - - - -] Initiating service 5 cleanup
>2018-06-25 21:05:59.745 1 INFO cinder.manager [req-d870c57b-9d45-44c9-a003-fa3b6c7b0578 - - - - -] Service 5 cleanup completed.
>2018-06-25 21:08:04.226 1 ERROR oslo.messaging._drivers.impl_rabbit [req-d870c57b-9d45-44c9-a003-fa3b6c7b0578 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:08:04.228 1 ERROR oslo.messaging._drivers.impl_rabbit [req-d870c57b-9d45-44c9-a003-fa3b6c7b0578 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:08:04.229 1 ERROR oslo_service.service [req-d870c57b-9d45-44c9-a003-fa3b6c7b0578 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:08:04.229 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 21:08:04.229 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 21:08:04.229 1 ERROR oslo_service.service     service.start()
>2018-06-25 21:08:04.229 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 21:08:04.229 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 21:08:04.229 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 21:08:04.229 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 21:08:04.229 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 21:08:04.229 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 21:08:04.229 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 21:08:04.229 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 21:08:04.229 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 21:08:04.229 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 21:08:04.229 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 21:08:04.229 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 21:08:04.229 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 21:08:04.229 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 21:08:04.229 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 21:08:04.229 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 21:08:04.229 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 21:08:04.229 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 21:08:04.229 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 21:08:04.229 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 21:08:04.229 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 21:08:04.229 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 21:08:04.229 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:08:04.229 1 ERROR oslo_service.service 
>2018-06-25 21:08:04.232 1 CRITICAL cinder [req-f262aa82-7a3d-4b94-a9d3-8612ab2eb7ef - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 21:08:04.232 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 21:08:04.232 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 21:08:04.232 1 ERROR cinder     sys.exit(main())
>2018-06-25 21:08:04.232 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 21:08:04.232 1 ERROR cinder     service.wait()
>2018-06-25 21:08:04.232 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 21:08:04.232 1 ERROR cinder     _launcher.wait()
>2018-06-25 21:08:04.232 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 21:08:04.232 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 21:08:04.232 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 21:08:04.232 1 ERROR cinder     self.services.wait()
>2018-06-25 21:08:04.232 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 21:08:04.232 1 ERROR cinder     service.wait()
>2018-06-25 21:08:04.232 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 21:08:04.232 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 21:08:04.232 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 21:08:04.232 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 21:08:04.232 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 21:08:04.232 1 ERROR cinder     post_fn = fn()
>2018-06-25 21:08:04.232 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 21:08:04.232 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 21:08:04.232 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 21:08:04.232 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 21:08:04.232 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 21:08:04.232 1 ERROR cinder 
>2018-06-25 21:08:06.818 1 WARNING cinder.scheduler.host_manager [req-f65ee325-02dd-4b1a-a186-1c10b8efa67a - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 21:08:06.824 1 INFO cinder.rpc [req-f65ee325-02dd-4b1a-a186-1c10b8efa67a - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 21:08:06.829 1 INFO cinder.rpc [req-f65ee325-02dd-4b1a-a186-1c10b8efa67a - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 21:08:06.840 1 INFO cinder.rpc [req-f65ee325-02dd-4b1a-a186-1c10b8efa67a - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 21:08:06.848 1 INFO cinder.rpc [req-f65ee325-02dd-4b1a-a186-1c10b8efa67a - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 21:08:06.869 1 WARNING oslo_config.cfg [req-f65ee325-02dd-4b1a-a186-1c10b8efa67a - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 21:08:06.871 1 WARNING oslo_config.cfg [req-f65ee325-02dd-4b1a-a186-1c10b8efa67a - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:08:06.871 1 WARNING oslo_config.cfg [req-f65ee325-02dd-4b1a-a186-1c10b8efa67a - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:08:06.872 1 WARNING oslo_config.cfg [req-f65ee325-02dd-4b1a-a186-1c10b8efa67a - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:08:06.877 1 WARNING oslo_config.cfg [req-f65ee325-02dd-4b1a-a186-1c10b8efa67a - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 21:08:06.878 1 WARNING oslo_config.cfg [req-f65ee325-02dd-4b1a-a186-1c10b8efa67a - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 21:08:06.880 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 21:08:06.886 1 INFO cinder.manager [req-909abd05-14ef-42f9-b907-f13f7cfe6a16 - - - - -] Initiating service 5 cleanup
>2018-06-25 21:08:06.890 1 INFO cinder.manager [req-909abd05-14ef-42f9-b907-f13f7cfe6a16 - - - - -] Service 5 cleanup completed.
>2018-06-25 21:10:13.204 1 ERROR oslo.messaging._drivers.impl_rabbit [req-909abd05-14ef-42f9-b907-f13f7cfe6a16 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:10:13.206 1 ERROR oslo.messaging._drivers.impl_rabbit [req-909abd05-14ef-42f9-b907-f13f7cfe6a16 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:10:13.206 1 ERROR oslo_service.service [req-909abd05-14ef-42f9-b907-f13f7cfe6a16 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:10:13.206 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 21:10:13.206 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 21:10:13.206 1 ERROR oslo_service.service     service.start()
>2018-06-25 21:10:13.206 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 21:10:13.206 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 21:10:13.206 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 21:10:13.206 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 21:10:13.206 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 21:10:13.206 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 21:10:13.206 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 21:10:13.206 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 21:10:13.206 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 21:10:13.206 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 21:10:13.206 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 21:10:13.206 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 21:10:13.206 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 21:10:13.206 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 21:10:13.206 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 21:10:13.206 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 21:10:13.206 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 21:10:13.206 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 21:10:13.206 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 21:10:13.206 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 21:10:13.206 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 21:10:13.206 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 21:10:13.206 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:10:13.206 1 ERROR oslo_service.service 
>2018-06-25 21:10:13.209 1 CRITICAL cinder [req-f65ee325-02dd-4b1a-a186-1c10b8efa67a - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 21:10:13.209 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 21:10:13.209 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 21:10:13.209 1 ERROR cinder     sys.exit(main())
>2018-06-25 21:10:13.209 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 21:10:13.209 1 ERROR cinder     service.wait()
>2018-06-25 21:10:13.209 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 21:10:13.209 1 ERROR cinder     _launcher.wait()
>2018-06-25 21:10:13.209 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 21:10:13.209 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 21:10:13.209 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 21:10:13.209 1 ERROR cinder     self.services.wait()
>2018-06-25 21:10:13.209 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 21:10:13.209 1 ERROR cinder     service.wait()
>2018-06-25 21:10:13.209 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 21:10:13.209 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 21:10:13.209 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 21:10:13.209 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 21:10:13.209 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 21:10:13.209 1 ERROR cinder     post_fn = fn()
>2018-06-25 21:10:13.209 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 21:10:13.209 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 21:10:13.209 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 21:10:13.209 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 21:10:13.209 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 21:10:13.209 1 ERROR cinder 
>2018-06-25 21:10:15.830 1 WARNING cinder.scheduler.host_manager [req-12447a4b-155f-46b7-8bb2-da4b5768698e - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 21:10:15.836 1 INFO cinder.rpc [req-12447a4b-155f-46b7-8bb2-da4b5768698e - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 21:10:15.842 1 INFO cinder.rpc [req-12447a4b-155f-46b7-8bb2-da4b5768698e - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 21:10:15.852 1 INFO cinder.rpc [req-12447a4b-155f-46b7-8bb2-da4b5768698e - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 21:10:15.861 1 INFO cinder.rpc [req-12447a4b-155f-46b7-8bb2-da4b5768698e - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 21:10:15.885 1 WARNING oslo_config.cfg [req-12447a4b-155f-46b7-8bb2-da4b5768698e - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 21:10:15.887 1 WARNING oslo_config.cfg [req-12447a4b-155f-46b7-8bb2-da4b5768698e - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:10:15.887 1 WARNING oslo_config.cfg [req-12447a4b-155f-46b7-8bb2-da4b5768698e - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:10:15.888 1 WARNING oslo_config.cfg [req-12447a4b-155f-46b7-8bb2-da4b5768698e - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:10:15.893 1 WARNING oslo_config.cfg [req-12447a4b-155f-46b7-8bb2-da4b5768698e - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 21:10:15.894 1 WARNING oslo_config.cfg [req-12447a4b-155f-46b7-8bb2-da4b5768698e - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 21:10:15.896 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 21:10:15.905 1 INFO cinder.manager [req-fb0cf39c-36ae-46d4-ad10-e2f16b282ad6 - - - - -] Initiating service 5 cleanup
>2018-06-25 21:10:15.912 1 INFO cinder.manager [req-fb0cf39c-36ae-46d4-ad10-e2f16b282ad6 - - - - -] Service 5 cleanup completed.
>2018-06-25 21:12:27.090 1 ERROR oslo.messaging._drivers.impl_rabbit [req-fb0cf39c-36ae-46d4-ad10-e2f16b282ad6 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:12:27.092 1 ERROR oslo.messaging._drivers.impl_rabbit [req-fb0cf39c-36ae-46d4-ad10-e2f16b282ad6 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:12:27.092 1 ERROR oslo_service.service [req-fb0cf39c-36ae-46d4-ad10-e2f16b282ad6 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:12:27.092 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 21:12:27.092 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 21:12:27.092 1 ERROR oslo_service.service     service.start()
>2018-06-25 21:12:27.092 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 21:12:27.092 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 21:12:27.092 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 21:12:27.092 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 21:12:27.092 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 21:12:27.092 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 21:12:27.092 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 21:12:27.092 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 21:12:27.092 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 21:12:27.092 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 21:12:27.092 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 21:12:27.092 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 21:12:27.092 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 21:12:27.092 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 21:12:27.092 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 21:12:27.092 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 21:12:27.092 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 21:12:27.092 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 21:12:27.092 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 21:12:27.092 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 21:12:27.092 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 21:12:27.092 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 21:12:27.092 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:12:27.092 1 ERROR oslo_service.service 
>2018-06-25 21:12:27.096 1 CRITICAL cinder [req-12447a4b-155f-46b7-8bb2-da4b5768698e - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 21:12:27.096 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 21:12:27.096 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 21:12:27.096 1 ERROR cinder     sys.exit(main())
>2018-06-25 21:12:27.096 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 21:12:27.096 1 ERROR cinder     service.wait()
>2018-06-25 21:12:27.096 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 21:12:27.096 1 ERROR cinder     _launcher.wait()
>2018-06-25 21:12:27.096 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 21:12:27.096 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 21:12:27.096 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 21:12:27.096 1 ERROR cinder     self.services.wait()
>2018-06-25 21:12:27.096 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 21:12:27.096 1 ERROR cinder     service.wait()
>2018-06-25 21:12:27.096 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 21:12:27.096 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 21:12:27.096 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 21:12:27.096 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 21:12:27.096 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 21:12:27.096 1 ERROR cinder     post_fn = fn()
>2018-06-25 21:12:27.096 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 21:12:27.096 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 21:12:27.096 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 21:12:27.096 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 21:12:27.096 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 21:12:27.096 1 ERROR cinder 
>2018-06-25 21:12:29.901 1 WARNING cinder.scheduler.host_manager [req-8ffc03fa-f6ab-4b09-9aea-6cabf09fc80f - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 21:12:29.908 1 INFO cinder.rpc [req-8ffc03fa-f6ab-4b09-9aea-6cabf09fc80f - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 21:12:29.914 1 INFO cinder.rpc [req-8ffc03fa-f6ab-4b09-9aea-6cabf09fc80f - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 21:12:29.928 1 INFO cinder.rpc [req-8ffc03fa-f6ab-4b09-9aea-6cabf09fc80f - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 21:12:29.935 1 INFO cinder.rpc [req-8ffc03fa-f6ab-4b09-9aea-6cabf09fc80f - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 21:12:29.962 1 WARNING oslo_config.cfg [req-8ffc03fa-f6ab-4b09-9aea-6cabf09fc80f - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 21:12:29.965 1 WARNING oslo_config.cfg [req-8ffc03fa-f6ab-4b09-9aea-6cabf09fc80f - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:12:29.965 1 WARNING oslo_config.cfg [req-8ffc03fa-f6ab-4b09-9aea-6cabf09fc80f - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:12:29.966 1 WARNING oslo_config.cfg [req-8ffc03fa-f6ab-4b09-9aea-6cabf09fc80f - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:12:29.972 1 WARNING oslo_config.cfg [req-8ffc03fa-f6ab-4b09-9aea-6cabf09fc80f - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 21:12:29.973 1 WARNING oslo_config.cfg [req-8ffc03fa-f6ab-4b09-9aea-6cabf09fc80f - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 21:12:29.978 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 21:12:29.986 1 INFO cinder.manager [req-30db19e3-8ff1-4c99-bf41-497e8032a7e1 - - - - -] Initiating service 5 cleanup
>2018-06-25 21:12:29.991 1 INFO cinder.manager [req-30db19e3-8ff1-4c99-bf41-497e8032a7e1 - - - - -] Service 5 cleanup completed.
>2018-06-25 21:14:42.006 1 ERROR oslo.messaging._drivers.impl_rabbit [req-30db19e3-8ff1-4c99-bf41-497e8032a7e1 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:14:42.008 1 ERROR oslo.messaging._drivers.impl_rabbit [req-30db19e3-8ff1-4c99-bf41-497e8032a7e1 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:14:42.008 1 ERROR oslo_service.service [req-30db19e3-8ff1-4c99-bf41-497e8032a7e1 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:14:42.008 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 21:14:42.008 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 21:14:42.008 1 ERROR oslo_service.service     service.start()
>2018-06-25 21:14:42.008 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 21:14:42.008 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 21:14:42.008 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 21:14:42.008 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 21:14:42.008 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 21:14:42.008 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 21:14:42.008 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 21:14:42.008 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 21:14:42.008 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 21:14:42.008 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 21:14:42.008 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 21:14:42.008 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 21:14:42.008 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 21:14:42.008 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 21:14:42.008 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 21:14:42.008 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 21:14:42.008 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 21:14:42.008 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 21:14:42.008 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 21:14:42.008 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 21:14:42.008 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 21:14:42.008 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 21:14:42.008 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:14:42.008 1 ERROR oslo_service.service 
>2018-06-25 21:14:42.011 1 CRITICAL cinder [req-8ffc03fa-f6ab-4b09-9aea-6cabf09fc80f - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 21:14:42.011 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 21:14:42.011 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 21:14:42.011 1 ERROR cinder     sys.exit(main())
>2018-06-25 21:14:42.011 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 21:14:42.011 1 ERROR cinder     service.wait()
>2018-06-25 21:14:42.011 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 21:14:42.011 1 ERROR cinder     _launcher.wait()
>2018-06-25 21:14:42.011 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 21:14:42.011 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 21:14:42.011 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 21:14:42.011 1 ERROR cinder     self.services.wait()
>2018-06-25 21:14:42.011 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 21:14:42.011 1 ERROR cinder     service.wait()
>2018-06-25 21:14:42.011 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 21:14:42.011 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 21:14:42.011 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 21:14:42.011 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 21:14:42.011 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 21:14:42.011 1 ERROR cinder     post_fn = fn()
>2018-06-25 21:14:42.011 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 21:14:42.011 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 21:14:42.011 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 21:14:42.011 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 21:14:42.011 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 21:14:42.011 1 ERROR cinder 
>2018-06-25 21:14:44.679 1 WARNING cinder.scheduler.host_manager [req-527093c3-6b15-4043-ab63-d3405cd4541e - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 21:14:44.685 1 INFO cinder.rpc [req-527093c3-6b15-4043-ab63-d3405cd4541e - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 21:14:44.691 1 INFO cinder.rpc [req-527093c3-6b15-4043-ab63-d3405cd4541e - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 21:14:44.702 1 INFO cinder.rpc [req-527093c3-6b15-4043-ab63-d3405cd4541e - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 21:14:44.707 1 INFO cinder.rpc [req-527093c3-6b15-4043-ab63-d3405cd4541e - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 21:14:44.732 1 WARNING oslo_config.cfg [req-527093c3-6b15-4043-ab63-d3405cd4541e - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 21:14:44.734 1 WARNING oslo_config.cfg [req-527093c3-6b15-4043-ab63-d3405cd4541e - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:14:44.735 1 WARNING oslo_config.cfg [req-527093c3-6b15-4043-ab63-d3405cd4541e - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:14:44.735 1 WARNING oslo_config.cfg [req-527093c3-6b15-4043-ab63-d3405cd4541e - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:14:44.740 1 WARNING oslo_config.cfg [req-527093c3-6b15-4043-ab63-d3405cd4541e - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 21:14:44.741 1 WARNING oslo_config.cfg [req-527093c3-6b15-4043-ab63-d3405cd4541e - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 21:14:44.744 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 21:14:44.754 1 INFO cinder.manager [req-9df2bf18-0f4f-4a81-b3fc-3d3386451cb2 - - - - -] Initiating service 5 cleanup
>2018-06-25 21:14:44.762 1 INFO cinder.manager [req-9df2bf18-0f4f-4a81-b3fc-3d3386451cb2 - - - - -] Service 5 cleanup completed.
>2018-06-25 21:16:49.180 1 ERROR oslo.messaging._drivers.impl_rabbit [req-9df2bf18-0f4f-4a81-b3fc-3d3386451cb2 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:16:49.183 1 ERROR oslo.messaging._drivers.impl_rabbit [req-9df2bf18-0f4f-4a81-b3fc-3d3386451cb2 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:16:49.183 1 ERROR oslo_service.service [req-9df2bf18-0f4f-4a81-b3fc-3d3386451cb2 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:16:49.183 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 21:16:49.183 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 21:16:49.183 1 ERROR oslo_service.service     service.start()
>2018-06-25 21:16:49.183 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 21:16:49.183 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 21:16:49.183 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 21:16:49.183 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 21:16:49.183 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 21:16:49.183 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 21:16:49.183 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 21:16:49.183 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 21:16:49.183 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 21:16:49.183 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 21:16:49.183 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 21:16:49.183 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 21:16:49.183 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 21:16:49.183 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 21:16:49.183 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 21:16:49.183 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 21:16:49.183 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 21:16:49.183 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 21:16:49.183 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 21:16:49.183 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 21:16:49.183 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 21:16:49.183 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 21:16:49.183 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:16:49.183 1 ERROR oslo_service.service 
>2018-06-25 21:16:49.187 1 CRITICAL cinder [req-527093c3-6b15-4043-ab63-d3405cd4541e - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 21:16:49.187 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 21:16:49.187 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 21:16:49.187 1 ERROR cinder     sys.exit(main())
>2018-06-25 21:16:49.187 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 21:16:49.187 1 ERROR cinder     service.wait()
>2018-06-25 21:16:49.187 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 21:16:49.187 1 ERROR cinder     _launcher.wait()
>2018-06-25 21:16:49.187 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 21:16:49.187 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 21:16:49.187 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 21:16:49.187 1 ERROR cinder     self.services.wait()
>2018-06-25 21:16:49.187 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 21:16:49.187 1 ERROR cinder     service.wait()
>2018-06-25 21:16:49.187 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 21:16:49.187 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 21:16:49.187 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 21:16:49.187 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 21:16:49.187 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 21:16:49.187 1 ERROR cinder     post_fn = fn()
>2018-06-25 21:16:49.187 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 21:16:49.187 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 21:16:49.187 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 21:16:49.187 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 21:16:49.187 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 21:16:49.187 1 ERROR cinder 
>2018-06-25 21:16:52.019 1 WARNING cinder.scheduler.host_manager [req-0470e037-9a49-4c90-81d2-bb260d0cdd15 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 21:16:52.028 1 INFO cinder.rpc [req-0470e037-9a49-4c90-81d2-bb260d0cdd15 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 21:16:52.038 1 INFO cinder.rpc [req-0470e037-9a49-4c90-81d2-bb260d0cdd15 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 21:16:52.055 1 INFO cinder.rpc [req-0470e037-9a49-4c90-81d2-bb260d0cdd15 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 21:16:52.062 1 INFO cinder.rpc [req-0470e037-9a49-4c90-81d2-bb260d0cdd15 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 21:16:52.090 1 WARNING oslo_config.cfg [req-0470e037-9a49-4c90-81d2-bb260d0cdd15 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 21:16:52.093 1 WARNING oslo_config.cfg [req-0470e037-9a49-4c90-81d2-bb260d0cdd15 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:16:52.093 1 WARNING oslo_config.cfg [req-0470e037-9a49-4c90-81d2-bb260d0cdd15 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:16:52.094 1 WARNING oslo_config.cfg [req-0470e037-9a49-4c90-81d2-bb260d0cdd15 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:16:52.099 1 WARNING oslo_config.cfg [req-0470e037-9a49-4c90-81d2-bb260d0cdd15 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 21:16:52.100 1 WARNING oslo_config.cfg [req-0470e037-9a49-4c90-81d2-bb260d0cdd15 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 21:16:52.103 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 21:16:52.113 1 INFO cinder.manager [req-7ce3cfa6-2c54-40fd-b8f0-21dbd1f12335 - - - - -] Initiating service 5 cleanup
>2018-06-25 21:16:52.130 1 INFO cinder.manager [req-7ce3cfa6-2c54-40fd-b8f0-21dbd1f12335 - - - - -] Service 5 cleanup completed.
>2018-06-25 21:19:04.606 1 ERROR oslo.messaging._drivers.impl_rabbit [req-7ce3cfa6-2c54-40fd-b8f0-21dbd1f12335 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:19:04.608 1 ERROR oslo.messaging._drivers.impl_rabbit [req-7ce3cfa6-2c54-40fd-b8f0-21dbd1f12335 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:19:04.609 1 ERROR oslo_service.service [req-7ce3cfa6-2c54-40fd-b8f0-21dbd1f12335 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:19:04.609 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 21:19:04.609 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 21:19:04.609 1 ERROR oslo_service.service     service.start()
>2018-06-25 21:19:04.609 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 21:19:04.609 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 21:19:04.609 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 21:19:04.609 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 21:19:04.609 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 21:19:04.609 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 21:19:04.609 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 21:19:04.609 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 21:19:04.609 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 21:19:04.609 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 21:19:04.609 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 21:19:04.609 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 21:19:04.609 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 21:19:04.609 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 21:19:04.609 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 21:19:04.609 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 21:19:04.609 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 21:19:04.609 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 21:19:04.609 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 21:19:04.609 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 21:19:04.609 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 21:19:04.609 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 21:19:04.609 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:19:04.609 1 ERROR oslo_service.service 
>2018-06-25 21:19:04.612 1 CRITICAL cinder [req-0470e037-9a49-4c90-81d2-bb260d0cdd15 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 21:19:04.612 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 21:19:04.612 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 21:19:04.612 1 ERROR cinder     sys.exit(main())
>2018-06-25 21:19:04.612 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 21:19:04.612 1 ERROR cinder     service.wait()
>2018-06-25 21:19:04.612 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 21:19:04.612 1 ERROR cinder     _launcher.wait()
>2018-06-25 21:19:04.612 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 21:19:04.612 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 21:19:04.612 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 21:19:04.612 1 ERROR cinder     self.services.wait()
>2018-06-25 21:19:04.612 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 21:19:04.612 1 ERROR cinder     service.wait()
>2018-06-25 21:19:04.612 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 21:19:04.612 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 21:19:04.612 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 21:19:04.612 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 21:19:04.612 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 21:19:04.612 1 ERROR cinder     post_fn = fn()
>2018-06-25 21:19:04.612 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 21:19:04.612 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 21:19:04.612 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 21:19:04.612 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 21:19:04.612 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 21:19:04.612 1 ERROR cinder 
>2018-06-25 21:19:07.301 1 WARNING cinder.scheduler.host_manager [req-f92aea3c-780d-4479-9e3d-108a0dfd48b4 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 21:19:07.307 1 INFO cinder.rpc [req-f92aea3c-780d-4479-9e3d-108a0dfd48b4 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 21:19:07.313 1 INFO cinder.rpc [req-f92aea3c-780d-4479-9e3d-108a0dfd48b4 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 21:19:07.327 1 INFO cinder.rpc [req-f92aea3c-780d-4479-9e3d-108a0dfd48b4 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 21:19:07.336 1 INFO cinder.rpc [req-f92aea3c-780d-4479-9e3d-108a0dfd48b4 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 21:19:07.364 1 WARNING oslo_config.cfg [req-f92aea3c-780d-4479-9e3d-108a0dfd48b4 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 21:19:07.366 1 WARNING oslo_config.cfg [req-f92aea3c-780d-4479-9e3d-108a0dfd48b4 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:19:07.366 1 WARNING oslo_config.cfg [req-f92aea3c-780d-4479-9e3d-108a0dfd48b4 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:19:07.367 1 WARNING oslo_config.cfg [req-f92aea3c-780d-4479-9e3d-108a0dfd48b4 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:19:07.372 1 WARNING oslo_config.cfg [req-f92aea3c-780d-4479-9e3d-108a0dfd48b4 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 21:19:07.374 1 WARNING oslo_config.cfg [req-f92aea3c-780d-4479-9e3d-108a0dfd48b4 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 21:19:07.377 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 21:19:07.384 1 INFO cinder.manager [req-d61c957a-e185-47cf-8221-2e658f5b4974 - - - - -] Initiating service 5 cleanup
>2018-06-25 21:19:07.389 1 INFO cinder.manager [req-d61c957a-e185-47cf-8221-2e658f5b4974 - - - - -] Service 5 cleanup completed.
>2018-06-25 21:21:13.518 1 ERROR oslo.messaging._drivers.impl_rabbit [req-d61c957a-e185-47cf-8221-2e658f5b4974 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:21:13.520 1 ERROR oslo.messaging._drivers.impl_rabbit [req-d61c957a-e185-47cf-8221-2e658f5b4974 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:21:13.520 1 ERROR oslo_service.service [req-d61c957a-e185-47cf-8221-2e658f5b4974 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:21:13.520 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 21:21:13.520 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 21:21:13.520 1 ERROR oslo_service.service     service.start()
>2018-06-25 21:21:13.520 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 21:21:13.520 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 21:21:13.520 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 21:21:13.520 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 21:21:13.520 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 21:21:13.520 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 21:21:13.520 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 21:21:13.520 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 21:21:13.520 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 21:21:13.520 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 21:21:13.520 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 21:21:13.520 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 21:21:13.520 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 21:21:13.520 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 21:21:13.520 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 21:21:13.520 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 21:21:13.520 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 21:21:13.520 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 21:21:13.520 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 21:21:13.520 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 21:21:13.520 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 21:21:13.520 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 21:21:13.520 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:21:13.520 1 ERROR oslo_service.service 
>2018-06-25 21:21:13.523 1 CRITICAL cinder [req-f92aea3c-780d-4479-9e3d-108a0dfd48b4 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 21:21:13.523 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 21:21:13.523 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 21:21:13.523 1 ERROR cinder     sys.exit(main())
>2018-06-25 21:21:13.523 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 21:21:13.523 1 ERROR cinder     service.wait()
>2018-06-25 21:21:13.523 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 21:21:13.523 1 ERROR cinder     _launcher.wait()
>2018-06-25 21:21:13.523 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 21:21:13.523 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 21:21:13.523 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 21:21:13.523 1 ERROR cinder     self.services.wait()
>2018-06-25 21:21:13.523 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 21:21:13.523 1 ERROR cinder     service.wait()
>2018-06-25 21:21:13.523 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 21:21:13.523 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 21:21:13.523 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 21:21:13.523 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 21:21:13.523 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 21:21:13.523 1 ERROR cinder     post_fn = fn()
>2018-06-25 21:21:13.523 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 21:21:13.523 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 21:21:13.523 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 21:21:13.523 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 21:21:13.523 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 21:21:13.523 1 ERROR cinder 
>2018-06-25 21:21:16.140 1 WARNING cinder.scheduler.host_manager [req-810d0a3e-b55e-4226-adbb-a9c95086a625 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 21:21:16.146 1 INFO cinder.rpc [req-810d0a3e-b55e-4226-adbb-a9c95086a625 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 21:21:16.151 1 INFO cinder.rpc [req-810d0a3e-b55e-4226-adbb-a9c95086a625 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 21:21:16.163 1 INFO cinder.rpc [req-810d0a3e-b55e-4226-adbb-a9c95086a625 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 21:21:16.172 1 INFO cinder.rpc [req-810d0a3e-b55e-4226-adbb-a9c95086a625 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 21:21:16.195 1 WARNING oslo_config.cfg [req-810d0a3e-b55e-4226-adbb-a9c95086a625 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 21:21:16.197 1 WARNING oslo_config.cfg [req-810d0a3e-b55e-4226-adbb-a9c95086a625 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:21:16.198 1 WARNING oslo_config.cfg [req-810d0a3e-b55e-4226-adbb-a9c95086a625 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:21:16.198 1 WARNING oslo_config.cfg [req-810d0a3e-b55e-4226-adbb-a9c95086a625 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:21:16.203 1 WARNING oslo_config.cfg [req-810d0a3e-b55e-4226-adbb-a9c95086a625 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 21:21:16.205 1 WARNING oslo_config.cfg [req-810d0a3e-b55e-4226-adbb-a9c95086a625 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 21:21:16.207 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 21:21:16.214 1 INFO cinder.manager [req-69a04f61-21be-4954-9861-ee35f4d63eb0 - - - - -] Initiating service 5 cleanup
>2018-06-25 21:21:16.219 1 INFO cinder.manager [req-69a04f61-21be-4954-9861-ee35f4d63eb0 - - - - -] Service 5 cleanup completed.
>2018-06-25 21:23:28.047 1 ERROR oslo.messaging._drivers.impl_rabbit [req-69a04f61-21be-4954-9861-ee35f4d63eb0 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:23:28.049 1 ERROR oslo.messaging._drivers.impl_rabbit [req-69a04f61-21be-4954-9861-ee35f4d63eb0 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:23:28.050 1 ERROR oslo_service.service [req-69a04f61-21be-4954-9861-ee35f4d63eb0 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:23:28.050 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 21:23:28.050 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 21:23:28.050 1 ERROR oslo_service.service     service.start()
>2018-06-25 21:23:28.050 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 21:23:28.050 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 21:23:28.050 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 21:23:28.050 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 21:23:28.050 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 21:23:28.050 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 21:23:28.050 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 21:23:28.050 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 21:23:28.050 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 21:23:28.050 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 21:23:28.050 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 21:23:28.050 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 21:23:28.050 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 21:23:28.050 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 21:23:28.050 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 21:23:28.050 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 21:23:28.050 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 21:23:28.050 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 21:23:28.050 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 21:23:28.050 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 21:23:28.050 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 21:23:28.050 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 21:23:28.050 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:23:28.050 1 ERROR oslo_service.service 
>2018-06-25 21:23:28.053 1 CRITICAL cinder [req-810d0a3e-b55e-4226-adbb-a9c95086a625 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 21:23:28.053 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 21:23:28.053 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 21:23:28.053 1 ERROR cinder     sys.exit(main())
>2018-06-25 21:23:28.053 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 21:23:28.053 1 ERROR cinder     service.wait()
>2018-06-25 21:23:28.053 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 21:23:28.053 1 ERROR cinder     _launcher.wait()
>2018-06-25 21:23:28.053 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 21:23:28.053 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 21:23:28.053 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 21:23:28.053 1 ERROR cinder     self.services.wait()
>2018-06-25 21:23:28.053 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 21:23:28.053 1 ERROR cinder     service.wait()
>2018-06-25 21:23:28.053 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 21:23:28.053 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 21:23:28.053 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 21:23:28.053 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 21:23:28.053 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 21:23:28.053 1 ERROR cinder     post_fn = fn()
>2018-06-25 21:23:28.053 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 21:23:28.053 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 21:23:28.053 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 21:23:28.053 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 21:23:28.053 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 21:23:28.053 1 ERROR cinder 
>2018-06-25 21:23:30.751 1 WARNING cinder.scheduler.host_manager [req-cae32004-ffa0-45aa-b590-6f36a365bf48 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 21:23:30.757 1 INFO cinder.rpc [req-cae32004-ffa0-45aa-b590-6f36a365bf48 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 21:23:30.763 1 INFO cinder.rpc [req-cae32004-ffa0-45aa-b590-6f36a365bf48 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 21:23:30.775 1 INFO cinder.rpc [req-cae32004-ffa0-45aa-b590-6f36a365bf48 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 21:23:30.782 1 INFO cinder.rpc [req-cae32004-ffa0-45aa-b590-6f36a365bf48 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 21:23:30.809 1 WARNING oslo_config.cfg [req-cae32004-ffa0-45aa-b590-6f36a365bf48 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 21:23:30.811 1 WARNING oslo_config.cfg [req-cae32004-ffa0-45aa-b590-6f36a365bf48 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:23:30.811 1 WARNING oslo_config.cfg [req-cae32004-ffa0-45aa-b590-6f36a365bf48 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:23:30.812 1 WARNING oslo_config.cfg [req-cae32004-ffa0-45aa-b590-6f36a365bf48 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:23:30.817 1 WARNING oslo_config.cfg [req-cae32004-ffa0-45aa-b590-6f36a365bf48 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 21:23:30.818 1 WARNING oslo_config.cfg [req-cae32004-ffa0-45aa-b590-6f36a365bf48 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 21:23:30.821 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 21:23:30.827 1 INFO cinder.manager [req-8089ea61-e1ea-4e74-a5c1-0fafa75d50d3 - - - - -] Initiating service 5 cleanup
>2018-06-25 21:23:30.832 1 INFO cinder.manager [req-8089ea61-e1ea-4e74-a5c1-0fafa75d50d3 - - - - -] Service 5 cleanup completed.
>2018-06-25 21:25:42.776 1 ERROR oslo.messaging._drivers.impl_rabbit [req-8089ea61-e1ea-4e74-a5c1-0fafa75d50d3 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:25:42.778 1 ERROR oslo.messaging._drivers.impl_rabbit [req-8089ea61-e1ea-4e74-a5c1-0fafa75d50d3 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:25:42.778 1 ERROR oslo_service.service [req-8089ea61-e1ea-4e74-a5c1-0fafa75d50d3 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:25:42.778 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 21:25:42.778 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 21:25:42.778 1 ERROR oslo_service.service     service.start()
>2018-06-25 21:25:42.778 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 21:25:42.778 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 21:25:42.778 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 21:25:42.778 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 21:25:42.778 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 21:25:42.778 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 21:25:42.778 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 21:25:42.778 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 21:25:42.778 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 21:25:42.778 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 21:25:42.778 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 21:25:42.778 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 21:25:42.778 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 21:25:42.778 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 21:25:42.778 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 21:25:42.778 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 21:25:42.778 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 21:25:42.778 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 21:25:42.778 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 21:25:42.778 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 21:25:42.778 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 21:25:42.778 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 21:25:42.778 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:25:42.778 1 ERROR oslo_service.service 
>2018-06-25 21:25:42.781 1 CRITICAL cinder [req-cae32004-ffa0-45aa-b590-6f36a365bf48 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 21:25:42.781 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 21:25:42.781 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 21:25:42.781 1 ERROR cinder     sys.exit(main())
>2018-06-25 21:25:42.781 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 21:25:42.781 1 ERROR cinder     service.wait()
>2018-06-25 21:25:42.781 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 21:25:42.781 1 ERROR cinder     _launcher.wait()
>2018-06-25 21:25:42.781 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 21:25:42.781 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 21:25:42.781 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 21:25:42.781 1 ERROR cinder     self.services.wait()
>2018-06-25 21:25:42.781 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 21:25:42.781 1 ERROR cinder     service.wait()
>2018-06-25 21:25:42.781 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 21:25:42.781 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 21:25:42.781 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 21:25:42.781 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 21:25:42.781 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 21:25:42.781 1 ERROR cinder     post_fn = fn()
>2018-06-25 21:25:42.781 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 21:25:42.781 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 21:25:42.781 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 21:25:42.781 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 21:25:42.781 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 21:25:42.781 1 ERROR cinder 
>2018-06-25 21:25:45.411 1 WARNING cinder.scheduler.host_manager [req-a6ce3917-53d8-41d4-beac-29caa56e79e1 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 21:25:45.418 1 INFO cinder.rpc [req-a6ce3917-53d8-41d4-beac-29caa56e79e1 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 21:25:45.423 1 INFO cinder.rpc [req-a6ce3917-53d8-41d4-beac-29caa56e79e1 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 21:25:45.438 1 INFO cinder.rpc [req-a6ce3917-53d8-41d4-beac-29caa56e79e1 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 21:25:45.443 1 INFO cinder.rpc [req-a6ce3917-53d8-41d4-beac-29caa56e79e1 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 21:25:45.466 1 WARNING oslo_config.cfg [req-a6ce3917-53d8-41d4-beac-29caa56e79e1 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 21:25:45.469 1 WARNING oslo_config.cfg [req-a6ce3917-53d8-41d4-beac-29caa56e79e1 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:25:45.469 1 WARNING oslo_config.cfg [req-a6ce3917-53d8-41d4-beac-29caa56e79e1 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:25:45.470 1 WARNING oslo_config.cfg [req-a6ce3917-53d8-41d4-beac-29caa56e79e1 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:25:45.475 1 WARNING oslo_config.cfg [req-a6ce3917-53d8-41d4-beac-29caa56e79e1 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 21:25:45.476 1 WARNING oslo_config.cfg [req-a6ce3917-53d8-41d4-beac-29caa56e79e1 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 21:25:45.479 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 21:25:45.484 1 INFO cinder.manager [req-1d21449d-c7f8-4811-b014-73d86c7a4cd5 - - - - -] Initiating service 5 cleanup
>2018-06-25 21:25:45.489 1 INFO cinder.manager [req-1d21449d-c7f8-4811-b014-73d86c7a4cd5 - - - - -] Service 5 cleanup completed.
>2018-06-25 21:27:51.533 1 ERROR oslo.messaging._drivers.impl_rabbit [req-1d21449d-c7f8-4811-b014-73d86c7a4cd5 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:27:51.535 1 ERROR oslo.messaging._drivers.impl_rabbit [req-1d21449d-c7f8-4811-b014-73d86c7a4cd5 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:27:51.535 1 ERROR oslo_service.service [req-1d21449d-c7f8-4811-b014-73d86c7a4cd5 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:27:51.535 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 21:27:51.535 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 21:27:51.535 1 ERROR oslo_service.service     service.start()
>2018-06-25 21:27:51.535 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 21:27:51.535 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 21:27:51.535 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 21:27:51.535 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 21:27:51.535 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 21:27:51.535 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 21:27:51.535 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 21:27:51.535 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 21:27:51.535 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 21:27:51.535 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 21:27:51.535 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 21:27:51.535 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 21:27:51.535 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 21:27:51.535 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 21:27:51.535 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 21:27:51.535 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 21:27:51.535 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 21:27:51.535 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 21:27:51.535 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 21:27:51.535 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 21:27:51.535 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 21:27:51.535 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 21:27:51.535 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:27:51.535 1 ERROR oslo_service.service 
>2018-06-25 21:27:51.538 1 CRITICAL cinder [req-a6ce3917-53d8-41d4-beac-29caa56e79e1 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 21:27:51.538 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 21:27:51.538 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 21:27:51.538 1 ERROR cinder     sys.exit(main())
>2018-06-25 21:27:51.538 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 21:27:51.538 1 ERROR cinder     service.wait()
>2018-06-25 21:27:51.538 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 21:27:51.538 1 ERROR cinder     _launcher.wait()
>2018-06-25 21:27:51.538 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 21:27:51.538 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 21:27:51.538 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 21:27:51.538 1 ERROR cinder     self.services.wait()
>2018-06-25 21:27:51.538 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 21:27:51.538 1 ERROR cinder     service.wait()
>2018-06-25 21:27:51.538 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 21:27:51.538 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 21:27:51.538 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 21:27:51.538 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 21:27:51.538 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 21:27:51.538 1 ERROR cinder     post_fn = fn()
>2018-06-25 21:27:51.538 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 21:27:51.538 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 21:27:51.538 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 21:27:51.538 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 21:27:51.538 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 21:27:51.538 1 ERROR cinder 
>2018-06-25 21:27:54.155 1 WARNING cinder.scheduler.host_manager [req-a29193c6-3893-4161-9e75-b68bd0ef5de4 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 21:27:54.161 1 INFO cinder.rpc [req-a29193c6-3893-4161-9e75-b68bd0ef5de4 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 21:27:54.167 1 INFO cinder.rpc [req-a29193c6-3893-4161-9e75-b68bd0ef5de4 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 21:27:54.179 1 INFO cinder.rpc [req-a29193c6-3893-4161-9e75-b68bd0ef5de4 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 21:27:54.184 1 INFO cinder.rpc [req-a29193c6-3893-4161-9e75-b68bd0ef5de4 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 21:27:54.211 1 WARNING oslo_config.cfg [req-a29193c6-3893-4161-9e75-b68bd0ef5de4 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 21:27:54.214 1 WARNING oslo_config.cfg [req-a29193c6-3893-4161-9e75-b68bd0ef5de4 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:27:54.214 1 WARNING oslo_config.cfg [req-a29193c6-3893-4161-9e75-b68bd0ef5de4 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:27:54.215 1 WARNING oslo_config.cfg [req-a29193c6-3893-4161-9e75-b68bd0ef5de4 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:27:54.220 1 WARNING oslo_config.cfg [req-a29193c6-3893-4161-9e75-b68bd0ef5de4 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 21:27:54.221 1 WARNING oslo_config.cfg [req-a29193c6-3893-4161-9e75-b68bd0ef5de4 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 21:27:54.224 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 21:27:54.230 1 INFO cinder.manager [req-723cb884-dd7d-4556-a20b-f888de1f0ca9 - - - - -] Initiating service 5 cleanup
>2018-06-25 21:27:54.234 1 INFO cinder.manager [req-723cb884-dd7d-4556-a20b-f888de1f0ca9 - - - - -] Service 5 cleanup completed.
>2018-06-25 21:29:58.665 1 ERROR oslo.messaging._drivers.impl_rabbit [req-723cb884-dd7d-4556-a20b-f888de1f0ca9 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:29:58.667 1 ERROR oslo.messaging._drivers.impl_rabbit [req-723cb884-dd7d-4556-a20b-f888de1f0ca9 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:29:58.667 1 ERROR oslo_service.service [req-723cb884-dd7d-4556-a20b-f888de1f0ca9 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:29:58.667 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 21:29:58.667 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 21:29:58.667 1 ERROR oslo_service.service     service.start()
>2018-06-25 21:29:58.667 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 21:29:58.667 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 21:29:58.667 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 21:29:58.667 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 21:29:58.667 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 21:29:58.667 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 21:29:58.667 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 21:29:58.667 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 21:29:58.667 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 21:29:58.667 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 21:29:58.667 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 21:29:58.667 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 21:29:58.667 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 21:29:58.667 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 21:29:58.667 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 21:29:58.667 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 21:29:58.667 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 21:29:58.667 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 21:29:58.667 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 21:29:58.667 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 21:29:58.667 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 21:29:58.667 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 21:29:58.667 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:29:58.667 1 ERROR oslo_service.service 
>2018-06-25 21:29:58.670 1 CRITICAL cinder [req-a29193c6-3893-4161-9e75-b68bd0ef5de4 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 21:29:58.670 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 21:29:58.670 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 21:29:58.670 1 ERROR cinder     sys.exit(main())
>2018-06-25 21:29:58.670 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 21:29:58.670 1 ERROR cinder     service.wait()
>2018-06-25 21:29:58.670 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 21:29:58.670 1 ERROR cinder     _launcher.wait()
>2018-06-25 21:29:58.670 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 21:29:58.670 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 21:29:58.670 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 21:29:58.670 1 ERROR cinder     self.services.wait()
>2018-06-25 21:29:58.670 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 21:29:58.670 1 ERROR cinder     service.wait()
>2018-06-25 21:29:58.670 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 21:29:58.670 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 21:29:58.670 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 21:29:58.670 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 21:29:58.670 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 21:29:58.670 1 ERROR cinder     post_fn = fn()
>2018-06-25 21:29:58.670 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 21:29:58.670 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 21:29:58.670 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 21:29:58.670 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 21:29:58.670 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 21:29:58.670 1 ERROR cinder 
>2018-06-25 21:30:01.462 1 WARNING cinder.scheduler.host_manager [req-85d01f50-df0d-426e-9413-fb1fc189a524 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 21:30:01.469 1 INFO cinder.rpc [req-85d01f50-df0d-426e-9413-fb1fc189a524 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 21:30:01.474 1 INFO cinder.rpc [req-85d01f50-df0d-426e-9413-fb1fc189a524 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 21:30:01.486 1 INFO cinder.rpc [req-85d01f50-df0d-426e-9413-fb1fc189a524 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 21:30:01.492 1 INFO cinder.rpc [req-85d01f50-df0d-426e-9413-fb1fc189a524 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 21:30:01.522 1 WARNING oslo_config.cfg [req-85d01f50-df0d-426e-9413-fb1fc189a524 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 21:30:01.525 1 WARNING oslo_config.cfg [req-85d01f50-df0d-426e-9413-fb1fc189a524 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:30:01.526 1 WARNING oslo_config.cfg [req-85d01f50-df0d-426e-9413-fb1fc189a524 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:30:01.526 1 WARNING oslo_config.cfg [req-85d01f50-df0d-426e-9413-fb1fc189a524 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:30:01.532 1 WARNING oslo_config.cfg [req-85d01f50-df0d-426e-9413-fb1fc189a524 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 21:30:01.533 1 WARNING oslo_config.cfg [req-85d01f50-df0d-426e-9413-fb1fc189a524 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 21:30:01.536 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 21:30:01.543 1 INFO cinder.manager [req-2b86e949-d9b3-45e7-8c37-c3ed903ec251 - - - - -] Initiating service 5 cleanup
>2018-06-25 21:30:01.547 1 INFO cinder.manager [req-2b86e949-d9b3-45e7-8c37-c3ed903ec251 - - - - -] Service 5 cleanup completed.
>2018-06-25 21:32:13.722 1 ERROR oslo.messaging._drivers.impl_rabbit [req-2b86e949-d9b3-45e7-8c37-c3ed903ec251 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:32:13.725 1 ERROR oslo.messaging._drivers.impl_rabbit [req-2b86e949-d9b3-45e7-8c37-c3ed903ec251 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:32:13.725 1 ERROR oslo_service.service [req-2b86e949-d9b3-45e7-8c37-c3ed903ec251 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:32:13.725 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 21:32:13.725 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 21:32:13.725 1 ERROR oslo_service.service     service.start()
>2018-06-25 21:32:13.725 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 21:32:13.725 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 21:32:13.725 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 21:32:13.725 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 21:32:13.725 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 21:32:13.725 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 21:32:13.725 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 21:32:13.725 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 21:32:13.725 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 21:32:13.725 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 21:32:13.725 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 21:32:13.725 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 21:32:13.725 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 21:32:13.725 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 21:32:13.725 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 21:32:13.725 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 21:32:13.725 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 21:32:13.725 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 21:32:13.725 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 21:32:13.725 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 21:32:13.725 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 21:32:13.725 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 21:32:13.725 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:32:13.725 1 ERROR oslo_service.service 
>2018-06-25 21:32:13.729 1 CRITICAL cinder [req-85d01f50-df0d-426e-9413-fb1fc189a524 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 21:32:13.729 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 21:32:13.729 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 21:32:13.729 1 ERROR cinder     sys.exit(main())
>2018-06-25 21:32:13.729 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 21:32:13.729 1 ERROR cinder     service.wait()
>2018-06-25 21:32:13.729 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 21:32:13.729 1 ERROR cinder     _launcher.wait()
>2018-06-25 21:32:13.729 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 21:32:13.729 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 21:32:13.729 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 21:32:13.729 1 ERROR cinder     self.services.wait()
>2018-06-25 21:32:13.729 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 21:32:13.729 1 ERROR cinder     service.wait()
>2018-06-25 21:32:13.729 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 21:32:13.729 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 21:32:13.729 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 21:32:13.729 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 21:32:13.729 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 21:32:13.729 1 ERROR cinder     post_fn = fn()
>2018-06-25 21:32:13.729 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 21:32:13.729 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 21:32:13.729 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 21:32:13.729 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 21:32:13.729 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 21:32:13.729 1 ERROR cinder 
>2018-06-25 21:32:16.434 1 WARNING cinder.scheduler.host_manager [req-b37735a1-be6e-4daf-aec6-1ecbaf3e3785 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 21:32:16.439 1 INFO cinder.rpc [req-b37735a1-be6e-4daf-aec6-1ecbaf3e3785 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 21:32:16.444 1 INFO cinder.rpc [req-b37735a1-be6e-4daf-aec6-1ecbaf3e3785 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 21:32:16.456 1 INFO cinder.rpc [req-b37735a1-be6e-4daf-aec6-1ecbaf3e3785 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 21:32:16.462 1 INFO cinder.rpc [req-b37735a1-be6e-4daf-aec6-1ecbaf3e3785 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 21:32:16.484 1 WARNING oslo_config.cfg [req-b37735a1-be6e-4daf-aec6-1ecbaf3e3785 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 21:32:16.486 1 WARNING oslo_config.cfg [req-b37735a1-be6e-4daf-aec6-1ecbaf3e3785 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:32:16.487 1 WARNING oslo_config.cfg [req-b37735a1-be6e-4daf-aec6-1ecbaf3e3785 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:32:16.487 1 WARNING oslo_config.cfg [req-b37735a1-be6e-4daf-aec6-1ecbaf3e3785 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:32:16.492 1 WARNING oslo_config.cfg [req-b37735a1-be6e-4daf-aec6-1ecbaf3e3785 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 21:32:16.494 1 WARNING oslo_config.cfg [req-b37735a1-be6e-4daf-aec6-1ecbaf3e3785 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 21:32:16.496 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 21:32:16.502 1 INFO cinder.manager [req-e8f81b3a-23a9-4b98-93ad-375af525d0ca - - - - -] Initiating service 5 cleanup
>2018-06-25 21:32:16.507 1 INFO cinder.manager [req-e8f81b3a-23a9-4b98-93ad-375af525d0ca - - - - -] Service 5 cleanup completed.
>2018-06-25 21:34:28.717 1 ERROR oslo.messaging._drivers.impl_rabbit [req-e8f81b3a-23a9-4b98-93ad-375af525d0ca - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:34:28.719 1 ERROR oslo.messaging._drivers.impl_rabbit [req-e8f81b3a-23a9-4b98-93ad-375af525d0ca - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:34:28.719 1 ERROR oslo_service.service [req-e8f81b3a-23a9-4b98-93ad-375af525d0ca - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:34:28.719 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 21:34:28.719 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 21:34:28.719 1 ERROR oslo_service.service     service.start()
>2018-06-25 21:34:28.719 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 21:34:28.719 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 21:34:28.719 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 21:34:28.719 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 21:34:28.719 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 21:34:28.719 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 21:34:28.719 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 21:34:28.719 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 21:34:28.719 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 21:34:28.719 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 21:34:28.719 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 21:34:28.719 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 21:34:28.719 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 21:34:28.719 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 21:34:28.719 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 21:34:28.719 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 21:34:28.719 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 21:34:28.719 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 21:34:28.719 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 21:34:28.719 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 21:34:28.719 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 21:34:28.719 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 21:34:28.719 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:34:28.719 1 ERROR oslo_service.service 
>2018-06-25 21:34:28.722 1 CRITICAL cinder [req-b37735a1-be6e-4daf-aec6-1ecbaf3e3785 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 21:34:28.722 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 21:34:28.722 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 21:34:28.722 1 ERROR cinder     sys.exit(main())
>2018-06-25 21:34:28.722 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 21:34:28.722 1 ERROR cinder     service.wait()
>2018-06-25 21:34:28.722 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 21:34:28.722 1 ERROR cinder     _launcher.wait()
>2018-06-25 21:34:28.722 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 21:34:28.722 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 21:34:28.722 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 21:34:28.722 1 ERROR cinder     self.services.wait()
>2018-06-25 21:34:28.722 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 21:34:28.722 1 ERROR cinder     service.wait()
>2018-06-25 21:34:28.722 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 21:34:28.722 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 21:34:28.722 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 21:34:28.722 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 21:34:28.722 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 21:34:28.722 1 ERROR cinder     post_fn = fn()
>2018-06-25 21:34:28.722 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 21:34:28.722 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 21:34:28.722 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 21:34:28.722 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 21:34:28.722 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 21:34:28.722 1 ERROR cinder 
>2018-06-25 21:34:31.332 1 WARNING cinder.scheduler.host_manager [req-5142274b-9f6f-421a-a068-14af619c04d7 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 21:34:31.341 1 INFO cinder.rpc [req-5142274b-9f6f-421a-a068-14af619c04d7 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 21:34:31.346 1 INFO cinder.rpc [req-5142274b-9f6f-421a-a068-14af619c04d7 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 21:34:31.361 1 INFO cinder.rpc [req-5142274b-9f6f-421a-a068-14af619c04d7 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 21:34:31.367 1 INFO cinder.rpc [req-5142274b-9f6f-421a-a068-14af619c04d7 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 21:34:31.395 1 WARNING oslo_config.cfg [req-5142274b-9f6f-421a-a068-14af619c04d7 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 21:34:31.397 1 WARNING oslo_config.cfg [req-5142274b-9f6f-421a-a068-14af619c04d7 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:34:31.398 1 WARNING oslo_config.cfg [req-5142274b-9f6f-421a-a068-14af619c04d7 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:34:31.398 1 WARNING oslo_config.cfg [req-5142274b-9f6f-421a-a068-14af619c04d7 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:34:31.404 1 WARNING oslo_config.cfg [req-5142274b-9f6f-421a-a068-14af619c04d7 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 21:34:31.405 1 WARNING oslo_config.cfg [req-5142274b-9f6f-421a-a068-14af619c04d7 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 21:34:31.408 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 21:34:31.416 1 INFO cinder.manager [req-6d7a8ff0-3339-41b1-a9eb-54d1b06aeeee - - - - -] Initiating service 5 cleanup
>2018-06-25 21:34:31.422 1 INFO cinder.manager [req-6d7a8ff0-3339-41b1-a9eb-54d1b06aeeee - - - - -] Service 5 cleanup completed.
>2018-06-25 21:36:37.505 1 ERROR oslo.messaging._drivers.impl_rabbit [req-6d7a8ff0-3339-41b1-a9eb-54d1b06aeeee - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:36:37.507 1 ERROR oslo.messaging._drivers.impl_rabbit [req-6d7a8ff0-3339-41b1-a9eb-54d1b06aeeee - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:36:37.507 1 ERROR oslo_service.service [req-6d7a8ff0-3339-41b1-a9eb-54d1b06aeeee - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:36:37.507 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 21:36:37.507 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 21:36:37.507 1 ERROR oslo_service.service     service.start()
>2018-06-25 21:36:37.507 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 21:36:37.507 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 21:36:37.507 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 21:36:37.507 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 21:36:37.507 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 21:36:37.507 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 21:36:37.507 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 21:36:37.507 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 21:36:37.507 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 21:36:37.507 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 21:36:37.507 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 21:36:37.507 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 21:36:37.507 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 21:36:37.507 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 21:36:37.507 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 21:36:37.507 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 21:36:37.507 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 21:36:37.507 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 21:36:37.507 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 21:36:37.507 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 21:36:37.507 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 21:36:37.507 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 21:36:37.507 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:36:37.507 1 ERROR oslo_service.service 
>2018-06-25 21:36:37.510 1 CRITICAL cinder [req-5142274b-9f6f-421a-a068-14af619c04d7 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 21:36:37.510 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 21:36:37.510 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 21:36:37.510 1 ERROR cinder     sys.exit(main())
>2018-06-25 21:36:37.510 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 21:36:37.510 1 ERROR cinder     service.wait()
>2018-06-25 21:36:37.510 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 21:36:37.510 1 ERROR cinder     _launcher.wait()
>2018-06-25 21:36:37.510 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 21:36:37.510 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 21:36:37.510 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 21:36:37.510 1 ERROR cinder     self.services.wait()
>2018-06-25 21:36:37.510 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 21:36:37.510 1 ERROR cinder     service.wait()
>2018-06-25 21:36:37.510 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 21:36:37.510 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 21:36:37.510 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 21:36:37.510 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 21:36:37.510 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 21:36:37.510 1 ERROR cinder     post_fn = fn()
>2018-06-25 21:36:37.510 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 21:36:37.510 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 21:36:37.510 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 21:36:37.510 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 21:36:37.510 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 21:36:37.510 1 ERROR cinder 
>2018-06-25 21:36:40.130 1 WARNING cinder.scheduler.host_manager [req-0ec2c666-095a-44ed-aef8-67a66ad65eb1 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 21:36:40.136 1 INFO cinder.rpc [req-0ec2c666-095a-44ed-aef8-67a66ad65eb1 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 21:36:40.141 1 INFO cinder.rpc [req-0ec2c666-095a-44ed-aef8-67a66ad65eb1 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 21:36:40.153 1 INFO cinder.rpc [req-0ec2c666-095a-44ed-aef8-67a66ad65eb1 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 21:36:40.159 1 INFO cinder.rpc [req-0ec2c666-095a-44ed-aef8-67a66ad65eb1 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 21:36:40.182 1 WARNING oslo_config.cfg [req-0ec2c666-095a-44ed-aef8-67a66ad65eb1 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 21:36:40.184 1 WARNING oslo_config.cfg [req-0ec2c666-095a-44ed-aef8-67a66ad65eb1 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:36:40.185 1 WARNING oslo_config.cfg [req-0ec2c666-095a-44ed-aef8-67a66ad65eb1 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:36:40.185 1 WARNING oslo_config.cfg [req-0ec2c666-095a-44ed-aef8-67a66ad65eb1 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:36:40.190 1 WARNING oslo_config.cfg [req-0ec2c666-095a-44ed-aef8-67a66ad65eb1 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 21:36:40.191 1 WARNING oslo_config.cfg [req-0ec2c666-095a-44ed-aef8-67a66ad65eb1 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 21:36:40.194 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 21:36:40.199 1 INFO cinder.manager [req-9cffc5ea-c5b4-485a-8158-47ef63c9bb7b - - - - -] Initiating service 5 cleanup
>2018-06-25 21:36:40.203 1 INFO cinder.manager [req-9cffc5ea-c5b4-485a-8158-47ef63c9bb7b - - - - -] Service 5 cleanup completed.
>2018-06-25 21:38:46.360 1 ERROR oslo.messaging._drivers.impl_rabbit [req-9cffc5ea-c5b4-485a-8158-47ef63c9bb7b - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:38:46.362 1 ERROR oslo.messaging._drivers.impl_rabbit [req-9cffc5ea-c5b4-485a-8158-47ef63c9bb7b - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:38:46.362 1 ERROR oslo_service.service [req-9cffc5ea-c5b4-485a-8158-47ef63c9bb7b - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:38:46.362 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 21:38:46.362 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 21:38:46.362 1 ERROR oslo_service.service     service.start()
>2018-06-25 21:38:46.362 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 21:38:46.362 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 21:38:46.362 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 21:38:46.362 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 21:38:46.362 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 21:38:46.362 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 21:38:46.362 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 21:38:46.362 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 21:38:46.362 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 21:38:46.362 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 21:38:46.362 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 21:38:46.362 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 21:38:46.362 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 21:38:46.362 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 21:38:46.362 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 21:38:46.362 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 21:38:46.362 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 21:38:46.362 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 21:38:46.362 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 21:38:46.362 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 21:38:46.362 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 21:38:46.362 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 21:38:46.362 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:38:46.362 1 ERROR oslo_service.service 
>2018-06-25 21:38:46.365 1 CRITICAL cinder [req-0ec2c666-095a-44ed-aef8-67a66ad65eb1 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 21:38:46.365 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 21:38:46.365 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 21:38:46.365 1 ERROR cinder     sys.exit(main())
>2018-06-25 21:38:46.365 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 21:38:46.365 1 ERROR cinder     service.wait()
>2018-06-25 21:38:46.365 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 21:38:46.365 1 ERROR cinder     _launcher.wait()
>2018-06-25 21:38:46.365 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 21:38:46.365 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 21:38:46.365 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 21:38:46.365 1 ERROR cinder     self.services.wait()
>2018-06-25 21:38:46.365 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 21:38:46.365 1 ERROR cinder     service.wait()
>2018-06-25 21:38:46.365 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 21:38:46.365 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 21:38:46.365 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 21:38:46.365 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 21:38:46.365 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 21:38:46.365 1 ERROR cinder     post_fn = fn()
>2018-06-25 21:38:46.365 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 21:38:46.365 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 21:38:46.365 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 21:38:46.365 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 21:38:46.365 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 21:38:46.365 1 ERROR cinder 
>2018-06-25 21:38:49.004 1 WARNING cinder.scheduler.host_manager [req-d4d6e673-d226-43a3-9abc-3950211218a2 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 21:38:49.011 1 INFO cinder.rpc [req-d4d6e673-d226-43a3-9abc-3950211218a2 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 21:38:49.020 1 INFO cinder.rpc [req-d4d6e673-d226-43a3-9abc-3950211218a2 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 21:38:49.039 1 INFO cinder.rpc [req-d4d6e673-d226-43a3-9abc-3950211218a2 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 21:38:49.050 1 INFO cinder.rpc [req-d4d6e673-d226-43a3-9abc-3950211218a2 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 21:38:49.091 1 WARNING oslo_config.cfg [req-d4d6e673-d226-43a3-9abc-3950211218a2 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 21:38:49.093 1 WARNING oslo_config.cfg [req-d4d6e673-d226-43a3-9abc-3950211218a2 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:38:49.094 1 WARNING oslo_config.cfg [req-d4d6e673-d226-43a3-9abc-3950211218a2 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:38:49.094 1 WARNING oslo_config.cfg [req-d4d6e673-d226-43a3-9abc-3950211218a2 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:38:49.100 1 WARNING oslo_config.cfg [req-d4d6e673-d226-43a3-9abc-3950211218a2 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 21:38:49.101 1 WARNING oslo_config.cfg [req-d4d6e673-d226-43a3-9abc-3950211218a2 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 21:38:49.104 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 21:38:49.109 1 INFO cinder.manager [req-cec1b670-39c8-4ac4-8f26-7e9d74d1b09a - - - - -] Initiating service 5 cleanup
>2018-06-25 21:38:49.116 1 INFO cinder.manager [req-cec1b670-39c8-4ac4-8f26-7e9d74d1b09a - - - - -] Service 5 cleanup completed.
>2018-06-25 21:40:53.546 1 ERROR oslo.messaging._drivers.impl_rabbit [req-cec1b670-39c8-4ac4-8f26-7e9d74d1b09a - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:40:53.549 1 ERROR oslo.messaging._drivers.impl_rabbit [req-cec1b670-39c8-4ac4-8f26-7e9d74d1b09a - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:40:53.549 1 ERROR oslo_service.service [req-cec1b670-39c8-4ac4-8f26-7e9d74d1b09a - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:40:53.549 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 21:40:53.549 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 21:40:53.549 1 ERROR oslo_service.service     service.start()
>2018-06-25 21:40:53.549 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 21:40:53.549 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 21:40:53.549 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 21:40:53.549 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 21:40:53.549 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 21:40:53.549 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 21:40:53.549 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 21:40:53.549 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 21:40:53.549 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 21:40:53.549 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 21:40:53.549 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 21:40:53.549 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 21:40:53.549 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 21:40:53.549 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 21:40:53.549 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 21:40:53.549 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 21:40:53.549 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 21:40:53.549 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 21:40:53.549 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 21:40:53.549 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 21:40:53.549 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 21:40:53.549 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 21:40:53.549 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:40:53.549 1 ERROR oslo_service.service 
>2018-06-25 21:40:53.552 1 CRITICAL cinder [req-d4d6e673-d226-43a3-9abc-3950211218a2 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 21:40:53.552 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 21:40:53.552 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 21:40:53.552 1 ERROR cinder     sys.exit(main())
>2018-06-25 21:40:53.552 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 21:40:53.552 1 ERROR cinder     service.wait()
>2018-06-25 21:40:53.552 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 21:40:53.552 1 ERROR cinder     _launcher.wait()
>2018-06-25 21:40:53.552 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 21:40:53.552 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 21:40:53.552 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 21:40:53.552 1 ERROR cinder     self.services.wait()
>2018-06-25 21:40:53.552 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 21:40:53.552 1 ERROR cinder     service.wait()
>2018-06-25 21:40:53.552 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 21:40:53.552 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 21:40:53.552 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 21:40:53.552 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 21:40:53.552 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 21:40:53.552 1 ERROR cinder     post_fn = fn()
>2018-06-25 21:40:53.552 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 21:40:53.552 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 21:40:53.552 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 21:40:53.552 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 21:40:53.552 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 21:40:53.552 1 ERROR cinder 
>2018-06-25 21:40:56.308 1 WARNING cinder.scheduler.host_manager [req-4a687fd7-fae3-4946-892f-6c9431fd1e47 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 21:40:56.314 1 INFO cinder.rpc [req-4a687fd7-fae3-4946-892f-6c9431fd1e47 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 21:40:56.324 1 INFO cinder.rpc [req-4a687fd7-fae3-4946-892f-6c9431fd1e47 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 21:40:56.335 1 INFO cinder.rpc [req-4a687fd7-fae3-4946-892f-6c9431fd1e47 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 21:40:56.342 1 INFO cinder.rpc [req-4a687fd7-fae3-4946-892f-6c9431fd1e47 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 21:40:56.364 1 WARNING oslo_config.cfg [req-4a687fd7-fae3-4946-892f-6c9431fd1e47 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 21:40:56.366 1 WARNING oslo_config.cfg [req-4a687fd7-fae3-4946-892f-6c9431fd1e47 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:40:56.367 1 WARNING oslo_config.cfg [req-4a687fd7-fae3-4946-892f-6c9431fd1e47 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:40:56.367 1 WARNING oslo_config.cfg [req-4a687fd7-fae3-4946-892f-6c9431fd1e47 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:40:56.372 1 WARNING oslo_config.cfg [req-4a687fd7-fae3-4946-892f-6c9431fd1e47 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 21:40:56.374 1 WARNING oslo_config.cfg [req-4a687fd7-fae3-4946-892f-6c9431fd1e47 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 21:40:56.376 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 21:40:56.383 1 INFO cinder.manager [req-687f4301-7d02-4ebf-97a2-ff4b2ab7931e - - - - -] Initiating service 5 cleanup
>2018-06-25 21:40:56.388 1 INFO cinder.manager [req-687f4301-7d02-4ebf-97a2-ff4b2ab7931e - - - - -] Service 5 cleanup completed.
>2018-06-25 21:43:07.667 1 ERROR oslo.messaging._drivers.impl_rabbit [req-687f4301-7d02-4ebf-97a2-ff4b2ab7931e - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:43:07.669 1 ERROR oslo.messaging._drivers.impl_rabbit [req-687f4301-7d02-4ebf-97a2-ff4b2ab7931e - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:43:07.669 1 ERROR oslo_service.service [req-687f4301-7d02-4ebf-97a2-ff4b2ab7931e - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:43:07.669 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 21:43:07.669 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 21:43:07.669 1 ERROR oslo_service.service     service.start()
>2018-06-25 21:43:07.669 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 21:43:07.669 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 21:43:07.669 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 21:43:07.669 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 21:43:07.669 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 21:43:07.669 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 21:43:07.669 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 21:43:07.669 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 21:43:07.669 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 21:43:07.669 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 21:43:07.669 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 21:43:07.669 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 21:43:07.669 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 21:43:07.669 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 21:43:07.669 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 21:43:07.669 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 21:43:07.669 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 21:43:07.669 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 21:43:07.669 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 21:43:07.669 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 21:43:07.669 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 21:43:07.669 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 21:43:07.669 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:43:07.669 1 ERROR oslo_service.service 
>2018-06-25 21:43:07.672 1 CRITICAL cinder [req-4a687fd7-fae3-4946-892f-6c9431fd1e47 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 21:43:07.672 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 21:43:07.672 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 21:43:07.672 1 ERROR cinder     sys.exit(main())
>2018-06-25 21:43:07.672 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 21:43:07.672 1 ERROR cinder     service.wait()
>2018-06-25 21:43:07.672 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 21:43:07.672 1 ERROR cinder     _launcher.wait()
>2018-06-25 21:43:07.672 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 21:43:07.672 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 21:43:07.672 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 21:43:07.672 1 ERROR cinder     self.services.wait()
>2018-06-25 21:43:07.672 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 21:43:07.672 1 ERROR cinder     service.wait()
>2018-06-25 21:43:07.672 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 21:43:07.672 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 21:43:07.672 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 21:43:07.672 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 21:43:07.672 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 21:43:07.672 1 ERROR cinder     post_fn = fn()
>2018-06-25 21:43:07.672 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 21:43:07.672 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 21:43:07.672 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 21:43:07.672 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 21:43:07.672 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 21:43:07.672 1 ERROR cinder 
>2018-06-25 21:43:10.310 1 WARNING cinder.scheduler.host_manager [req-312a66a5-2d4e-47e5-a413-9a7c02b3a203 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 21:43:10.316 1 INFO cinder.rpc [req-312a66a5-2d4e-47e5-a413-9a7c02b3a203 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 21:43:10.322 1 INFO cinder.rpc [req-312a66a5-2d4e-47e5-a413-9a7c02b3a203 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 21:43:10.333 1 INFO cinder.rpc [req-312a66a5-2d4e-47e5-a413-9a7c02b3a203 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 21:43:10.339 1 INFO cinder.rpc [req-312a66a5-2d4e-47e5-a413-9a7c02b3a203 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 21:43:10.361 1 WARNING oslo_config.cfg [req-312a66a5-2d4e-47e5-a413-9a7c02b3a203 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 21:43:10.363 1 WARNING oslo_config.cfg [req-312a66a5-2d4e-47e5-a413-9a7c02b3a203 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:43:10.364 1 WARNING oslo_config.cfg [req-312a66a5-2d4e-47e5-a413-9a7c02b3a203 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:43:10.364 1 WARNING oslo_config.cfg [req-312a66a5-2d4e-47e5-a413-9a7c02b3a203 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:43:10.371 1 WARNING oslo_config.cfg [req-312a66a5-2d4e-47e5-a413-9a7c02b3a203 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 21:43:10.372 1 WARNING oslo_config.cfg [req-312a66a5-2d4e-47e5-a413-9a7c02b3a203 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 21:43:10.375 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 21:43:10.381 1 INFO cinder.manager [req-ee5dd556-d44b-42a9-85d4-a21376ca823d - - - - -] Initiating service 5 cleanup
>2018-06-25 21:43:10.386 1 INFO cinder.manager [req-ee5dd556-d44b-42a9-85d4-a21376ca823d - - - - -] Service 5 cleanup completed.
>2018-06-25 21:45:16.565 1 ERROR oslo.messaging._drivers.impl_rabbit [req-ee5dd556-d44b-42a9-85d4-a21376ca823d - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:45:16.567 1 ERROR oslo.messaging._drivers.impl_rabbit [req-ee5dd556-d44b-42a9-85d4-a21376ca823d - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:45:16.567 1 ERROR oslo_service.service [req-ee5dd556-d44b-42a9-85d4-a21376ca823d - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:45:16.567 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 21:45:16.567 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 21:45:16.567 1 ERROR oslo_service.service     service.start()
>2018-06-25 21:45:16.567 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 21:45:16.567 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 21:45:16.567 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 21:45:16.567 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 21:45:16.567 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 21:45:16.567 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 21:45:16.567 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 21:45:16.567 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 21:45:16.567 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 21:45:16.567 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 21:45:16.567 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 21:45:16.567 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 21:45:16.567 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 21:45:16.567 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 21:45:16.567 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 21:45:16.567 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 21:45:16.567 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 21:45:16.567 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 21:45:16.567 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 21:45:16.567 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 21:45:16.567 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 21:45:16.567 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 21:45:16.567 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:45:16.567 1 ERROR oslo_service.service 
>2018-06-25 21:45:16.570 1 CRITICAL cinder [req-312a66a5-2d4e-47e5-a413-9a7c02b3a203 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 21:45:16.570 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 21:45:16.570 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 21:45:16.570 1 ERROR cinder     sys.exit(main())
>2018-06-25 21:45:16.570 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 21:45:16.570 1 ERROR cinder     service.wait()
>2018-06-25 21:45:16.570 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 21:45:16.570 1 ERROR cinder     _launcher.wait()
>2018-06-25 21:45:16.570 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 21:45:16.570 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 21:45:16.570 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 21:45:16.570 1 ERROR cinder     self.services.wait()
>2018-06-25 21:45:16.570 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 21:45:16.570 1 ERROR cinder     service.wait()
>2018-06-25 21:45:16.570 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 21:45:16.570 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 21:45:16.570 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 21:45:16.570 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 21:45:16.570 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 21:45:16.570 1 ERROR cinder     post_fn = fn()
>2018-06-25 21:45:16.570 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 21:45:16.570 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 21:45:16.570 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 21:45:16.570 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 21:45:16.570 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 21:45:16.570 1 ERROR cinder 
>2018-06-25 21:45:19.260 1 WARNING cinder.scheduler.host_manager [req-bc3f0e44-1b6b-4b1f-ace7-69fb26b0fc35 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 21:45:19.268 1 INFO cinder.rpc [req-bc3f0e44-1b6b-4b1f-ace7-69fb26b0fc35 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 21:45:19.275 1 INFO cinder.rpc [req-bc3f0e44-1b6b-4b1f-ace7-69fb26b0fc35 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 21:45:19.295 1 INFO cinder.rpc [req-bc3f0e44-1b6b-4b1f-ace7-69fb26b0fc35 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 21:45:19.303 1 INFO cinder.rpc [req-bc3f0e44-1b6b-4b1f-ace7-69fb26b0fc35 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 21:45:19.341 1 WARNING oslo_config.cfg [req-bc3f0e44-1b6b-4b1f-ace7-69fb26b0fc35 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 21:45:19.344 1 WARNING oslo_config.cfg [req-bc3f0e44-1b6b-4b1f-ace7-69fb26b0fc35 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:45:19.344 1 WARNING oslo_config.cfg [req-bc3f0e44-1b6b-4b1f-ace7-69fb26b0fc35 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:45:19.345 1 WARNING oslo_config.cfg [req-bc3f0e44-1b6b-4b1f-ace7-69fb26b0fc35 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:45:19.351 1 WARNING oslo_config.cfg [req-bc3f0e44-1b6b-4b1f-ace7-69fb26b0fc35 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 21:45:19.352 1 WARNING oslo_config.cfg [req-bc3f0e44-1b6b-4b1f-ace7-69fb26b0fc35 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 21:45:19.354 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 21:45:19.364 1 INFO cinder.manager [req-8404608e-8df9-4d54-86c8-18829c4be0d4 - - - - -] Initiating service 5 cleanup
>2018-06-25 21:45:19.373 1 INFO cinder.manager [req-8404608e-8df9-4d54-86c8-18829c4be0d4 - - - - -] Service 5 cleanup completed.
>2018-06-25 21:47:25.668 1 ERROR oslo.messaging._drivers.impl_rabbit [req-8404608e-8df9-4d54-86c8-18829c4be0d4 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:47:25.672 1 ERROR oslo.messaging._drivers.impl_rabbit [req-8404608e-8df9-4d54-86c8-18829c4be0d4 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:47:25.673 1 ERROR oslo_service.service [req-8404608e-8df9-4d54-86c8-18829c4be0d4 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:47:25.673 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 21:47:25.673 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 21:47:25.673 1 ERROR oslo_service.service     service.start()
>2018-06-25 21:47:25.673 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 21:47:25.673 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 21:47:25.673 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 21:47:25.673 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 21:47:25.673 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 21:47:25.673 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 21:47:25.673 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 21:47:25.673 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 21:47:25.673 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 21:47:25.673 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 21:47:25.673 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 21:47:25.673 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 21:47:25.673 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 21:47:25.673 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 21:47:25.673 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 21:47:25.673 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 21:47:25.673 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 21:47:25.673 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 21:47:25.673 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 21:47:25.673 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 21:47:25.673 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 21:47:25.673 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 21:47:25.673 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:47:25.673 1 ERROR oslo_service.service 
>2018-06-25 21:47:25.676 1 CRITICAL cinder [req-bc3f0e44-1b6b-4b1f-ace7-69fb26b0fc35 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 21:47:25.676 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 21:47:25.676 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 21:47:25.676 1 ERROR cinder     sys.exit(main())
>2018-06-25 21:47:25.676 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 21:47:25.676 1 ERROR cinder     service.wait()
>2018-06-25 21:47:25.676 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 21:47:25.676 1 ERROR cinder     _launcher.wait()
>2018-06-25 21:47:25.676 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 21:47:25.676 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 21:47:25.676 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 21:47:25.676 1 ERROR cinder     self.services.wait()
>2018-06-25 21:47:25.676 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 21:47:25.676 1 ERROR cinder     service.wait()
>2018-06-25 21:47:25.676 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 21:47:25.676 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 21:47:25.676 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 21:47:25.676 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 21:47:25.676 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 21:47:25.676 1 ERROR cinder     post_fn = fn()
>2018-06-25 21:47:25.676 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 21:47:25.676 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 21:47:25.676 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 21:47:25.676 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 21:47:25.676 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 21:47:25.676 1 ERROR cinder 
>2018-06-25 21:47:28.384 1 WARNING cinder.scheduler.host_manager [req-ae08bca0-2a90-4225-b6f8-697390451d3b - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 21:47:28.390 1 INFO cinder.rpc [req-ae08bca0-2a90-4225-b6f8-697390451d3b - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 21:47:28.395 1 INFO cinder.rpc [req-ae08bca0-2a90-4225-b6f8-697390451d3b - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 21:47:28.407 1 INFO cinder.rpc [req-ae08bca0-2a90-4225-b6f8-697390451d3b - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 21:47:28.417 1 INFO cinder.rpc [req-ae08bca0-2a90-4225-b6f8-697390451d3b - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 21:47:28.444 1 WARNING oslo_config.cfg [req-ae08bca0-2a90-4225-b6f8-697390451d3b - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 21:47:28.446 1 WARNING oslo_config.cfg [req-ae08bca0-2a90-4225-b6f8-697390451d3b - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:47:28.446 1 WARNING oslo_config.cfg [req-ae08bca0-2a90-4225-b6f8-697390451d3b - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:47:28.447 1 WARNING oslo_config.cfg [req-ae08bca0-2a90-4225-b6f8-697390451d3b - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:47:28.452 1 WARNING oslo_config.cfg [req-ae08bca0-2a90-4225-b6f8-697390451d3b - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 21:47:28.453 1 WARNING oslo_config.cfg [req-ae08bca0-2a90-4225-b6f8-697390451d3b - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 21:47:28.456 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 21:47:28.461 1 INFO cinder.manager [req-381d31a5-3124-46f3-82f6-d37880da3d5b - - - - -] Initiating service 5 cleanup
>2018-06-25 21:47:28.465 1 INFO cinder.manager [req-381d31a5-3124-46f3-82f6-d37880da3d5b - - - - -] Service 5 cleanup completed.
>2018-06-25 21:49:33.037 1 ERROR oslo.messaging._drivers.impl_rabbit [req-381d31a5-3124-46f3-82f6-d37880da3d5b - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:49:33.038 1 ERROR oslo.messaging._drivers.impl_rabbit [req-381d31a5-3124-46f3-82f6-d37880da3d5b - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:49:33.039 1 ERROR oslo_service.service [req-381d31a5-3124-46f3-82f6-d37880da3d5b - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:49:33.039 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 21:49:33.039 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 21:49:33.039 1 ERROR oslo_service.service     service.start()
>2018-06-25 21:49:33.039 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 21:49:33.039 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 21:49:33.039 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 21:49:33.039 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 21:49:33.039 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 21:49:33.039 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 21:49:33.039 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 21:49:33.039 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 21:49:33.039 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 21:49:33.039 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 21:49:33.039 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 21:49:33.039 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 21:49:33.039 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 21:49:33.039 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 21:49:33.039 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 21:49:33.039 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 21:49:33.039 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 21:49:33.039 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 21:49:33.039 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 21:49:33.039 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 21:49:33.039 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 21:49:33.039 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 21:49:33.039 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:49:33.039 1 ERROR oslo_service.service 
>2018-06-25 21:49:33.042 1 CRITICAL cinder [req-ae08bca0-2a90-4225-b6f8-697390451d3b - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 21:49:33.042 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 21:49:33.042 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 21:49:33.042 1 ERROR cinder     sys.exit(main())
>2018-06-25 21:49:33.042 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 21:49:33.042 1 ERROR cinder     service.wait()
>2018-06-25 21:49:33.042 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 21:49:33.042 1 ERROR cinder     _launcher.wait()
>2018-06-25 21:49:33.042 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 21:49:33.042 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 21:49:33.042 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 21:49:33.042 1 ERROR cinder     self.services.wait()
>2018-06-25 21:49:33.042 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 21:49:33.042 1 ERROR cinder     service.wait()
>2018-06-25 21:49:33.042 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 21:49:33.042 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 21:49:33.042 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 21:49:33.042 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 21:49:33.042 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 21:49:33.042 1 ERROR cinder     post_fn = fn()
>2018-06-25 21:49:33.042 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 21:49:33.042 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 21:49:33.042 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 21:49:33.042 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 21:49:33.042 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 21:49:33.042 1 ERROR cinder 
>2018-06-25 21:49:35.802 1 WARNING cinder.scheduler.host_manager [req-8fbb836f-cc75-4ff3-bf2f-5fedaff9654f - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 21:49:35.808 1 INFO cinder.rpc [req-8fbb836f-cc75-4ff3-bf2f-5fedaff9654f - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 21:49:35.814 1 INFO cinder.rpc [req-8fbb836f-cc75-4ff3-bf2f-5fedaff9654f - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 21:49:35.826 1 INFO cinder.rpc [req-8fbb836f-cc75-4ff3-bf2f-5fedaff9654f - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 21:49:35.831 1 INFO cinder.rpc [req-8fbb836f-cc75-4ff3-bf2f-5fedaff9654f - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 21:49:35.854 1 WARNING oslo_config.cfg [req-8fbb836f-cc75-4ff3-bf2f-5fedaff9654f - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 21:49:35.856 1 WARNING oslo_config.cfg [req-8fbb836f-cc75-4ff3-bf2f-5fedaff9654f - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:49:35.857 1 WARNING oslo_config.cfg [req-8fbb836f-cc75-4ff3-bf2f-5fedaff9654f - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:49:35.857 1 WARNING oslo_config.cfg [req-8fbb836f-cc75-4ff3-bf2f-5fedaff9654f - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:49:35.863 1 WARNING oslo_config.cfg [req-8fbb836f-cc75-4ff3-bf2f-5fedaff9654f - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 21:49:35.864 1 WARNING oslo_config.cfg [req-8fbb836f-cc75-4ff3-bf2f-5fedaff9654f - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 21:49:35.866 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 21:49:35.873 1 INFO cinder.manager [req-2d9cee4d-b57a-46cc-be03-0aa82dafa37d - - - - -] Initiating service 5 cleanup
>2018-06-25 21:49:35.878 1 INFO cinder.manager [req-2d9cee4d-b57a-46cc-be03-0aa82dafa37d - - - - -] Service 5 cleanup completed.
>2018-06-25 21:51:40.241 1 ERROR oslo.messaging._drivers.impl_rabbit [req-2d9cee4d-b57a-46cc-be03-0aa82dafa37d - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:51:40.243 1 ERROR oslo.messaging._drivers.impl_rabbit [req-2d9cee4d-b57a-46cc-be03-0aa82dafa37d - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:51:40.244 1 ERROR oslo_service.service [req-2d9cee4d-b57a-46cc-be03-0aa82dafa37d - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:51:40.244 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 21:51:40.244 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 21:51:40.244 1 ERROR oslo_service.service     service.start()
>2018-06-25 21:51:40.244 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 21:51:40.244 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 21:51:40.244 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 21:51:40.244 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 21:51:40.244 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 21:51:40.244 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 21:51:40.244 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 21:51:40.244 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 21:51:40.244 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 21:51:40.244 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 21:51:40.244 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 21:51:40.244 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 21:51:40.244 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 21:51:40.244 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 21:51:40.244 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 21:51:40.244 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 21:51:40.244 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 21:51:40.244 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 21:51:40.244 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 21:51:40.244 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 21:51:40.244 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 21:51:40.244 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 21:51:40.244 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:51:40.244 1 ERROR oslo_service.service 
>2018-06-25 21:51:40.248 1 CRITICAL cinder [req-8fbb836f-cc75-4ff3-bf2f-5fedaff9654f - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 21:51:40.248 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 21:51:40.248 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 21:51:40.248 1 ERROR cinder     sys.exit(main())
>2018-06-25 21:51:40.248 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 21:51:40.248 1 ERROR cinder     service.wait()
>2018-06-25 21:51:40.248 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 21:51:40.248 1 ERROR cinder     _launcher.wait()
>2018-06-25 21:51:40.248 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 21:51:40.248 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 21:51:40.248 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 21:51:40.248 1 ERROR cinder     self.services.wait()
>2018-06-25 21:51:40.248 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 21:51:40.248 1 ERROR cinder     service.wait()
>2018-06-25 21:51:40.248 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 21:51:40.248 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 21:51:40.248 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 21:51:40.248 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 21:51:40.248 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 21:51:40.248 1 ERROR cinder     post_fn = fn()
>2018-06-25 21:51:40.248 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 21:51:40.248 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 21:51:40.248 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 21:51:40.248 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 21:51:40.248 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 21:51:40.248 1 ERROR cinder 
>2018-06-25 21:51:42.956 1 WARNING cinder.scheduler.host_manager [req-eae7a275-e08f-4c1b-9592-5058a275855e - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 21:51:42.962 1 INFO cinder.rpc [req-eae7a275-e08f-4c1b-9592-5058a275855e - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 21:51:42.967 1 INFO cinder.rpc [req-eae7a275-e08f-4c1b-9592-5058a275855e - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 21:51:42.979 1 INFO cinder.rpc [req-eae7a275-e08f-4c1b-9592-5058a275855e - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 21:51:42.985 1 INFO cinder.rpc [req-eae7a275-e08f-4c1b-9592-5058a275855e - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 21:51:43.007 1 WARNING oslo_config.cfg [req-eae7a275-e08f-4c1b-9592-5058a275855e - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 21:51:43.010 1 WARNING oslo_config.cfg [req-eae7a275-e08f-4c1b-9592-5058a275855e - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:51:43.010 1 WARNING oslo_config.cfg [req-eae7a275-e08f-4c1b-9592-5058a275855e - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:51:43.011 1 WARNING oslo_config.cfg [req-eae7a275-e08f-4c1b-9592-5058a275855e - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:51:43.017 1 WARNING oslo_config.cfg [req-eae7a275-e08f-4c1b-9592-5058a275855e - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 21:51:43.018 1 WARNING oslo_config.cfg [req-eae7a275-e08f-4c1b-9592-5058a275855e - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 21:51:43.022 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 21:51:43.028 1 INFO cinder.manager [req-88a75437-b12f-416c-9da4-32239c0f250c - - - - -] Initiating service 5 cleanup
>2018-06-25 21:51:43.033 1 INFO cinder.manager [req-88a75437-b12f-416c-9da4-32239c0f250c - - - - -] Service 5 cleanup completed.
>2018-06-25 21:53:54.380 1 ERROR oslo.messaging._drivers.impl_rabbit [req-88a75437-b12f-416c-9da4-32239c0f250c - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:53:54.381 1 ERROR oslo.messaging._drivers.impl_rabbit [req-88a75437-b12f-416c-9da4-32239c0f250c - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:53:54.382 1 ERROR oslo_service.service [req-88a75437-b12f-416c-9da4-32239c0f250c - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:53:54.382 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 21:53:54.382 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 21:53:54.382 1 ERROR oslo_service.service     service.start()
>2018-06-25 21:53:54.382 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 21:53:54.382 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 21:53:54.382 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 21:53:54.382 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 21:53:54.382 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 21:53:54.382 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 21:53:54.382 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 21:53:54.382 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 21:53:54.382 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 21:53:54.382 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 21:53:54.382 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 21:53:54.382 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 21:53:54.382 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 21:53:54.382 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 21:53:54.382 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 21:53:54.382 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 21:53:54.382 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 21:53:54.382 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 21:53:54.382 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 21:53:54.382 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 21:53:54.382 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 21:53:54.382 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 21:53:54.382 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:53:54.382 1 ERROR oslo_service.service 
>2018-06-25 21:53:54.385 1 CRITICAL cinder [req-eae7a275-e08f-4c1b-9592-5058a275855e - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 21:53:54.385 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 21:53:54.385 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 21:53:54.385 1 ERROR cinder     sys.exit(main())
>2018-06-25 21:53:54.385 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 21:53:54.385 1 ERROR cinder     service.wait()
>2018-06-25 21:53:54.385 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 21:53:54.385 1 ERROR cinder     _launcher.wait()
>2018-06-25 21:53:54.385 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 21:53:54.385 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 21:53:54.385 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 21:53:54.385 1 ERROR cinder     self.services.wait()
>2018-06-25 21:53:54.385 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 21:53:54.385 1 ERROR cinder     service.wait()
>2018-06-25 21:53:54.385 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 21:53:54.385 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 21:53:54.385 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 21:53:54.385 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 21:53:54.385 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 21:53:54.385 1 ERROR cinder     post_fn = fn()
>2018-06-25 21:53:54.385 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 21:53:54.385 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 21:53:54.385 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 21:53:54.385 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 21:53:54.385 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 21:53:54.385 1 ERROR cinder 
>2018-06-25 21:53:57.019 1 WARNING cinder.scheduler.host_manager [req-e6e2b682-07e6-487c-95a3-834f31e85ba0 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 21:53:57.027 1 INFO cinder.rpc [req-e6e2b682-07e6-487c-95a3-834f31e85ba0 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 21:53:57.033 1 INFO cinder.rpc [req-e6e2b682-07e6-487c-95a3-834f31e85ba0 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 21:53:57.047 1 INFO cinder.rpc [req-e6e2b682-07e6-487c-95a3-834f31e85ba0 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 21:53:57.052 1 INFO cinder.rpc [req-e6e2b682-07e6-487c-95a3-834f31e85ba0 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 21:53:57.074 1 WARNING oslo_config.cfg [req-e6e2b682-07e6-487c-95a3-834f31e85ba0 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 21:53:57.076 1 WARNING oslo_config.cfg [req-e6e2b682-07e6-487c-95a3-834f31e85ba0 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:53:57.077 1 WARNING oslo_config.cfg [req-e6e2b682-07e6-487c-95a3-834f31e85ba0 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:53:57.077 1 WARNING oslo_config.cfg [req-e6e2b682-07e6-487c-95a3-834f31e85ba0 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:53:57.082 1 WARNING oslo_config.cfg [req-e6e2b682-07e6-487c-95a3-834f31e85ba0 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 21:53:57.083 1 WARNING oslo_config.cfg [req-e6e2b682-07e6-487c-95a3-834f31e85ba0 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 21:53:57.086 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 21:53:57.093 1 INFO cinder.manager [req-119ec4c8-3152-4dbc-8074-da7aa8f4675d - - - - -] Initiating service 5 cleanup
>2018-06-25 21:53:57.097 1 INFO cinder.manager [req-119ec4c8-3152-4dbc-8074-da7aa8f4675d - - - - -] Service 5 cleanup completed.
>2018-06-25 21:56:01.486 1 ERROR oslo.messaging._drivers.impl_rabbit [req-119ec4c8-3152-4dbc-8074-da7aa8f4675d - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:56:01.488 1 ERROR oslo.messaging._drivers.impl_rabbit [req-119ec4c8-3152-4dbc-8074-da7aa8f4675d - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:56:01.489 1 ERROR oslo_service.service [req-119ec4c8-3152-4dbc-8074-da7aa8f4675d - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:56:01.489 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 21:56:01.489 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 21:56:01.489 1 ERROR oslo_service.service     service.start()
>2018-06-25 21:56:01.489 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 21:56:01.489 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 21:56:01.489 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 21:56:01.489 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 21:56:01.489 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 21:56:01.489 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 21:56:01.489 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 21:56:01.489 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 21:56:01.489 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 21:56:01.489 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 21:56:01.489 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 21:56:01.489 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 21:56:01.489 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 21:56:01.489 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 21:56:01.489 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 21:56:01.489 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 21:56:01.489 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 21:56:01.489 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 21:56:01.489 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 21:56:01.489 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 21:56:01.489 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 21:56:01.489 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 21:56:01.489 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:56:01.489 1 ERROR oslo_service.service 
>2018-06-25 21:56:01.491 1 CRITICAL cinder [req-e6e2b682-07e6-487c-95a3-834f31e85ba0 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 21:56:01.491 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 21:56:01.491 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 21:56:01.491 1 ERROR cinder     sys.exit(main())
>2018-06-25 21:56:01.491 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 21:56:01.491 1 ERROR cinder     service.wait()
>2018-06-25 21:56:01.491 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 21:56:01.491 1 ERROR cinder     _launcher.wait()
>2018-06-25 21:56:01.491 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 21:56:01.491 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 21:56:01.491 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 21:56:01.491 1 ERROR cinder     self.services.wait()
>2018-06-25 21:56:01.491 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 21:56:01.491 1 ERROR cinder     service.wait()
>2018-06-25 21:56:01.491 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 21:56:01.491 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 21:56:01.491 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 21:56:01.491 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 21:56:01.491 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 21:56:01.491 1 ERROR cinder     post_fn = fn()
>2018-06-25 21:56:01.491 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 21:56:01.491 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 21:56:01.491 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 21:56:01.491 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 21:56:01.491 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 21:56:01.491 1 ERROR cinder 
>2018-06-25 21:56:04.184 1 WARNING cinder.scheduler.host_manager [req-bf8328b3-5785-48c6-8d90-55702f7b90c9 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 21:56:04.191 1 INFO cinder.rpc [req-bf8328b3-5785-48c6-8d90-55702f7b90c9 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 21:56:04.196 1 INFO cinder.rpc [req-bf8328b3-5785-48c6-8d90-55702f7b90c9 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 21:56:04.209 1 INFO cinder.rpc [req-bf8328b3-5785-48c6-8d90-55702f7b90c9 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 21:56:04.214 1 INFO cinder.rpc [req-bf8328b3-5785-48c6-8d90-55702f7b90c9 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 21:56:04.250 1 WARNING oslo_config.cfg [req-bf8328b3-5785-48c6-8d90-55702f7b90c9 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 21:56:04.253 1 WARNING oslo_config.cfg [req-bf8328b3-5785-48c6-8d90-55702f7b90c9 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:56:04.254 1 WARNING oslo_config.cfg [req-bf8328b3-5785-48c6-8d90-55702f7b90c9 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:56:04.254 1 WARNING oslo_config.cfg [req-bf8328b3-5785-48c6-8d90-55702f7b90c9 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:56:04.261 1 WARNING oslo_config.cfg [req-bf8328b3-5785-48c6-8d90-55702f7b90c9 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 21:56:04.262 1 WARNING oslo_config.cfg [req-bf8328b3-5785-48c6-8d90-55702f7b90c9 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 21:56:04.265 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 21:56:04.272 1 INFO cinder.manager [req-c3638adc-75f0-407c-9a02-e6488ef5c58d - - - - -] Initiating service 5 cleanup
>2018-06-25 21:56:04.279 1 INFO cinder.manager [req-c3638adc-75f0-407c-9a02-e6488ef5c58d - - - - -] Service 5 cleanup completed.
>2018-06-25 21:58:10.420 1 ERROR oslo.messaging._drivers.impl_rabbit [req-c3638adc-75f0-407c-9a02-e6488ef5c58d - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:58:10.422 1 ERROR oslo.messaging._drivers.impl_rabbit [req-c3638adc-75f0-407c-9a02-e6488ef5c58d - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:58:10.423 1 ERROR oslo_service.service [req-c3638adc-75f0-407c-9a02-e6488ef5c58d - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:58:10.423 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 21:58:10.423 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 21:58:10.423 1 ERROR oslo_service.service     service.start()
>2018-06-25 21:58:10.423 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 21:58:10.423 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 21:58:10.423 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 21:58:10.423 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 21:58:10.423 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 21:58:10.423 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 21:58:10.423 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 21:58:10.423 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 21:58:10.423 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 21:58:10.423 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 21:58:10.423 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 21:58:10.423 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 21:58:10.423 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 21:58:10.423 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 21:58:10.423 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 21:58:10.423 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 21:58:10.423 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 21:58:10.423 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 21:58:10.423 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 21:58:10.423 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 21:58:10.423 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 21:58:10.423 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 21:58:10.423 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 21:58:10.423 1 ERROR oslo_service.service 
>2018-06-25 21:58:10.427 1 CRITICAL cinder [req-bf8328b3-5785-48c6-8d90-55702f7b90c9 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 21:58:10.427 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 21:58:10.427 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 21:58:10.427 1 ERROR cinder     sys.exit(main())
>2018-06-25 21:58:10.427 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 21:58:10.427 1 ERROR cinder     service.wait()
>2018-06-25 21:58:10.427 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 21:58:10.427 1 ERROR cinder     _launcher.wait()
>2018-06-25 21:58:10.427 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 21:58:10.427 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 21:58:10.427 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 21:58:10.427 1 ERROR cinder     self.services.wait()
>2018-06-25 21:58:10.427 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 21:58:10.427 1 ERROR cinder     service.wait()
>2018-06-25 21:58:10.427 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 21:58:10.427 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 21:58:10.427 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 21:58:10.427 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 21:58:10.427 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 21:58:10.427 1 ERROR cinder     post_fn = fn()
>2018-06-25 21:58:10.427 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 21:58:10.427 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 21:58:10.427 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 21:58:10.427 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 21:58:10.427 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 21:58:10.427 1 ERROR cinder 
>2018-06-25 21:58:13.098 1 WARNING cinder.scheduler.host_manager [req-ff3283d5-8746-46f6-9ee8-2422102ea6de - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 21:58:13.104 1 INFO cinder.rpc [req-ff3283d5-8746-46f6-9ee8-2422102ea6de - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 21:58:13.110 1 INFO cinder.rpc [req-ff3283d5-8746-46f6-9ee8-2422102ea6de - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 21:58:13.121 1 INFO cinder.rpc [req-ff3283d5-8746-46f6-9ee8-2422102ea6de - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 21:58:13.126 1 INFO cinder.rpc [req-ff3283d5-8746-46f6-9ee8-2422102ea6de - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 21:58:13.150 1 WARNING oslo_config.cfg [req-ff3283d5-8746-46f6-9ee8-2422102ea6de - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 21:58:13.152 1 WARNING oslo_config.cfg [req-ff3283d5-8746-46f6-9ee8-2422102ea6de - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:58:13.153 1 WARNING oslo_config.cfg [req-ff3283d5-8746-46f6-9ee8-2422102ea6de - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:58:13.154 1 WARNING oslo_config.cfg [req-ff3283d5-8746-46f6-9ee8-2422102ea6de - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 21:58:13.159 1 WARNING oslo_config.cfg [req-ff3283d5-8746-46f6-9ee8-2422102ea6de - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 21:58:13.160 1 WARNING oslo_config.cfg [req-ff3283d5-8746-46f6-9ee8-2422102ea6de - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 21:58:13.163 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 21:58:13.169 1 INFO cinder.manager [req-820d2eef-f595-4a6c-889d-e5f21062d38c - - - - -] Initiating service 5 cleanup
>2018-06-25 21:58:13.175 1 INFO cinder.manager [req-820d2eef-f595-4a6c-889d-e5f21062d38c - - - - -] Service 5 cleanup completed.
>2018-06-25 22:00:17.648 1 ERROR oslo.messaging._drivers.impl_rabbit [req-820d2eef-f595-4a6c-889d-e5f21062d38c - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:00:17.650 1 ERROR oslo.messaging._drivers.impl_rabbit [req-820d2eef-f595-4a6c-889d-e5f21062d38c - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:00:17.650 1 ERROR oslo_service.service [req-820d2eef-f595-4a6c-889d-e5f21062d38c - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:00:17.650 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 22:00:17.650 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 22:00:17.650 1 ERROR oslo_service.service     service.start()
>2018-06-25 22:00:17.650 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 22:00:17.650 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 22:00:17.650 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 22:00:17.650 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 22:00:17.650 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 22:00:17.650 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 22:00:17.650 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 22:00:17.650 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 22:00:17.650 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 22:00:17.650 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 22:00:17.650 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 22:00:17.650 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 22:00:17.650 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 22:00:17.650 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 22:00:17.650 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 22:00:17.650 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 22:00:17.650 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 22:00:17.650 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 22:00:17.650 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 22:00:17.650 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 22:00:17.650 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 22:00:17.650 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 22:00:17.650 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:00:17.650 1 ERROR oslo_service.service 
>2018-06-25 22:00:17.653 1 CRITICAL cinder [req-ff3283d5-8746-46f6-9ee8-2422102ea6de - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 22:00:17.653 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 22:00:17.653 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 22:00:17.653 1 ERROR cinder     sys.exit(main())
>2018-06-25 22:00:17.653 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 22:00:17.653 1 ERROR cinder     service.wait()
>2018-06-25 22:00:17.653 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 22:00:17.653 1 ERROR cinder     _launcher.wait()
>2018-06-25 22:00:17.653 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 22:00:17.653 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 22:00:17.653 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 22:00:17.653 1 ERROR cinder     self.services.wait()
>2018-06-25 22:00:17.653 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 22:00:17.653 1 ERROR cinder     service.wait()
>2018-06-25 22:00:17.653 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 22:00:17.653 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 22:00:17.653 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 22:00:17.653 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 22:00:17.653 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 22:00:17.653 1 ERROR cinder     post_fn = fn()
>2018-06-25 22:00:17.653 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 22:00:17.653 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 22:00:17.653 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 22:00:17.653 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 22:00:17.653 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 22:00:17.653 1 ERROR cinder 
>2018-06-25 22:00:20.546 1 WARNING cinder.scheduler.host_manager [req-ab99ef2d-3712-4848-a4a0-334466bbfdba - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 22:00:20.555 1 INFO cinder.rpc [req-ab99ef2d-3712-4848-a4a0-334466bbfdba - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 22:00:20.564 1 INFO cinder.rpc [req-ab99ef2d-3712-4848-a4a0-334466bbfdba - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 22:00:20.577 1 INFO cinder.rpc [req-ab99ef2d-3712-4848-a4a0-334466bbfdba - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 22:00:20.584 1 INFO cinder.rpc [req-ab99ef2d-3712-4848-a4a0-334466bbfdba - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 22:00:20.610 1 WARNING oslo_config.cfg [req-ab99ef2d-3712-4848-a4a0-334466bbfdba - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 22:00:20.612 1 WARNING oslo_config.cfg [req-ab99ef2d-3712-4848-a4a0-334466bbfdba - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:00:20.613 1 WARNING oslo_config.cfg [req-ab99ef2d-3712-4848-a4a0-334466bbfdba - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:00:20.614 1 WARNING oslo_config.cfg [req-ab99ef2d-3712-4848-a4a0-334466bbfdba - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:00:20.619 1 WARNING oslo_config.cfg [req-ab99ef2d-3712-4848-a4a0-334466bbfdba - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 22:00:20.620 1 WARNING oslo_config.cfg [req-ab99ef2d-3712-4848-a4a0-334466bbfdba - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 22:00:20.623 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 22:00:20.629 1 INFO cinder.manager [req-7ec54563-ac3c-473d-bc17-75fe828a61e1 - - - - -] Initiating service 5 cleanup
>2018-06-25 22:00:20.634 1 INFO cinder.manager [req-7ec54563-ac3c-473d-bc17-75fe828a61e1 - - - - -] Service 5 cleanup completed.
>2018-06-25 22:02:25.066 1 ERROR oslo.messaging._drivers.impl_rabbit [req-7ec54563-ac3c-473d-bc17-75fe828a61e1 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:02:25.068 1 ERROR oslo.messaging._drivers.impl_rabbit [req-7ec54563-ac3c-473d-bc17-75fe828a61e1 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:02:25.069 1 ERROR oslo_service.service [req-7ec54563-ac3c-473d-bc17-75fe828a61e1 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:02:25.069 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 22:02:25.069 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 22:02:25.069 1 ERROR oslo_service.service     service.start()
>2018-06-25 22:02:25.069 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 22:02:25.069 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 22:02:25.069 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 22:02:25.069 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 22:02:25.069 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 22:02:25.069 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 22:02:25.069 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 22:02:25.069 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 22:02:25.069 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 22:02:25.069 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 22:02:25.069 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 22:02:25.069 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 22:02:25.069 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 22:02:25.069 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 22:02:25.069 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 22:02:25.069 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 22:02:25.069 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 22:02:25.069 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 22:02:25.069 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 22:02:25.069 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 22:02:25.069 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 22:02:25.069 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 22:02:25.069 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:02:25.069 1 ERROR oslo_service.service 
>2018-06-25 22:02:25.071 1 CRITICAL cinder [req-ab99ef2d-3712-4848-a4a0-334466bbfdba - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 22:02:25.071 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 22:02:25.071 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 22:02:25.071 1 ERROR cinder     sys.exit(main())
>2018-06-25 22:02:25.071 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 22:02:25.071 1 ERROR cinder     service.wait()
>2018-06-25 22:02:25.071 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 22:02:25.071 1 ERROR cinder     _launcher.wait()
>2018-06-25 22:02:25.071 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 22:02:25.071 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 22:02:25.071 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 22:02:25.071 1 ERROR cinder     self.services.wait()
>2018-06-25 22:02:25.071 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 22:02:25.071 1 ERROR cinder     service.wait()
>2018-06-25 22:02:25.071 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 22:02:25.071 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 22:02:25.071 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 22:02:25.071 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 22:02:25.071 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 22:02:25.071 1 ERROR cinder     post_fn = fn()
>2018-06-25 22:02:25.071 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 22:02:25.071 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 22:02:25.071 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 22:02:25.071 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 22:02:25.071 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 22:02:25.071 1 ERROR cinder 
>2018-06-25 22:02:27.856 1 WARNING cinder.scheduler.host_manager [req-3e15f159-5b8c-4455-aea3-305dbf46d89d - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 22:02:27.862 1 INFO cinder.rpc [req-3e15f159-5b8c-4455-aea3-305dbf46d89d - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 22:02:27.868 1 INFO cinder.rpc [req-3e15f159-5b8c-4455-aea3-305dbf46d89d - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 22:02:27.884 1 INFO cinder.rpc [req-3e15f159-5b8c-4455-aea3-305dbf46d89d - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 22:02:27.891 1 INFO cinder.rpc [req-3e15f159-5b8c-4455-aea3-305dbf46d89d - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 22:02:27.918 1 WARNING oslo_config.cfg [req-3e15f159-5b8c-4455-aea3-305dbf46d89d - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 22:02:27.920 1 WARNING oslo_config.cfg [req-3e15f159-5b8c-4455-aea3-305dbf46d89d - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:02:27.921 1 WARNING oslo_config.cfg [req-3e15f159-5b8c-4455-aea3-305dbf46d89d - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:02:27.922 1 WARNING oslo_config.cfg [req-3e15f159-5b8c-4455-aea3-305dbf46d89d - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:02:27.927 1 WARNING oslo_config.cfg [req-3e15f159-5b8c-4455-aea3-305dbf46d89d - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 22:02:27.929 1 WARNING oslo_config.cfg [req-3e15f159-5b8c-4455-aea3-305dbf46d89d - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 22:02:27.932 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 22:02:27.937 1 INFO cinder.manager [req-c397a24c-a36f-4b1d-a5ff-2c88a88b9cb2 - - - - -] Initiating service 5 cleanup
>2018-06-25 22:02:27.944 1 INFO cinder.manager [req-c397a24c-a36f-4b1d-a5ff-2c88a88b9cb2 - - - - -] Service 5 cleanup completed.
>2018-06-25 22:04:34.826 1 ERROR oslo.messaging._drivers.impl_rabbit [req-c397a24c-a36f-4b1d-a5ff-2c88a88b9cb2 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:04:34.827 1 ERROR oslo.messaging._drivers.impl_rabbit [req-c397a24c-a36f-4b1d-a5ff-2c88a88b9cb2 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:04:34.828 1 ERROR oslo_service.service [req-c397a24c-a36f-4b1d-a5ff-2c88a88b9cb2 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:04:34.828 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 22:04:34.828 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 22:04:34.828 1 ERROR oslo_service.service     service.start()
>2018-06-25 22:04:34.828 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 22:04:34.828 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 22:04:34.828 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 22:04:34.828 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 22:04:34.828 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 22:04:34.828 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 22:04:34.828 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 22:04:34.828 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 22:04:34.828 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 22:04:34.828 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 22:04:34.828 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 22:04:34.828 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 22:04:34.828 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 22:04:34.828 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 22:04:34.828 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 22:04:34.828 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 22:04:34.828 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 22:04:34.828 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 22:04:34.828 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 22:04:34.828 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 22:04:34.828 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 22:04:34.828 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 22:04:34.828 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:04:34.828 1 ERROR oslo_service.service 
>2018-06-25 22:04:34.830 1 CRITICAL cinder [req-3e15f159-5b8c-4455-aea3-305dbf46d89d - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 22:04:34.830 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 22:04:34.830 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 22:04:34.830 1 ERROR cinder     sys.exit(main())
>2018-06-25 22:04:34.830 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 22:04:34.830 1 ERROR cinder     service.wait()
>2018-06-25 22:04:34.830 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 22:04:34.830 1 ERROR cinder     _launcher.wait()
>2018-06-25 22:04:34.830 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 22:04:34.830 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 22:04:34.830 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 22:04:34.830 1 ERROR cinder     self.services.wait()
>2018-06-25 22:04:34.830 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 22:04:34.830 1 ERROR cinder     service.wait()
>2018-06-25 22:04:34.830 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 22:04:34.830 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 22:04:34.830 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 22:04:34.830 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 22:04:34.830 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 22:04:34.830 1 ERROR cinder     post_fn = fn()
>2018-06-25 22:04:34.830 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 22:04:34.830 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 22:04:34.830 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 22:04:34.830 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 22:04:34.830 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 22:04:34.830 1 ERROR cinder 
>2018-06-25 22:04:37.474 1 WARNING cinder.scheduler.host_manager [req-ad7b7f58-e566-43da-a60b-792a4b867278 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 22:04:37.481 1 INFO cinder.rpc [req-ad7b7f58-e566-43da-a60b-792a4b867278 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 22:04:37.486 1 INFO cinder.rpc [req-ad7b7f58-e566-43da-a60b-792a4b867278 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 22:04:37.500 1 INFO cinder.rpc [req-ad7b7f58-e566-43da-a60b-792a4b867278 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 22:04:37.507 1 INFO cinder.rpc [req-ad7b7f58-e566-43da-a60b-792a4b867278 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 22:04:37.533 1 WARNING oslo_config.cfg [req-ad7b7f58-e566-43da-a60b-792a4b867278 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 22:04:37.535 1 WARNING oslo_config.cfg [req-ad7b7f58-e566-43da-a60b-792a4b867278 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:04:37.536 1 WARNING oslo_config.cfg [req-ad7b7f58-e566-43da-a60b-792a4b867278 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:04:37.536 1 WARNING oslo_config.cfg [req-ad7b7f58-e566-43da-a60b-792a4b867278 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:04:37.542 1 WARNING oslo_config.cfg [req-ad7b7f58-e566-43da-a60b-792a4b867278 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 22:04:37.543 1 WARNING oslo_config.cfg [req-ad7b7f58-e566-43da-a60b-792a4b867278 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 22:04:37.546 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 22:04:37.553 1 INFO cinder.manager [req-cc62c737-9b0a-468e-916a-88814357315a - - - - -] Initiating service 5 cleanup
>2018-06-25 22:04:37.562 1 INFO cinder.manager [req-cc62c737-9b0a-468e-916a-88814357315a - - - - -] Service 5 cleanup completed.
>2018-06-25 22:06:49.165 1 ERROR oslo.messaging._drivers.impl_rabbit [req-cc62c737-9b0a-468e-916a-88814357315a - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:06:49.167 1 ERROR oslo.messaging._drivers.impl_rabbit [req-cc62c737-9b0a-468e-916a-88814357315a - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:06:49.168 1 ERROR oslo_service.service [req-cc62c737-9b0a-468e-916a-88814357315a - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:06:49.168 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 22:06:49.168 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 22:06:49.168 1 ERROR oslo_service.service     service.start()
>2018-06-25 22:06:49.168 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 22:06:49.168 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 22:06:49.168 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 22:06:49.168 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 22:06:49.168 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 22:06:49.168 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 22:06:49.168 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 22:06:49.168 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 22:06:49.168 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 22:06:49.168 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 22:06:49.168 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 22:06:49.168 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 22:06:49.168 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 22:06:49.168 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 22:06:49.168 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 22:06:49.168 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 22:06:49.168 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 22:06:49.168 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 22:06:49.168 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 22:06:49.168 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 22:06:49.168 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 22:06:49.168 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 22:06:49.168 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:06:49.168 1 ERROR oslo_service.service 
>2018-06-25 22:06:49.171 1 CRITICAL cinder [req-ad7b7f58-e566-43da-a60b-792a4b867278 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 22:06:49.171 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 22:06:49.171 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 22:06:49.171 1 ERROR cinder     sys.exit(main())
>2018-06-25 22:06:49.171 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 22:06:49.171 1 ERROR cinder     service.wait()
>2018-06-25 22:06:49.171 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 22:06:49.171 1 ERROR cinder     _launcher.wait()
>2018-06-25 22:06:49.171 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 22:06:49.171 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 22:06:49.171 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 22:06:49.171 1 ERROR cinder     self.services.wait()
>2018-06-25 22:06:49.171 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 22:06:49.171 1 ERROR cinder     service.wait()
>2018-06-25 22:06:49.171 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 22:06:49.171 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 22:06:49.171 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 22:06:49.171 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 22:06:49.171 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 22:06:49.171 1 ERROR cinder     post_fn = fn()
>2018-06-25 22:06:49.171 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 22:06:49.171 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 22:06:49.171 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 22:06:49.171 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 22:06:49.171 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 22:06:49.171 1 ERROR cinder 
>2018-06-25 22:06:51.839 1 WARNING cinder.scheduler.host_manager [req-f657ab30-4b7d-4b16-b852-a3680e0e0ad5 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 22:06:51.848 1 INFO cinder.rpc [req-f657ab30-4b7d-4b16-b852-a3680e0e0ad5 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 22:06:51.857 1 INFO cinder.rpc [req-f657ab30-4b7d-4b16-b852-a3680e0e0ad5 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 22:06:51.878 1 INFO cinder.rpc [req-f657ab30-4b7d-4b16-b852-a3680e0e0ad5 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 22:06:51.885 1 INFO cinder.rpc [req-f657ab30-4b7d-4b16-b852-a3680e0e0ad5 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 22:06:51.926 1 WARNING oslo_config.cfg [req-f657ab30-4b7d-4b16-b852-a3680e0e0ad5 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 22:06:51.928 1 WARNING oslo_config.cfg [req-f657ab30-4b7d-4b16-b852-a3680e0e0ad5 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:06:51.929 1 WARNING oslo_config.cfg [req-f657ab30-4b7d-4b16-b852-a3680e0e0ad5 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:06:51.929 1 WARNING oslo_config.cfg [req-f657ab30-4b7d-4b16-b852-a3680e0e0ad5 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:06:51.934 1 WARNING oslo_config.cfg [req-f657ab30-4b7d-4b16-b852-a3680e0e0ad5 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 22:06:51.935 1 WARNING oslo_config.cfg [req-f657ab30-4b7d-4b16-b852-a3680e0e0ad5 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 22:06:51.938 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 22:06:51.945 1 INFO cinder.manager [req-7a21024e-7118-4c01-9ba6-93a32d56f464 - - - - -] Initiating service 5 cleanup
>2018-06-25 22:06:51.951 1 INFO cinder.manager [req-7a21024e-7118-4c01-9ba6-93a32d56f464 - - - - -] Service 5 cleanup completed.
>2018-06-25 22:09:03.469 1 ERROR oslo.messaging._drivers.impl_rabbit [req-7a21024e-7118-4c01-9ba6-93a32d56f464 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:09:03.471 1 ERROR oslo.messaging._drivers.impl_rabbit [req-7a21024e-7118-4c01-9ba6-93a32d56f464 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:09:03.471 1 ERROR oslo_service.service [req-7a21024e-7118-4c01-9ba6-93a32d56f464 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:09:03.471 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 22:09:03.471 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 22:09:03.471 1 ERROR oslo_service.service     service.start()
>2018-06-25 22:09:03.471 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 22:09:03.471 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 22:09:03.471 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 22:09:03.471 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 22:09:03.471 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 22:09:03.471 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 22:09:03.471 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 22:09:03.471 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 22:09:03.471 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 22:09:03.471 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 22:09:03.471 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 22:09:03.471 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 22:09:03.471 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 22:09:03.471 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 22:09:03.471 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 22:09:03.471 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 22:09:03.471 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 22:09:03.471 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 22:09:03.471 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 22:09:03.471 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 22:09:03.471 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 22:09:03.471 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 22:09:03.471 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:09:03.471 1 ERROR oslo_service.service 
>2018-06-25 22:09:03.474 1 CRITICAL cinder [req-f657ab30-4b7d-4b16-b852-a3680e0e0ad5 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 22:09:03.474 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 22:09:03.474 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 22:09:03.474 1 ERROR cinder     sys.exit(main())
>2018-06-25 22:09:03.474 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 22:09:03.474 1 ERROR cinder     service.wait()
>2018-06-25 22:09:03.474 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 22:09:03.474 1 ERROR cinder     _launcher.wait()
>2018-06-25 22:09:03.474 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 22:09:03.474 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 22:09:03.474 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 22:09:03.474 1 ERROR cinder     self.services.wait()
>2018-06-25 22:09:03.474 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 22:09:03.474 1 ERROR cinder     service.wait()
>2018-06-25 22:09:03.474 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 22:09:03.474 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 22:09:03.474 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 22:09:03.474 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 22:09:03.474 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 22:09:03.474 1 ERROR cinder     post_fn = fn()
>2018-06-25 22:09:03.474 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 22:09:03.474 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 22:09:03.474 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 22:09:03.474 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 22:09:03.474 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 22:09:03.474 1 ERROR cinder 
>2018-06-25 22:09:06.137 1 WARNING cinder.scheduler.host_manager [req-e401cc36-c795-4462-9713-7b2440296b01 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 22:09:06.149 1 INFO cinder.rpc [req-e401cc36-c795-4462-9713-7b2440296b01 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 22:09:06.157 1 INFO cinder.rpc [req-e401cc36-c795-4462-9713-7b2440296b01 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 22:09:06.173 1 INFO cinder.rpc [req-e401cc36-c795-4462-9713-7b2440296b01 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 22:09:06.180 1 INFO cinder.rpc [req-e401cc36-c795-4462-9713-7b2440296b01 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 22:09:06.211 1 WARNING oslo_config.cfg [req-e401cc36-c795-4462-9713-7b2440296b01 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 22:09:06.213 1 WARNING oslo_config.cfg [req-e401cc36-c795-4462-9713-7b2440296b01 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:09:06.214 1 WARNING oslo_config.cfg [req-e401cc36-c795-4462-9713-7b2440296b01 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:09:06.214 1 WARNING oslo_config.cfg [req-e401cc36-c795-4462-9713-7b2440296b01 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:09:06.219 1 WARNING oslo_config.cfg [req-e401cc36-c795-4462-9713-7b2440296b01 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 22:09:06.221 1 WARNING oslo_config.cfg [req-e401cc36-c795-4462-9713-7b2440296b01 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 22:09:06.223 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 22:09:06.230 1 INFO cinder.manager [req-50791444-cd99-4d9b-81a1-eeb727ab903e - - - - -] Initiating service 5 cleanup
>2018-06-25 22:09:06.241 1 INFO cinder.manager [req-50791444-cd99-4d9b-81a1-eeb727ab903e - - - - -] Service 5 cleanup completed.
>2018-06-25 22:11:10.604 1 ERROR oslo.messaging._drivers.impl_rabbit [req-50791444-cd99-4d9b-81a1-eeb727ab903e - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:11:10.606 1 ERROR oslo.messaging._drivers.impl_rabbit [req-50791444-cd99-4d9b-81a1-eeb727ab903e - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:11:10.606 1 ERROR oslo_service.service [req-50791444-cd99-4d9b-81a1-eeb727ab903e - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:11:10.606 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 22:11:10.606 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 22:11:10.606 1 ERROR oslo_service.service     service.start()
>2018-06-25 22:11:10.606 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 22:11:10.606 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 22:11:10.606 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 22:11:10.606 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 22:11:10.606 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 22:11:10.606 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 22:11:10.606 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 22:11:10.606 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 22:11:10.606 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 22:11:10.606 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 22:11:10.606 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 22:11:10.606 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 22:11:10.606 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 22:11:10.606 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 22:11:10.606 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 22:11:10.606 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 22:11:10.606 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 22:11:10.606 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 22:11:10.606 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 22:11:10.606 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 22:11:10.606 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 22:11:10.606 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 22:11:10.606 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:11:10.606 1 ERROR oslo_service.service 
>2018-06-25 22:11:10.609 1 CRITICAL cinder [req-e401cc36-c795-4462-9713-7b2440296b01 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 22:11:10.609 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 22:11:10.609 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 22:11:10.609 1 ERROR cinder     sys.exit(main())
>2018-06-25 22:11:10.609 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 22:11:10.609 1 ERROR cinder     service.wait()
>2018-06-25 22:11:10.609 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 22:11:10.609 1 ERROR cinder     _launcher.wait()
>2018-06-25 22:11:10.609 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 22:11:10.609 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 22:11:10.609 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 22:11:10.609 1 ERROR cinder     self.services.wait()
>2018-06-25 22:11:10.609 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 22:11:10.609 1 ERROR cinder     service.wait()
>2018-06-25 22:11:10.609 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 22:11:10.609 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 22:11:10.609 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 22:11:10.609 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 22:11:10.609 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 22:11:10.609 1 ERROR cinder     post_fn = fn()
>2018-06-25 22:11:10.609 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 22:11:10.609 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 22:11:10.609 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 22:11:10.609 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 22:11:10.609 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 22:11:10.609 1 ERROR cinder 
>2018-06-25 22:11:13.214 1 WARNING cinder.scheduler.host_manager [req-0f83940f-062e-47d0-9fa0-53fdbe84de87 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 22:11:13.221 1 INFO cinder.rpc [req-0f83940f-062e-47d0-9fa0-53fdbe84de87 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 22:11:13.226 1 INFO cinder.rpc [req-0f83940f-062e-47d0-9fa0-53fdbe84de87 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 22:11:13.240 1 INFO cinder.rpc [req-0f83940f-062e-47d0-9fa0-53fdbe84de87 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 22:11:13.245 1 INFO cinder.rpc [req-0f83940f-062e-47d0-9fa0-53fdbe84de87 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 22:11:13.269 1 WARNING oslo_config.cfg [req-0f83940f-062e-47d0-9fa0-53fdbe84de87 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 22:11:13.272 1 WARNING oslo_config.cfg [req-0f83940f-062e-47d0-9fa0-53fdbe84de87 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:11:13.272 1 WARNING oslo_config.cfg [req-0f83940f-062e-47d0-9fa0-53fdbe84de87 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:11:13.273 1 WARNING oslo_config.cfg [req-0f83940f-062e-47d0-9fa0-53fdbe84de87 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:11:13.278 1 WARNING oslo_config.cfg [req-0f83940f-062e-47d0-9fa0-53fdbe84de87 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 22:11:13.279 1 WARNING oslo_config.cfg [req-0f83940f-062e-47d0-9fa0-53fdbe84de87 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 22:11:13.282 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 22:11:13.288 1 INFO cinder.manager [req-45afff53-653b-4406-aadd-6f8400443cf6 - - - - -] Initiating service 5 cleanup
>2018-06-25 22:11:13.292 1 INFO cinder.manager [req-45afff53-653b-4406-aadd-6f8400443cf6 - - - - -] Service 5 cleanup completed.
>2018-06-25 22:13:17.798 1 ERROR oslo.messaging._drivers.impl_rabbit [req-45afff53-653b-4406-aadd-6f8400443cf6 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:13:17.800 1 ERROR oslo.messaging._drivers.impl_rabbit [req-45afff53-653b-4406-aadd-6f8400443cf6 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:13:17.801 1 ERROR oslo_service.service [req-45afff53-653b-4406-aadd-6f8400443cf6 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:13:17.801 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 22:13:17.801 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 22:13:17.801 1 ERROR oslo_service.service     service.start()
>2018-06-25 22:13:17.801 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 22:13:17.801 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 22:13:17.801 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 22:13:17.801 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 22:13:17.801 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 22:13:17.801 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 22:13:17.801 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 22:13:17.801 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 22:13:17.801 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 22:13:17.801 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 22:13:17.801 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 22:13:17.801 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 22:13:17.801 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 22:13:17.801 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 22:13:17.801 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 22:13:17.801 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 22:13:17.801 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 22:13:17.801 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 22:13:17.801 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 22:13:17.801 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 22:13:17.801 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 22:13:17.801 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 22:13:17.801 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:13:17.801 1 ERROR oslo_service.service 
>2018-06-25 22:13:17.803 1 CRITICAL cinder [req-0f83940f-062e-47d0-9fa0-53fdbe84de87 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 22:13:17.803 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 22:13:17.803 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 22:13:17.803 1 ERROR cinder     sys.exit(main())
>2018-06-25 22:13:17.803 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 22:13:17.803 1 ERROR cinder     service.wait()
>2018-06-25 22:13:17.803 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 22:13:17.803 1 ERROR cinder     _launcher.wait()
>2018-06-25 22:13:17.803 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 22:13:17.803 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 22:13:17.803 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 22:13:17.803 1 ERROR cinder     self.services.wait()
>2018-06-25 22:13:17.803 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 22:13:17.803 1 ERROR cinder     service.wait()
>2018-06-25 22:13:17.803 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 22:13:17.803 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 22:13:17.803 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 22:13:17.803 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 22:13:17.803 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 22:13:17.803 1 ERROR cinder     post_fn = fn()
>2018-06-25 22:13:17.803 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 22:13:17.803 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 22:13:17.803 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 22:13:17.803 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 22:13:17.803 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 22:13:17.803 1 ERROR cinder 
>2018-06-25 22:13:20.602 1 WARNING cinder.scheduler.host_manager [req-036bdfd0-9ca7-4b38-98e5-1d838d090729 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 22:13:20.610 1 INFO cinder.rpc [req-036bdfd0-9ca7-4b38-98e5-1d838d090729 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 22:13:20.616 1 INFO cinder.rpc [req-036bdfd0-9ca7-4b38-98e5-1d838d090729 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 22:13:20.627 1 INFO cinder.rpc [req-036bdfd0-9ca7-4b38-98e5-1d838d090729 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 22:13:20.633 1 INFO cinder.rpc [req-036bdfd0-9ca7-4b38-98e5-1d838d090729 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 22:13:20.657 1 WARNING oslo_config.cfg [req-036bdfd0-9ca7-4b38-98e5-1d838d090729 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 22:13:20.659 1 WARNING oslo_config.cfg [req-036bdfd0-9ca7-4b38-98e5-1d838d090729 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:13:20.660 1 WARNING oslo_config.cfg [req-036bdfd0-9ca7-4b38-98e5-1d838d090729 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:13:20.660 1 WARNING oslo_config.cfg [req-036bdfd0-9ca7-4b38-98e5-1d838d090729 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:13:20.665 1 WARNING oslo_config.cfg [req-036bdfd0-9ca7-4b38-98e5-1d838d090729 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 22:13:20.667 1 WARNING oslo_config.cfg [req-036bdfd0-9ca7-4b38-98e5-1d838d090729 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 22:13:20.670 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 22:13:20.677 1 INFO cinder.manager [req-1fe3e939-3d77-48a6-ab9d-422c4c6295ba - - - - -] Initiating service 5 cleanup
>2018-06-25 22:13:20.681 1 INFO cinder.manager [req-1fe3e939-3d77-48a6-ab9d-422c4c6295ba - - - - -] Service 5 cleanup completed.
>2018-06-25 22:15:32.262 1 ERROR oslo.messaging._drivers.impl_rabbit [req-1fe3e939-3d77-48a6-ab9d-422c4c6295ba - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:15:32.265 1 ERROR oslo.messaging._drivers.impl_rabbit [req-1fe3e939-3d77-48a6-ab9d-422c4c6295ba - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:15:32.266 1 ERROR oslo_service.service [req-1fe3e939-3d77-48a6-ab9d-422c4c6295ba - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:15:32.266 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 22:15:32.266 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 22:15:32.266 1 ERROR oslo_service.service     service.start()
>2018-06-25 22:15:32.266 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 22:15:32.266 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 22:15:32.266 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 22:15:32.266 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 22:15:32.266 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 22:15:32.266 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 22:15:32.266 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 22:15:32.266 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 22:15:32.266 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 22:15:32.266 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 22:15:32.266 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 22:15:32.266 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 22:15:32.266 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 22:15:32.266 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 22:15:32.266 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 22:15:32.266 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 22:15:32.266 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 22:15:32.266 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 22:15:32.266 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 22:15:32.266 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 22:15:32.266 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 22:15:32.266 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 22:15:32.266 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:15:32.266 1 ERROR oslo_service.service 
>2018-06-25 22:15:32.270 1 CRITICAL cinder [req-036bdfd0-9ca7-4b38-98e5-1d838d090729 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 22:15:32.270 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 22:15:32.270 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 22:15:32.270 1 ERROR cinder     sys.exit(main())
>2018-06-25 22:15:32.270 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 22:15:32.270 1 ERROR cinder     service.wait()
>2018-06-25 22:15:32.270 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 22:15:32.270 1 ERROR cinder     _launcher.wait()
>2018-06-25 22:15:32.270 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 22:15:32.270 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 22:15:32.270 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 22:15:32.270 1 ERROR cinder     self.services.wait()
>2018-06-25 22:15:32.270 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 22:15:32.270 1 ERROR cinder     service.wait()
>2018-06-25 22:15:32.270 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 22:15:32.270 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 22:15:32.270 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 22:15:32.270 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 22:15:32.270 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 22:15:32.270 1 ERROR cinder     post_fn = fn()
>2018-06-25 22:15:32.270 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 22:15:32.270 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 22:15:32.270 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 22:15:32.270 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 22:15:32.270 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 22:15:32.270 1 ERROR cinder 
>2018-06-25 22:15:34.972 1 WARNING cinder.scheduler.host_manager [req-b74c9b58-bb94-4a9e-98f5-c9a9215f1841 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 22:15:34.978 1 INFO cinder.rpc [req-b74c9b58-bb94-4a9e-98f5-c9a9215f1841 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 22:15:34.983 1 INFO cinder.rpc [req-b74c9b58-bb94-4a9e-98f5-c9a9215f1841 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 22:15:34.995 1 INFO cinder.rpc [req-b74c9b58-bb94-4a9e-98f5-c9a9215f1841 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 22:15:35.003 1 INFO cinder.rpc [req-b74c9b58-bb94-4a9e-98f5-c9a9215f1841 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 22:15:35.030 1 WARNING oslo_config.cfg [req-b74c9b58-bb94-4a9e-98f5-c9a9215f1841 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 22:15:35.032 1 WARNING oslo_config.cfg [req-b74c9b58-bb94-4a9e-98f5-c9a9215f1841 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:15:35.033 1 WARNING oslo_config.cfg [req-b74c9b58-bb94-4a9e-98f5-c9a9215f1841 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:15:35.033 1 WARNING oslo_config.cfg [req-b74c9b58-bb94-4a9e-98f5-c9a9215f1841 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:15:35.039 1 WARNING oslo_config.cfg [req-b74c9b58-bb94-4a9e-98f5-c9a9215f1841 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 22:15:35.040 1 WARNING oslo_config.cfg [req-b74c9b58-bb94-4a9e-98f5-c9a9215f1841 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 22:15:35.042 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 22:15:35.051 1 INFO cinder.manager [req-1d00ee62-da6e-403d-a637-3900c7ffe942 - - - - -] Initiating service 5 cleanup
>2018-06-25 22:15:35.057 1 INFO cinder.manager [req-1d00ee62-da6e-403d-a637-3900c7ffe942 - - - - -] Service 5 cleanup completed.
>2018-06-25 22:17:46.629 1 ERROR oslo.messaging._drivers.impl_rabbit [req-1d00ee62-da6e-403d-a637-3900c7ffe942 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:17:46.631 1 ERROR oslo.messaging._drivers.impl_rabbit [req-1d00ee62-da6e-403d-a637-3900c7ffe942 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:17:46.632 1 ERROR oslo_service.service [req-1d00ee62-da6e-403d-a637-3900c7ffe942 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:17:46.632 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 22:17:46.632 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 22:17:46.632 1 ERROR oslo_service.service     service.start()
>2018-06-25 22:17:46.632 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 22:17:46.632 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 22:17:46.632 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 22:17:46.632 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 22:17:46.632 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 22:17:46.632 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 22:17:46.632 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 22:17:46.632 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 22:17:46.632 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 22:17:46.632 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 22:17:46.632 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 22:17:46.632 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 22:17:46.632 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 22:17:46.632 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 22:17:46.632 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 22:17:46.632 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 22:17:46.632 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 22:17:46.632 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 22:17:46.632 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 22:17:46.632 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 22:17:46.632 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 22:17:46.632 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 22:17:46.632 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:17:46.632 1 ERROR oslo_service.service 
>2018-06-25 22:17:46.635 1 CRITICAL cinder [req-b74c9b58-bb94-4a9e-98f5-c9a9215f1841 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 22:17:46.635 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 22:17:46.635 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 22:17:46.635 1 ERROR cinder     sys.exit(main())
>2018-06-25 22:17:46.635 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 22:17:46.635 1 ERROR cinder     service.wait()
>2018-06-25 22:17:46.635 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 22:17:46.635 1 ERROR cinder     _launcher.wait()
>2018-06-25 22:17:46.635 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 22:17:46.635 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 22:17:46.635 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 22:17:46.635 1 ERROR cinder     self.services.wait()
>2018-06-25 22:17:46.635 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 22:17:46.635 1 ERROR cinder     service.wait()
>2018-06-25 22:17:46.635 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 22:17:46.635 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 22:17:46.635 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 22:17:46.635 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 22:17:46.635 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 22:17:46.635 1 ERROR cinder     post_fn = fn()
>2018-06-25 22:17:46.635 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 22:17:46.635 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 22:17:46.635 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 22:17:46.635 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 22:17:46.635 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 22:17:46.635 1 ERROR cinder 
>2018-06-25 22:17:49.305 1 WARNING cinder.scheduler.host_manager [req-873ed8bf-550e-4a3e-aa7d-bfda5bdd36d0 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 22:17:49.354 1 INFO cinder.rpc [req-873ed8bf-550e-4a3e-aa7d-bfda5bdd36d0 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 22:17:49.368 1 INFO cinder.rpc [req-873ed8bf-550e-4a3e-aa7d-bfda5bdd36d0 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 22:17:49.389 1 INFO cinder.rpc [req-873ed8bf-550e-4a3e-aa7d-bfda5bdd36d0 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 22:17:49.403 1 INFO cinder.rpc [req-873ed8bf-550e-4a3e-aa7d-bfda5bdd36d0 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 22:17:49.457 1 WARNING oslo_config.cfg [req-873ed8bf-550e-4a3e-aa7d-bfda5bdd36d0 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 22:17:49.459 1 WARNING oslo_config.cfg [req-873ed8bf-550e-4a3e-aa7d-bfda5bdd36d0 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:17:49.460 1 WARNING oslo_config.cfg [req-873ed8bf-550e-4a3e-aa7d-bfda5bdd36d0 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:17:49.460 1 WARNING oslo_config.cfg [req-873ed8bf-550e-4a3e-aa7d-bfda5bdd36d0 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:17:49.465 1 WARNING oslo_config.cfg [req-873ed8bf-550e-4a3e-aa7d-bfda5bdd36d0 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 22:17:49.466 1 WARNING oslo_config.cfg [req-873ed8bf-550e-4a3e-aa7d-bfda5bdd36d0 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 22:17:49.469 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 22:17:49.480 1 INFO cinder.manager [req-96dfb4b3-dea8-497e-aae8-94696125d341 - - - - -] Initiating service 5 cleanup
>2018-06-25 22:17:49.487 1 INFO cinder.manager [req-96dfb4b3-dea8-497e-aae8-94696125d341 - - - - -] Service 5 cleanup completed.
>2018-06-25 22:19:53.835 1 ERROR oslo.messaging._drivers.impl_rabbit [req-96dfb4b3-dea8-497e-aae8-94696125d341 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:19:53.838 1 ERROR oslo.messaging._drivers.impl_rabbit [req-96dfb4b3-dea8-497e-aae8-94696125d341 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:19:53.838 1 ERROR oslo_service.service [req-96dfb4b3-dea8-497e-aae8-94696125d341 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:19:53.838 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 22:19:53.838 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 22:19:53.838 1 ERROR oslo_service.service     service.start()
>2018-06-25 22:19:53.838 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 22:19:53.838 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 22:19:53.838 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 22:19:53.838 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 22:19:53.838 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 22:19:53.838 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 22:19:53.838 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 22:19:53.838 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 22:19:53.838 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 22:19:53.838 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 22:19:53.838 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 22:19:53.838 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 22:19:53.838 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 22:19:53.838 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 22:19:53.838 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 22:19:53.838 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 22:19:53.838 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 22:19:53.838 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 22:19:53.838 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 22:19:53.838 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 22:19:53.838 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 22:19:53.838 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 22:19:53.838 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:19:53.838 1 ERROR oslo_service.service 
>2018-06-25 22:19:53.840 1 CRITICAL cinder [req-873ed8bf-550e-4a3e-aa7d-bfda5bdd36d0 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 22:19:53.840 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 22:19:53.840 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 22:19:53.840 1 ERROR cinder     sys.exit(main())
>2018-06-25 22:19:53.840 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 22:19:53.840 1 ERROR cinder     service.wait()
>2018-06-25 22:19:53.840 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 22:19:53.840 1 ERROR cinder     _launcher.wait()
>2018-06-25 22:19:53.840 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 22:19:53.840 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 22:19:53.840 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 22:19:53.840 1 ERROR cinder     self.services.wait()
>2018-06-25 22:19:53.840 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 22:19:53.840 1 ERROR cinder     service.wait()
>2018-06-25 22:19:53.840 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 22:19:53.840 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 22:19:53.840 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 22:19:53.840 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 22:19:53.840 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 22:19:53.840 1 ERROR cinder     post_fn = fn()
>2018-06-25 22:19:53.840 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 22:19:53.840 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 22:19:53.840 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 22:19:53.840 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 22:19:53.840 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 22:19:53.840 1 ERROR cinder 
>2018-06-25 22:19:56.480 1 WARNING cinder.scheduler.host_manager [req-fb15b713-696a-48ed-879f-a7b60ff47a48 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 22:19:56.485 1 INFO cinder.rpc [req-fb15b713-696a-48ed-879f-a7b60ff47a48 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 22:19:56.491 1 INFO cinder.rpc [req-fb15b713-696a-48ed-879f-a7b60ff47a48 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 22:19:56.502 1 INFO cinder.rpc [req-fb15b713-696a-48ed-879f-a7b60ff47a48 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 22:19:56.507 1 INFO cinder.rpc [req-fb15b713-696a-48ed-879f-a7b60ff47a48 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 22:19:56.532 1 WARNING oslo_config.cfg [req-fb15b713-696a-48ed-879f-a7b60ff47a48 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 22:19:56.534 1 WARNING oslo_config.cfg [req-fb15b713-696a-48ed-879f-a7b60ff47a48 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:19:56.535 1 WARNING oslo_config.cfg [req-fb15b713-696a-48ed-879f-a7b60ff47a48 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:19:56.535 1 WARNING oslo_config.cfg [req-fb15b713-696a-48ed-879f-a7b60ff47a48 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:19:56.540 1 WARNING oslo_config.cfg [req-fb15b713-696a-48ed-879f-a7b60ff47a48 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 22:19:56.542 1 WARNING oslo_config.cfg [req-fb15b713-696a-48ed-879f-a7b60ff47a48 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 22:19:56.544 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 22:19:56.550 1 INFO cinder.manager [req-196f26a6-6167-4fa0-bf50-883977e863b3 - - - - -] Initiating service 5 cleanup
>2018-06-25 22:19:56.554 1 INFO cinder.manager [req-196f26a6-6167-4fa0-bf50-883977e863b3 - - - - -] Service 5 cleanup completed.
>2018-06-25 22:22:08.573 1 ERROR oslo.messaging._drivers.impl_rabbit [req-196f26a6-6167-4fa0-bf50-883977e863b3 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:22:08.576 1 ERROR oslo.messaging._drivers.impl_rabbit [req-196f26a6-6167-4fa0-bf50-883977e863b3 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:22:08.576 1 ERROR oslo_service.service [req-196f26a6-6167-4fa0-bf50-883977e863b3 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:22:08.576 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 22:22:08.576 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 22:22:08.576 1 ERROR oslo_service.service     service.start()
>2018-06-25 22:22:08.576 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 22:22:08.576 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 22:22:08.576 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 22:22:08.576 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 22:22:08.576 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 22:22:08.576 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 22:22:08.576 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 22:22:08.576 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 22:22:08.576 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 22:22:08.576 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 22:22:08.576 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 22:22:08.576 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 22:22:08.576 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 22:22:08.576 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 22:22:08.576 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 22:22:08.576 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 22:22:08.576 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 22:22:08.576 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 22:22:08.576 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 22:22:08.576 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 22:22:08.576 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 22:22:08.576 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 22:22:08.576 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:22:08.576 1 ERROR oslo_service.service 
>2018-06-25 22:22:08.579 1 CRITICAL cinder [req-fb15b713-696a-48ed-879f-a7b60ff47a48 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 22:22:08.579 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 22:22:08.579 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 22:22:08.579 1 ERROR cinder     sys.exit(main())
>2018-06-25 22:22:08.579 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 22:22:08.579 1 ERROR cinder     service.wait()
>2018-06-25 22:22:08.579 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 22:22:08.579 1 ERROR cinder     _launcher.wait()
>2018-06-25 22:22:08.579 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 22:22:08.579 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 22:22:08.579 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 22:22:08.579 1 ERROR cinder     self.services.wait()
>2018-06-25 22:22:08.579 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 22:22:08.579 1 ERROR cinder     service.wait()
>2018-06-25 22:22:08.579 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 22:22:08.579 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 22:22:08.579 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 22:22:08.579 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 22:22:08.579 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 22:22:08.579 1 ERROR cinder     post_fn = fn()
>2018-06-25 22:22:08.579 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 22:22:08.579 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 22:22:08.579 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 22:22:08.579 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 22:22:08.579 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 22:22:08.579 1 ERROR cinder 
>2018-06-25 22:22:11.196 1 WARNING cinder.scheduler.host_manager [req-f1aa1175-5096-4115-9580-28d85d0fce2a - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 22:22:11.202 1 INFO cinder.rpc [req-f1aa1175-5096-4115-9580-28d85d0fce2a - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 22:22:11.207 1 INFO cinder.rpc [req-f1aa1175-5096-4115-9580-28d85d0fce2a - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 22:22:11.222 1 INFO cinder.rpc [req-f1aa1175-5096-4115-9580-28d85d0fce2a - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 22:22:11.228 1 INFO cinder.rpc [req-f1aa1175-5096-4115-9580-28d85d0fce2a - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 22:22:11.261 1 WARNING oslo_config.cfg [req-f1aa1175-5096-4115-9580-28d85d0fce2a - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 22:22:11.263 1 WARNING oslo_config.cfg [req-f1aa1175-5096-4115-9580-28d85d0fce2a - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:22:11.264 1 WARNING oslo_config.cfg [req-f1aa1175-5096-4115-9580-28d85d0fce2a - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:22:11.264 1 WARNING oslo_config.cfg [req-f1aa1175-5096-4115-9580-28d85d0fce2a - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:22:11.269 1 WARNING oslo_config.cfg [req-f1aa1175-5096-4115-9580-28d85d0fce2a - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 22:22:11.270 1 WARNING oslo_config.cfg [req-f1aa1175-5096-4115-9580-28d85d0fce2a - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 22:22:11.273 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 22:22:11.280 1 INFO cinder.manager [req-7dd1f69a-29f3-47e8-92f7-88834a382e08 - - - - -] Initiating service 5 cleanup
>2018-06-25 22:22:11.286 1 INFO cinder.manager [req-7dd1f69a-29f3-47e8-92f7-88834a382e08 - - - - -] Service 5 cleanup completed.
>2018-06-25 22:24:23.648 1 ERROR oslo.messaging._drivers.impl_rabbit [req-7dd1f69a-29f3-47e8-92f7-88834a382e08 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:24:23.650 1 ERROR oslo.messaging._drivers.impl_rabbit [req-7dd1f69a-29f3-47e8-92f7-88834a382e08 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:24:23.651 1 ERROR oslo_service.service [req-7dd1f69a-29f3-47e8-92f7-88834a382e08 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:24:23.651 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 22:24:23.651 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 22:24:23.651 1 ERROR oslo_service.service     service.start()
>2018-06-25 22:24:23.651 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 22:24:23.651 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 22:24:23.651 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 22:24:23.651 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 22:24:23.651 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 22:24:23.651 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 22:24:23.651 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 22:24:23.651 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 22:24:23.651 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 22:24:23.651 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 22:24:23.651 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 22:24:23.651 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 22:24:23.651 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 22:24:23.651 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 22:24:23.651 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 22:24:23.651 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 22:24:23.651 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 22:24:23.651 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 22:24:23.651 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 22:24:23.651 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 22:24:23.651 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 22:24:23.651 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 22:24:23.651 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:24:23.651 1 ERROR oslo_service.service 
>2018-06-25 22:24:23.654 1 CRITICAL cinder [req-f1aa1175-5096-4115-9580-28d85d0fce2a - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 22:24:23.654 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 22:24:23.654 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 22:24:23.654 1 ERROR cinder     sys.exit(main())
>2018-06-25 22:24:23.654 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 22:24:23.654 1 ERROR cinder     service.wait()
>2018-06-25 22:24:23.654 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 22:24:23.654 1 ERROR cinder     _launcher.wait()
>2018-06-25 22:24:23.654 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 22:24:23.654 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 22:24:23.654 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 22:24:23.654 1 ERROR cinder     self.services.wait()
>2018-06-25 22:24:23.654 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 22:24:23.654 1 ERROR cinder     service.wait()
>2018-06-25 22:24:23.654 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 22:24:23.654 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 22:24:23.654 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 22:24:23.654 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 22:24:23.654 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 22:24:23.654 1 ERROR cinder     post_fn = fn()
>2018-06-25 22:24:23.654 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 22:24:23.654 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 22:24:23.654 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 22:24:23.654 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 22:24:23.654 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 22:24:23.654 1 ERROR cinder 
>2018-06-25 22:24:26.282 1 WARNING cinder.scheduler.host_manager [req-6ca6c0e9-a1a8-4f70-9fca-1251a6f4c3dd - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 22:24:26.289 1 INFO cinder.rpc [req-6ca6c0e9-a1a8-4f70-9fca-1251a6f4c3dd - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 22:24:26.295 1 INFO cinder.rpc [req-6ca6c0e9-a1a8-4f70-9fca-1251a6f4c3dd - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 22:24:26.306 1 INFO cinder.rpc [req-6ca6c0e9-a1a8-4f70-9fca-1251a6f4c3dd - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 22:24:26.312 1 INFO cinder.rpc [req-6ca6c0e9-a1a8-4f70-9fca-1251a6f4c3dd - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 22:24:26.335 1 WARNING oslo_config.cfg [req-6ca6c0e9-a1a8-4f70-9fca-1251a6f4c3dd - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 22:24:26.337 1 WARNING oslo_config.cfg [req-6ca6c0e9-a1a8-4f70-9fca-1251a6f4c3dd - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:24:26.337 1 WARNING oslo_config.cfg [req-6ca6c0e9-a1a8-4f70-9fca-1251a6f4c3dd - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:24:26.338 1 WARNING oslo_config.cfg [req-6ca6c0e9-a1a8-4f70-9fca-1251a6f4c3dd - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:24:26.343 1 WARNING oslo_config.cfg [req-6ca6c0e9-a1a8-4f70-9fca-1251a6f4c3dd - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 22:24:26.344 1 WARNING oslo_config.cfg [req-6ca6c0e9-a1a8-4f70-9fca-1251a6f4c3dd - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 22:24:26.347 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 22:24:26.353 1 INFO cinder.manager [req-336ebac6-6d73-443a-aa24-71b69e7b562a - - - - -] Initiating service 5 cleanup
>2018-06-25 22:24:26.358 1 INFO cinder.manager [req-336ebac6-6d73-443a-aa24-71b69e7b562a - - - - -] Service 5 cleanup completed.
>2018-06-25 22:26:30.712 1 ERROR oslo.messaging._drivers.impl_rabbit [req-336ebac6-6d73-443a-aa24-71b69e7b562a - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:26:30.714 1 ERROR oslo.messaging._drivers.impl_rabbit [req-336ebac6-6d73-443a-aa24-71b69e7b562a - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:26:30.714 1 ERROR oslo_service.service [req-336ebac6-6d73-443a-aa24-71b69e7b562a - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:26:30.714 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 22:26:30.714 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 22:26:30.714 1 ERROR oslo_service.service     service.start()
>2018-06-25 22:26:30.714 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 22:26:30.714 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 22:26:30.714 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 22:26:30.714 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 22:26:30.714 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 22:26:30.714 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 22:26:30.714 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 22:26:30.714 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 22:26:30.714 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 22:26:30.714 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 22:26:30.714 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 22:26:30.714 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 22:26:30.714 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 22:26:30.714 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 22:26:30.714 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 22:26:30.714 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 22:26:30.714 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 22:26:30.714 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 22:26:30.714 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 22:26:30.714 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 22:26:30.714 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 22:26:30.714 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 22:26:30.714 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:26:30.714 1 ERROR oslo_service.service 
>2018-06-25 22:26:30.717 1 CRITICAL cinder [req-6ca6c0e9-a1a8-4f70-9fca-1251a6f4c3dd - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 22:26:30.717 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 22:26:30.717 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 22:26:30.717 1 ERROR cinder     sys.exit(main())
>2018-06-25 22:26:30.717 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 22:26:30.717 1 ERROR cinder     service.wait()
>2018-06-25 22:26:30.717 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 22:26:30.717 1 ERROR cinder     _launcher.wait()
>2018-06-25 22:26:30.717 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 22:26:30.717 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 22:26:30.717 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 22:26:30.717 1 ERROR cinder     self.services.wait()
>2018-06-25 22:26:30.717 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 22:26:30.717 1 ERROR cinder     service.wait()
>2018-06-25 22:26:30.717 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 22:26:30.717 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 22:26:30.717 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 22:26:30.717 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 22:26:30.717 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 22:26:30.717 1 ERROR cinder     post_fn = fn()
>2018-06-25 22:26:30.717 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 22:26:30.717 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 22:26:30.717 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 22:26:30.717 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 22:26:30.717 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 22:26:30.717 1 ERROR cinder 
>2018-06-25 22:26:33.354 1 WARNING cinder.scheduler.host_manager [req-7d8538a3-616a-4df6-9a42-f84354751d0c - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 22:26:33.360 1 INFO cinder.rpc [req-7d8538a3-616a-4df6-9a42-f84354751d0c - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 22:26:33.365 1 INFO cinder.rpc [req-7d8538a3-616a-4df6-9a42-f84354751d0c - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 22:26:33.380 1 INFO cinder.rpc [req-7d8538a3-616a-4df6-9a42-f84354751d0c - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 22:26:33.386 1 INFO cinder.rpc [req-7d8538a3-616a-4df6-9a42-f84354751d0c - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 22:26:33.413 1 WARNING oslo_config.cfg [req-7d8538a3-616a-4df6-9a42-f84354751d0c - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 22:26:33.415 1 WARNING oslo_config.cfg [req-7d8538a3-616a-4df6-9a42-f84354751d0c - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:26:33.416 1 WARNING oslo_config.cfg [req-7d8538a3-616a-4df6-9a42-f84354751d0c - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:26:33.416 1 WARNING oslo_config.cfg [req-7d8538a3-616a-4df6-9a42-f84354751d0c - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:26:33.421 1 WARNING oslo_config.cfg [req-7d8538a3-616a-4df6-9a42-f84354751d0c - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 22:26:33.422 1 WARNING oslo_config.cfg [req-7d8538a3-616a-4df6-9a42-f84354751d0c - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 22:26:33.424 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 22:26:33.433 1 INFO cinder.manager [req-eb813846-4dfe-48bc-b235-8970d164f991 - - - - -] Initiating service 5 cleanup
>2018-06-25 22:26:33.438 1 INFO cinder.manager [req-eb813846-4dfe-48bc-b235-8970d164f991 - - - - -] Service 5 cleanup completed.
>2018-06-25 22:28:45.992 1 ERROR oslo.messaging._drivers.impl_rabbit [req-eb813846-4dfe-48bc-b235-8970d164f991 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:28:45.994 1 ERROR oslo.messaging._drivers.impl_rabbit [req-eb813846-4dfe-48bc-b235-8970d164f991 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:28:45.995 1 ERROR oslo_service.service [req-eb813846-4dfe-48bc-b235-8970d164f991 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:28:45.995 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 22:28:45.995 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 22:28:45.995 1 ERROR oslo_service.service     service.start()
>2018-06-25 22:28:45.995 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 22:28:45.995 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 22:28:45.995 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 22:28:45.995 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 22:28:45.995 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 22:28:45.995 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 22:28:45.995 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 22:28:45.995 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 22:28:45.995 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 22:28:45.995 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 22:28:45.995 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 22:28:45.995 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 22:28:45.995 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 22:28:45.995 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 22:28:45.995 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 22:28:45.995 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 22:28:45.995 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 22:28:45.995 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 22:28:45.995 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 22:28:45.995 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 22:28:45.995 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 22:28:45.995 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 22:28:45.995 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:28:45.995 1 ERROR oslo_service.service 
>2018-06-25 22:28:45.998 1 CRITICAL cinder [req-7d8538a3-616a-4df6-9a42-f84354751d0c - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 22:28:45.998 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 22:28:45.998 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 22:28:45.998 1 ERROR cinder     sys.exit(main())
>2018-06-25 22:28:45.998 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 22:28:45.998 1 ERROR cinder     service.wait()
>2018-06-25 22:28:45.998 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 22:28:45.998 1 ERROR cinder     _launcher.wait()
>2018-06-25 22:28:45.998 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 22:28:45.998 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 22:28:45.998 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 22:28:45.998 1 ERROR cinder     self.services.wait()
>2018-06-25 22:28:45.998 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 22:28:45.998 1 ERROR cinder     service.wait()
>2018-06-25 22:28:45.998 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 22:28:45.998 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 22:28:45.998 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 22:28:45.998 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 22:28:45.998 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 22:28:45.998 1 ERROR cinder     post_fn = fn()
>2018-06-25 22:28:45.998 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 22:28:45.998 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 22:28:45.998 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 22:28:45.998 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 22:28:45.998 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 22:28:45.998 1 ERROR cinder 
>2018-06-25 22:28:48.699 1 WARNING cinder.scheduler.host_manager [req-164367c2-583c-498a-9603-75e9914f1c09 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 22:28:48.705 1 INFO cinder.rpc [req-164367c2-583c-498a-9603-75e9914f1c09 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 22:28:48.711 1 INFO cinder.rpc [req-164367c2-583c-498a-9603-75e9914f1c09 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 22:28:48.723 1 INFO cinder.rpc [req-164367c2-583c-498a-9603-75e9914f1c09 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 22:28:48.729 1 INFO cinder.rpc [req-164367c2-583c-498a-9603-75e9914f1c09 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 22:28:48.757 1 WARNING oslo_config.cfg [req-164367c2-583c-498a-9603-75e9914f1c09 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 22:28:48.759 1 WARNING oslo_config.cfg [req-164367c2-583c-498a-9603-75e9914f1c09 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:28:48.760 1 WARNING oslo_config.cfg [req-164367c2-583c-498a-9603-75e9914f1c09 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:28:48.761 1 WARNING oslo_config.cfg [req-164367c2-583c-498a-9603-75e9914f1c09 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:28:48.766 1 WARNING oslo_config.cfg [req-164367c2-583c-498a-9603-75e9914f1c09 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 22:28:48.767 1 WARNING oslo_config.cfg [req-164367c2-583c-498a-9603-75e9914f1c09 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 22:28:48.770 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 22:28:48.778 1 INFO cinder.manager [req-0d891599-2998-4af7-a8ae-b43d4df0ddf2 - - - - -] Initiating service 5 cleanup
>2018-06-25 22:28:48.782 1 INFO cinder.manager [req-0d891599-2998-4af7-a8ae-b43d4df0ddf2 - - - - -] Service 5 cleanup completed.
>2018-06-25 22:31:00.237 1 ERROR oslo.messaging._drivers.impl_rabbit [req-0d891599-2998-4af7-a8ae-b43d4df0ddf2 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:31:00.239 1 ERROR oslo.messaging._drivers.impl_rabbit [req-0d891599-2998-4af7-a8ae-b43d4df0ddf2 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:31:00.240 1 ERROR oslo_service.service [req-0d891599-2998-4af7-a8ae-b43d4df0ddf2 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:31:00.240 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 22:31:00.240 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 22:31:00.240 1 ERROR oslo_service.service     service.start()
>2018-06-25 22:31:00.240 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 22:31:00.240 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 22:31:00.240 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 22:31:00.240 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 22:31:00.240 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 22:31:00.240 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 22:31:00.240 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 22:31:00.240 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 22:31:00.240 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 22:31:00.240 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 22:31:00.240 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 22:31:00.240 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 22:31:00.240 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 22:31:00.240 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 22:31:00.240 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 22:31:00.240 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 22:31:00.240 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 22:31:00.240 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 22:31:00.240 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 22:31:00.240 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 22:31:00.240 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 22:31:00.240 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 22:31:00.240 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:31:00.240 1 ERROR oslo_service.service 
>2018-06-25 22:31:00.243 1 CRITICAL cinder [req-164367c2-583c-498a-9603-75e9914f1c09 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 22:31:00.243 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 22:31:00.243 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 22:31:00.243 1 ERROR cinder     sys.exit(main())
>2018-06-25 22:31:00.243 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 22:31:00.243 1 ERROR cinder     service.wait()
>2018-06-25 22:31:00.243 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 22:31:00.243 1 ERROR cinder     _launcher.wait()
>2018-06-25 22:31:00.243 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 22:31:00.243 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 22:31:00.243 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 22:31:00.243 1 ERROR cinder     self.services.wait()
>2018-06-25 22:31:00.243 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 22:31:00.243 1 ERROR cinder     service.wait()
>2018-06-25 22:31:00.243 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 22:31:00.243 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 22:31:00.243 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 22:31:00.243 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 22:31:00.243 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 22:31:00.243 1 ERROR cinder     post_fn = fn()
>2018-06-25 22:31:00.243 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 22:31:00.243 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 22:31:00.243 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 22:31:00.243 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 22:31:00.243 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 22:31:00.243 1 ERROR cinder 
>2018-06-25 22:31:02.874 1 WARNING cinder.scheduler.host_manager [req-0216cdf3-f38b-4083-9ae2-85bd2c43665c - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 22:31:02.881 1 INFO cinder.rpc [req-0216cdf3-f38b-4083-9ae2-85bd2c43665c - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 22:31:02.887 1 INFO cinder.rpc [req-0216cdf3-f38b-4083-9ae2-85bd2c43665c - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 22:31:02.898 1 INFO cinder.rpc [req-0216cdf3-f38b-4083-9ae2-85bd2c43665c - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 22:31:02.904 1 INFO cinder.rpc [req-0216cdf3-f38b-4083-9ae2-85bd2c43665c - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 22:31:02.930 1 WARNING oslo_config.cfg [req-0216cdf3-f38b-4083-9ae2-85bd2c43665c - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 22:31:02.932 1 WARNING oslo_config.cfg [req-0216cdf3-f38b-4083-9ae2-85bd2c43665c - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:31:02.932 1 WARNING oslo_config.cfg [req-0216cdf3-f38b-4083-9ae2-85bd2c43665c - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:31:02.933 1 WARNING oslo_config.cfg [req-0216cdf3-f38b-4083-9ae2-85bd2c43665c - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:31:02.937 1 WARNING oslo_config.cfg [req-0216cdf3-f38b-4083-9ae2-85bd2c43665c - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 22:31:02.939 1 WARNING oslo_config.cfg [req-0216cdf3-f38b-4083-9ae2-85bd2c43665c - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 22:31:02.941 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 22:31:02.949 1 INFO cinder.manager [req-b5c8d163-74a2-4c1e-9a79-1294beb82770 - - - - -] Initiating service 5 cleanup
>2018-06-25 22:31:02.953 1 INFO cinder.manager [req-b5c8d163-74a2-4c1e-9a79-1294beb82770 - - - - -] Service 5 cleanup completed.
>2018-06-25 22:33:07.361 1 ERROR oslo.messaging._drivers.impl_rabbit [req-b5c8d163-74a2-4c1e-9a79-1294beb82770 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:33:07.364 1 ERROR oslo.messaging._drivers.impl_rabbit [req-b5c8d163-74a2-4c1e-9a79-1294beb82770 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:33:07.364 1 ERROR oslo_service.service [req-b5c8d163-74a2-4c1e-9a79-1294beb82770 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:33:07.364 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 22:33:07.364 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 22:33:07.364 1 ERROR oslo_service.service     service.start()
>2018-06-25 22:33:07.364 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 22:33:07.364 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 22:33:07.364 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 22:33:07.364 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 22:33:07.364 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 22:33:07.364 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 22:33:07.364 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 22:33:07.364 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 22:33:07.364 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 22:33:07.364 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 22:33:07.364 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 22:33:07.364 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 22:33:07.364 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 22:33:07.364 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 22:33:07.364 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 22:33:07.364 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 22:33:07.364 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 22:33:07.364 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 22:33:07.364 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 22:33:07.364 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 22:33:07.364 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 22:33:07.364 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 22:33:07.364 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:33:07.364 1 ERROR oslo_service.service 
>2018-06-25 22:33:07.367 1 CRITICAL cinder [req-0216cdf3-f38b-4083-9ae2-85bd2c43665c - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 22:33:07.367 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 22:33:07.367 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 22:33:07.367 1 ERROR cinder     sys.exit(main())
>2018-06-25 22:33:07.367 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 22:33:07.367 1 ERROR cinder     service.wait()
>2018-06-25 22:33:07.367 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 22:33:07.367 1 ERROR cinder     _launcher.wait()
>2018-06-25 22:33:07.367 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 22:33:07.367 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 22:33:07.367 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 22:33:07.367 1 ERROR cinder     self.services.wait()
>2018-06-25 22:33:07.367 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 22:33:07.367 1 ERROR cinder     service.wait()
>2018-06-25 22:33:07.367 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 22:33:07.367 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 22:33:07.367 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 22:33:07.367 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 22:33:07.367 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 22:33:07.367 1 ERROR cinder     post_fn = fn()
>2018-06-25 22:33:07.367 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 22:33:07.367 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 22:33:07.367 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 22:33:07.367 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 22:33:07.367 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 22:33:07.367 1 ERROR cinder 
>2018-06-25 22:33:09.995 1 WARNING cinder.scheduler.host_manager [req-7131c56c-5326-42d8-b875-a98cdac6b539 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 22:33:10.002 1 INFO cinder.rpc [req-7131c56c-5326-42d8-b875-a98cdac6b539 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 22:33:10.010 1 INFO cinder.rpc [req-7131c56c-5326-42d8-b875-a98cdac6b539 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 22:33:10.025 1 INFO cinder.rpc [req-7131c56c-5326-42d8-b875-a98cdac6b539 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 22:33:10.033 1 INFO cinder.rpc [req-7131c56c-5326-42d8-b875-a98cdac6b539 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 22:33:10.069 1 WARNING oslo_config.cfg [req-7131c56c-5326-42d8-b875-a98cdac6b539 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 22:33:10.071 1 WARNING oslo_config.cfg [req-7131c56c-5326-42d8-b875-a98cdac6b539 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:33:10.072 1 WARNING oslo_config.cfg [req-7131c56c-5326-42d8-b875-a98cdac6b539 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:33:10.073 1 WARNING oslo_config.cfg [req-7131c56c-5326-42d8-b875-a98cdac6b539 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:33:10.078 1 WARNING oslo_config.cfg [req-7131c56c-5326-42d8-b875-a98cdac6b539 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 22:33:10.080 1 WARNING oslo_config.cfg [req-7131c56c-5326-42d8-b875-a98cdac6b539 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 22:33:10.082 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 22:33:10.090 1 INFO cinder.manager [req-3008acdc-4209-4740-a0c6-aa87a169912c - - - - -] Initiating service 5 cleanup
>2018-06-25 22:33:10.095 1 INFO cinder.manager [req-3008acdc-4209-4740-a0c6-aa87a169912c - - - - -] Service 5 cleanup completed.
>2018-06-25 22:35:14.520 1 ERROR oslo.messaging._drivers.impl_rabbit [req-3008acdc-4209-4740-a0c6-aa87a169912c - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:35:14.522 1 ERROR oslo.messaging._drivers.impl_rabbit [req-3008acdc-4209-4740-a0c6-aa87a169912c - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:35:14.522 1 ERROR oslo_service.service [req-3008acdc-4209-4740-a0c6-aa87a169912c - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:35:14.522 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 22:35:14.522 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 22:35:14.522 1 ERROR oslo_service.service     service.start()
>2018-06-25 22:35:14.522 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 22:35:14.522 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 22:35:14.522 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 22:35:14.522 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 22:35:14.522 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 22:35:14.522 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 22:35:14.522 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 22:35:14.522 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 22:35:14.522 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 22:35:14.522 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 22:35:14.522 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 22:35:14.522 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 22:35:14.522 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 22:35:14.522 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 22:35:14.522 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 22:35:14.522 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 22:35:14.522 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 22:35:14.522 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 22:35:14.522 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 22:35:14.522 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 22:35:14.522 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 22:35:14.522 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 22:35:14.522 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:35:14.522 1 ERROR oslo_service.service 
>2018-06-25 22:35:14.525 1 CRITICAL cinder [req-7131c56c-5326-42d8-b875-a98cdac6b539 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 22:35:14.525 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 22:35:14.525 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 22:35:14.525 1 ERROR cinder     sys.exit(main())
>2018-06-25 22:35:14.525 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 22:35:14.525 1 ERROR cinder     service.wait()
>2018-06-25 22:35:14.525 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 22:35:14.525 1 ERROR cinder     _launcher.wait()
>2018-06-25 22:35:14.525 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 22:35:14.525 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 22:35:14.525 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 22:35:14.525 1 ERROR cinder     self.services.wait()
>2018-06-25 22:35:14.525 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 22:35:14.525 1 ERROR cinder     service.wait()
>2018-06-25 22:35:14.525 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 22:35:14.525 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 22:35:14.525 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 22:35:14.525 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 22:35:14.525 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 22:35:14.525 1 ERROR cinder     post_fn = fn()
>2018-06-25 22:35:14.525 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 22:35:14.525 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 22:35:14.525 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 22:35:14.525 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 22:35:14.525 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 22:35:14.525 1 ERROR cinder 
>2018-06-25 22:35:17.391 1 WARNING cinder.scheduler.host_manager [req-d5c82887-21d5-4343-9560-1f8e1d328f3e - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 22:35:17.399 1 INFO cinder.rpc [req-d5c82887-21d5-4343-9560-1f8e1d328f3e - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 22:35:17.405 1 INFO cinder.rpc [req-d5c82887-21d5-4343-9560-1f8e1d328f3e - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 22:35:17.417 1 INFO cinder.rpc [req-d5c82887-21d5-4343-9560-1f8e1d328f3e - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 22:35:17.426 1 INFO cinder.rpc [req-d5c82887-21d5-4343-9560-1f8e1d328f3e - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 22:35:17.456 1 WARNING oslo_config.cfg [req-d5c82887-21d5-4343-9560-1f8e1d328f3e - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 22:35:17.458 1 WARNING oslo_config.cfg [req-d5c82887-21d5-4343-9560-1f8e1d328f3e - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:35:17.459 1 WARNING oslo_config.cfg [req-d5c82887-21d5-4343-9560-1f8e1d328f3e - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:35:17.459 1 WARNING oslo_config.cfg [req-d5c82887-21d5-4343-9560-1f8e1d328f3e - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:35:17.466 1 WARNING oslo_config.cfg [req-d5c82887-21d5-4343-9560-1f8e1d328f3e - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 22:35:17.468 1 WARNING oslo_config.cfg [req-d5c82887-21d5-4343-9560-1f8e1d328f3e - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 22:35:17.471 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 22:35:17.478 1 INFO cinder.manager [req-f9692af3-cafa-45e8-b82d-b07fc67f0fea - - - - -] Initiating service 5 cleanup
>2018-06-25 22:35:17.483 1 INFO cinder.manager [req-f9692af3-cafa-45e8-b82d-b07fc67f0fea - - - - -] Service 5 cleanup completed.
>2018-06-25 22:37:21.864 1 ERROR oslo.messaging._drivers.impl_rabbit [req-f9692af3-cafa-45e8-b82d-b07fc67f0fea - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:37:21.866 1 ERROR oslo.messaging._drivers.impl_rabbit [req-f9692af3-cafa-45e8-b82d-b07fc67f0fea - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:37:21.867 1 ERROR oslo_service.service [req-f9692af3-cafa-45e8-b82d-b07fc67f0fea - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:37:21.867 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 22:37:21.867 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 22:37:21.867 1 ERROR oslo_service.service     service.start()
>2018-06-25 22:37:21.867 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 22:37:21.867 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 22:37:21.867 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 22:37:21.867 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 22:37:21.867 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 22:37:21.867 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 22:37:21.867 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 22:37:21.867 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 22:37:21.867 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 22:37:21.867 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 22:37:21.867 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 22:37:21.867 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 22:37:21.867 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 22:37:21.867 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 22:37:21.867 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 22:37:21.867 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 22:37:21.867 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 22:37:21.867 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 22:37:21.867 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 22:37:21.867 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 22:37:21.867 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 22:37:21.867 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 22:37:21.867 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:37:21.867 1 ERROR oslo_service.service 
>2018-06-25 22:37:21.869 1 CRITICAL cinder [req-d5c82887-21d5-4343-9560-1f8e1d328f3e - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 22:37:21.869 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 22:37:21.869 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 22:37:21.869 1 ERROR cinder     sys.exit(main())
>2018-06-25 22:37:21.869 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 22:37:21.869 1 ERROR cinder     service.wait()
>2018-06-25 22:37:21.869 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 22:37:21.869 1 ERROR cinder     _launcher.wait()
>2018-06-25 22:37:21.869 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 22:37:21.869 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 22:37:21.869 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 22:37:21.869 1 ERROR cinder     self.services.wait()
>2018-06-25 22:37:21.869 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 22:37:21.869 1 ERROR cinder     service.wait()
>2018-06-25 22:37:21.869 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 22:37:21.869 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 22:37:21.869 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 22:37:21.869 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 22:37:21.869 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 22:37:21.869 1 ERROR cinder     post_fn = fn()
>2018-06-25 22:37:21.869 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 22:37:21.869 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 22:37:21.869 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 22:37:21.869 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 22:37:21.869 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 22:37:21.869 1 ERROR cinder 
>2018-06-25 22:37:24.571 1 WARNING cinder.scheduler.host_manager [req-933e38f9-b7d2-4c44-a0a6-8d9b9d28896e - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 22:37:24.577 1 INFO cinder.rpc [req-933e38f9-b7d2-4c44-a0a6-8d9b9d28896e - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 22:37:24.583 1 INFO cinder.rpc [req-933e38f9-b7d2-4c44-a0a6-8d9b9d28896e - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 22:37:24.597 1 INFO cinder.rpc [req-933e38f9-b7d2-4c44-a0a6-8d9b9d28896e - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 22:37:24.603 1 INFO cinder.rpc [req-933e38f9-b7d2-4c44-a0a6-8d9b9d28896e - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 22:37:24.627 1 WARNING oslo_config.cfg [req-933e38f9-b7d2-4c44-a0a6-8d9b9d28896e - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 22:37:24.629 1 WARNING oslo_config.cfg [req-933e38f9-b7d2-4c44-a0a6-8d9b9d28896e - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:37:24.630 1 WARNING oslo_config.cfg [req-933e38f9-b7d2-4c44-a0a6-8d9b9d28896e - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:37:24.630 1 WARNING oslo_config.cfg [req-933e38f9-b7d2-4c44-a0a6-8d9b9d28896e - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:37:24.635 1 WARNING oslo_config.cfg [req-933e38f9-b7d2-4c44-a0a6-8d9b9d28896e - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 22:37:24.636 1 WARNING oslo_config.cfg [req-933e38f9-b7d2-4c44-a0a6-8d9b9d28896e - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 22:37:24.639 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 22:37:24.646 1 INFO cinder.manager [req-8ad180d8-4646-415a-b4ca-ac2325eb92ed - - - - -] Initiating service 5 cleanup
>2018-06-25 22:37:24.651 1 INFO cinder.manager [req-8ad180d8-4646-415a-b4ca-ac2325eb92ed - - - - -] Service 5 cleanup completed.
>2018-06-25 22:39:36.821 1 ERROR oslo.messaging._drivers.impl_rabbit [req-8ad180d8-4646-415a-b4ca-ac2325eb92ed - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:39:36.823 1 ERROR oslo.messaging._drivers.impl_rabbit [req-8ad180d8-4646-415a-b4ca-ac2325eb92ed - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:39:36.824 1 ERROR oslo_service.service [req-8ad180d8-4646-415a-b4ca-ac2325eb92ed - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:39:36.824 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 22:39:36.824 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 22:39:36.824 1 ERROR oslo_service.service     service.start()
>2018-06-25 22:39:36.824 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 22:39:36.824 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 22:39:36.824 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 22:39:36.824 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 22:39:36.824 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 22:39:36.824 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 22:39:36.824 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 22:39:36.824 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 22:39:36.824 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 22:39:36.824 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 22:39:36.824 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 22:39:36.824 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 22:39:36.824 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 22:39:36.824 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 22:39:36.824 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 22:39:36.824 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 22:39:36.824 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 22:39:36.824 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 22:39:36.824 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 22:39:36.824 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 22:39:36.824 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 22:39:36.824 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 22:39:36.824 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:39:36.824 1 ERROR oslo_service.service 
>2018-06-25 22:39:36.826 1 CRITICAL cinder [req-933e38f9-b7d2-4c44-a0a6-8d9b9d28896e - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 22:39:36.826 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 22:39:36.826 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 22:39:36.826 1 ERROR cinder     sys.exit(main())
>2018-06-25 22:39:36.826 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 22:39:36.826 1 ERROR cinder     service.wait()
>2018-06-25 22:39:36.826 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 22:39:36.826 1 ERROR cinder     _launcher.wait()
>2018-06-25 22:39:36.826 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 22:39:36.826 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 22:39:36.826 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 22:39:36.826 1 ERROR cinder     self.services.wait()
>2018-06-25 22:39:36.826 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 22:39:36.826 1 ERROR cinder     service.wait()
>2018-06-25 22:39:36.826 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 22:39:36.826 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 22:39:36.826 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 22:39:36.826 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 22:39:36.826 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 22:39:36.826 1 ERROR cinder     post_fn = fn()
>2018-06-25 22:39:36.826 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 22:39:36.826 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 22:39:36.826 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 22:39:36.826 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 22:39:36.826 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 22:39:36.826 1 ERROR cinder 
>2018-06-25 22:39:39.529 1 WARNING cinder.scheduler.host_manager [req-d58971d2-b357-4a4a-a89b-7d2107b020e2 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 22:39:39.535 1 INFO cinder.rpc [req-d58971d2-b357-4a4a-a89b-7d2107b020e2 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 22:39:39.541 1 INFO cinder.rpc [req-d58971d2-b357-4a4a-a89b-7d2107b020e2 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 22:39:39.552 1 INFO cinder.rpc [req-d58971d2-b357-4a4a-a89b-7d2107b020e2 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 22:39:39.558 1 INFO cinder.rpc [req-d58971d2-b357-4a4a-a89b-7d2107b020e2 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 22:39:39.582 1 WARNING oslo_config.cfg [req-d58971d2-b357-4a4a-a89b-7d2107b020e2 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 22:39:39.584 1 WARNING oslo_config.cfg [req-d58971d2-b357-4a4a-a89b-7d2107b020e2 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:39:39.585 1 WARNING oslo_config.cfg [req-d58971d2-b357-4a4a-a89b-7d2107b020e2 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:39:39.585 1 WARNING oslo_config.cfg [req-d58971d2-b357-4a4a-a89b-7d2107b020e2 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:39:39.591 1 WARNING oslo_config.cfg [req-d58971d2-b357-4a4a-a89b-7d2107b020e2 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 22:39:39.592 1 WARNING oslo_config.cfg [req-d58971d2-b357-4a4a-a89b-7d2107b020e2 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 22:39:39.595 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 22:39:39.600 1 INFO cinder.manager [req-ce719e05-87a2-426a-ab96-8944254cc1e3 - - - - -] Initiating service 5 cleanup
>2018-06-25 22:39:39.606 1 INFO cinder.manager [req-ce719e05-87a2-426a-ab96-8944254cc1e3 - - - - -] Service 5 cleanup completed.
>2018-06-25 22:41:45.671 1 ERROR oslo.messaging._drivers.impl_rabbit [req-ce719e05-87a2-426a-ab96-8944254cc1e3 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:41:45.673 1 ERROR oslo.messaging._drivers.impl_rabbit [req-ce719e05-87a2-426a-ab96-8944254cc1e3 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:41:45.673 1 ERROR oslo_service.service [req-ce719e05-87a2-426a-ab96-8944254cc1e3 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:41:45.673 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 22:41:45.673 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 22:41:45.673 1 ERROR oslo_service.service     service.start()
>2018-06-25 22:41:45.673 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 22:41:45.673 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 22:41:45.673 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 22:41:45.673 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 22:41:45.673 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 22:41:45.673 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 22:41:45.673 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 22:41:45.673 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 22:41:45.673 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 22:41:45.673 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 22:41:45.673 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 22:41:45.673 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 22:41:45.673 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 22:41:45.673 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 22:41:45.673 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 22:41:45.673 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 22:41:45.673 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 22:41:45.673 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 22:41:45.673 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 22:41:45.673 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 22:41:45.673 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 22:41:45.673 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 22:41:45.673 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:41:45.673 1 ERROR oslo_service.service 
>2018-06-25 22:41:45.676 1 CRITICAL cinder [req-d58971d2-b357-4a4a-a89b-7d2107b020e2 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 22:41:45.676 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 22:41:45.676 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 22:41:45.676 1 ERROR cinder     sys.exit(main())
>2018-06-25 22:41:45.676 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 22:41:45.676 1 ERROR cinder     service.wait()
>2018-06-25 22:41:45.676 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 22:41:45.676 1 ERROR cinder     _launcher.wait()
>2018-06-25 22:41:45.676 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 22:41:45.676 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 22:41:45.676 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 22:41:45.676 1 ERROR cinder     self.services.wait()
>2018-06-25 22:41:45.676 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 22:41:45.676 1 ERROR cinder     service.wait()
>2018-06-25 22:41:45.676 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 22:41:45.676 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 22:41:45.676 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 22:41:45.676 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 22:41:45.676 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 22:41:45.676 1 ERROR cinder     post_fn = fn()
>2018-06-25 22:41:45.676 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 22:41:45.676 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 22:41:45.676 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 22:41:45.676 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 22:41:45.676 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 22:41:45.676 1 ERROR cinder 
>2018-06-25 22:41:48.294 1 WARNING cinder.scheduler.host_manager [req-42225339-1343-4f28-b9b1-c1984fb04919 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 22:41:48.302 1 INFO cinder.rpc [req-42225339-1343-4f28-b9b1-c1984fb04919 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 22:41:48.310 1 INFO cinder.rpc [req-42225339-1343-4f28-b9b1-c1984fb04919 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 22:41:48.325 1 INFO cinder.rpc [req-42225339-1343-4f28-b9b1-c1984fb04919 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 22:41:48.332 1 INFO cinder.rpc [req-42225339-1343-4f28-b9b1-c1984fb04919 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 22:41:48.367 1 WARNING oslo_config.cfg [req-42225339-1343-4f28-b9b1-c1984fb04919 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 22:41:48.369 1 WARNING oslo_config.cfg [req-42225339-1343-4f28-b9b1-c1984fb04919 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:41:48.369 1 WARNING oslo_config.cfg [req-42225339-1343-4f28-b9b1-c1984fb04919 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:41:48.370 1 WARNING oslo_config.cfg [req-42225339-1343-4f28-b9b1-c1984fb04919 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:41:48.375 1 WARNING oslo_config.cfg [req-42225339-1343-4f28-b9b1-c1984fb04919 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 22:41:48.376 1 WARNING oslo_config.cfg [req-42225339-1343-4f28-b9b1-c1984fb04919 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 22:41:48.379 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 22:41:48.387 1 INFO cinder.manager [req-053abf9a-fb97-42b6-8acf-d9a5cfe6db4b - - - - -] Initiating service 5 cleanup
>2018-06-25 22:41:48.391 1 INFO cinder.manager [req-053abf9a-fb97-42b6-8acf-d9a5cfe6db4b - - - - -] Service 5 cleanup completed.
>2018-06-25 22:43:54.309 1 ERROR oslo.messaging._drivers.impl_rabbit [req-053abf9a-fb97-42b6-8acf-d9a5cfe6db4b - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:43:54.311 1 ERROR oslo.messaging._drivers.impl_rabbit [req-053abf9a-fb97-42b6-8acf-d9a5cfe6db4b - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:43:54.311 1 ERROR oslo_service.service [req-053abf9a-fb97-42b6-8acf-d9a5cfe6db4b - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:43:54.311 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 22:43:54.311 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 22:43:54.311 1 ERROR oslo_service.service     service.start()
>2018-06-25 22:43:54.311 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 22:43:54.311 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 22:43:54.311 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 22:43:54.311 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 22:43:54.311 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 22:43:54.311 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 22:43:54.311 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 22:43:54.311 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 22:43:54.311 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 22:43:54.311 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 22:43:54.311 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 22:43:54.311 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 22:43:54.311 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 22:43:54.311 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 22:43:54.311 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 22:43:54.311 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 22:43:54.311 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 22:43:54.311 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 22:43:54.311 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 22:43:54.311 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 22:43:54.311 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 22:43:54.311 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 22:43:54.311 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:43:54.311 1 ERROR oslo_service.service 
>2018-06-25 22:43:54.314 1 CRITICAL cinder [req-42225339-1343-4f28-b9b1-c1984fb04919 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 22:43:54.314 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 22:43:54.314 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 22:43:54.314 1 ERROR cinder     sys.exit(main())
>2018-06-25 22:43:54.314 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 22:43:54.314 1 ERROR cinder     service.wait()
>2018-06-25 22:43:54.314 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 22:43:54.314 1 ERROR cinder     _launcher.wait()
>2018-06-25 22:43:54.314 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 22:43:54.314 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 22:43:54.314 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 22:43:54.314 1 ERROR cinder     self.services.wait()
>2018-06-25 22:43:54.314 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 22:43:54.314 1 ERROR cinder     service.wait()
>2018-06-25 22:43:54.314 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 22:43:54.314 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 22:43:54.314 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 22:43:54.314 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 22:43:54.314 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 22:43:54.314 1 ERROR cinder     post_fn = fn()
>2018-06-25 22:43:54.314 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 22:43:54.314 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 22:43:54.314 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 22:43:54.314 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 22:43:54.314 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 22:43:54.314 1 ERROR cinder 
>2018-06-25 22:43:56.942 1 WARNING cinder.scheduler.host_manager [req-30cbbee3-b2c8-4d7d-987d-1b0de9ec0c0b - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 22:43:56.948 1 INFO cinder.rpc [req-30cbbee3-b2c8-4d7d-987d-1b0de9ec0c0b - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 22:43:56.953 1 INFO cinder.rpc [req-30cbbee3-b2c8-4d7d-987d-1b0de9ec0c0b - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 22:43:56.964 1 INFO cinder.rpc [req-30cbbee3-b2c8-4d7d-987d-1b0de9ec0c0b - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 22:43:56.970 1 INFO cinder.rpc [req-30cbbee3-b2c8-4d7d-987d-1b0de9ec0c0b - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 22:43:56.997 1 WARNING oslo_config.cfg [req-30cbbee3-b2c8-4d7d-987d-1b0de9ec0c0b - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 22:43:56.999 1 WARNING oslo_config.cfg [req-30cbbee3-b2c8-4d7d-987d-1b0de9ec0c0b - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:43:57.000 1 WARNING oslo_config.cfg [req-30cbbee3-b2c8-4d7d-987d-1b0de9ec0c0b - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:43:57.001 1 WARNING oslo_config.cfg [req-30cbbee3-b2c8-4d7d-987d-1b0de9ec0c0b - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:43:57.005 1 WARNING oslo_config.cfg [req-30cbbee3-b2c8-4d7d-987d-1b0de9ec0c0b - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 22:43:57.006 1 WARNING oslo_config.cfg [req-30cbbee3-b2c8-4d7d-987d-1b0de9ec0c0b - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 22:43:57.009 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 22:43:57.014 1 INFO cinder.manager [req-bfa36675-e176-4476-834c-38a8b1552795 - - - - -] Initiating service 5 cleanup
>2018-06-25 22:43:57.019 1 INFO cinder.manager [req-bfa36675-e176-4476-834c-38a8b1552795 - - - - -] Service 5 cleanup completed.
>2018-06-25 22:46:01.379 1 ERROR oslo.messaging._drivers.impl_rabbit [req-bfa36675-e176-4476-834c-38a8b1552795 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:46:01.380 1 ERROR oslo.messaging._drivers.impl_rabbit [req-bfa36675-e176-4476-834c-38a8b1552795 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:46:01.381 1 ERROR oslo_service.service [req-bfa36675-e176-4476-834c-38a8b1552795 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:46:01.381 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 22:46:01.381 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 22:46:01.381 1 ERROR oslo_service.service     service.start()
>2018-06-25 22:46:01.381 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 22:46:01.381 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 22:46:01.381 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 22:46:01.381 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 22:46:01.381 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 22:46:01.381 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 22:46:01.381 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 22:46:01.381 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 22:46:01.381 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 22:46:01.381 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 22:46:01.381 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 22:46:01.381 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 22:46:01.381 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 22:46:01.381 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 22:46:01.381 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 22:46:01.381 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 22:46:01.381 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 22:46:01.381 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 22:46:01.381 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 22:46:01.381 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 22:46:01.381 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 22:46:01.381 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 22:46:01.381 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:46:01.381 1 ERROR oslo_service.service 
>2018-06-25 22:46:01.383 1 CRITICAL cinder [req-30cbbee3-b2c8-4d7d-987d-1b0de9ec0c0b - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 22:46:01.383 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 22:46:01.383 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 22:46:01.383 1 ERROR cinder     sys.exit(main())
>2018-06-25 22:46:01.383 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 22:46:01.383 1 ERROR cinder     service.wait()
>2018-06-25 22:46:01.383 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 22:46:01.383 1 ERROR cinder     _launcher.wait()
>2018-06-25 22:46:01.383 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 22:46:01.383 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 22:46:01.383 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 22:46:01.383 1 ERROR cinder     self.services.wait()
>2018-06-25 22:46:01.383 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 22:46:01.383 1 ERROR cinder     service.wait()
>2018-06-25 22:46:01.383 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 22:46:01.383 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 22:46:01.383 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 22:46:01.383 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 22:46:01.383 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 22:46:01.383 1 ERROR cinder     post_fn = fn()
>2018-06-25 22:46:01.383 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 22:46:01.383 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 22:46:01.383 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 22:46:01.383 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 22:46:01.383 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 22:46:01.383 1 ERROR cinder 
>2018-06-25 22:46:03.926 1 WARNING cinder.scheduler.host_manager [req-61d094e8-7464-441f-9dde-7a134f223dce - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 22:46:03.932 1 INFO cinder.rpc [req-61d094e8-7464-441f-9dde-7a134f223dce - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 22:46:03.937 1 INFO cinder.rpc [req-61d094e8-7464-441f-9dde-7a134f223dce - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 22:46:03.949 1 INFO cinder.rpc [req-61d094e8-7464-441f-9dde-7a134f223dce - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 22:46:03.954 1 INFO cinder.rpc [req-61d094e8-7464-441f-9dde-7a134f223dce - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 22:46:03.978 1 WARNING oslo_config.cfg [req-61d094e8-7464-441f-9dde-7a134f223dce - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 22:46:03.980 1 WARNING oslo_config.cfg [req-61d094e8-7464-441f-9dde-7a134f223dce - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:46:03.981 1 WARNING oslo_config.cfg [req-61d094e8-7464-441f-9dde-7a134f223dce - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:46:03.981 1 WARNING oslo_config.cfg [req-61d094e8-7464-441f-9dde-7a134f223dce - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:46:03.986 1 WARNING oslo_config.cfg [req-61d094e8-7464-441f-9dde-7a134f223dce - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 22:46:03.987 1 WARNING oslo_config.cfg [req-61d094e8-7464-441f-9dde-7a134f223dce - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 22:46:03.990 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 22:46:03.995 1 INFO cinder.manager [req-92fc6fa4-1c44-43ca-aa44-f2b4962a4600 - - - - -] Initiating service 5 cleanup
>2018-06-25 22:46:03.999 1 INFO cinder.manager [req-92fc6fa4-1c44-43ca-aa44-f2b4962a4600 - - - - -] Service 5 cleanup completed.
>2018-06-25 22:48:08.447 1 ERROR oslo.messaging._drivers.impl_rabbit [req-92fc6fa4-1c44-43ca-aa44-f2b4962a4600 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:48:08.449 1 ERROR oslo.messaging._drivers.impl_rabbit [req-92fc6fa4-1c44-43ca-aa44-f2b4962a4600 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:48:08.449 1 ERROR oslo_service.service [req-92fc6fa4-1c44-43ca-aa44-f2b4962a4600 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:48:08.449 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 22:48:08.449 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 22:48:08.449 1 ERROR oslo_service.service     service.start()
>2018-06-25 22:48:08.449 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 22:48:08.449 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 22:48:08.449 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 22:48:08.449 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 22:48:08.449 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 22:48:08.449 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 22:48:08.449 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 22:48:08.449 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 22:48:08.449 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 22:48:08.449 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 22:48:08.449 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 22:48:08.449 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 22:48:08.449 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 22:48:08.449 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 22:48:08.449 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 22:48:08.449 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 22:48:08.449 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 22:48:08.449 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 22:48:08.449 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 22:48:08.449 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 22:48:08.449 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 22:48:08.449 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 22:48:08.449 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:48:08.449 1 ERROR oslo_service.service 
>2018-06-25 22:48:08.452 1 CRITICAL cinder [req-61d094e8-7464-441f-9dde-7a134f223dce - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 22:48:08.452 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 22:48:08.452 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 22:48:08.452 1 ERROR cinder     sys.exit(main())
>2018-06-25 22:48:08.452 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 22:48:08.452 1 ERROR cinder     service.wait()
>2018-06-25 22:48:08.452 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 22:48:08.452 1 ERROR cinder     _launcher.wait()
>2018-06-25 22:48:08.452 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 22:48:08.452 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 22:48:08.452 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 22:48:08.452 1 ERROR cinder     self.services.wait()
>2018-06-25 22:48:08.452 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 22:48:08.452 1 ERROR cinder     service.wait()
>2018-06-25 22:48:08.452 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 22:48:08.452 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 22:48:08.452 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 22:48:08.452 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 22:48:08.452 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 22:48:08.452 1 ERROR cinder     post_fn = fn()
>2018-06-25 22:48:08.452 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 22:48:08.452 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 22:48:08.452 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 22:48:08.452 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 22:48:08.452 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 22:48:08.452 1 ERROR cinder 
>2018-06-25 22:48:11.159 1 WARNING cinder.scheduler.host_manager [req-913680bd-3b31-4606-b148-d07bda97ee3f - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 22:48:11.166 1 INFO cinder.rpc [req-913680bd-3b31-4606-b148-d07bda97ee3f - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 22:48:11.172 1 INFO cinder.rpc [req-913680bd-3b31-4606-b148-d07bda97ee3f - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 22:48:11.187 1 INFO cinder.rpc [req-913680bd-3b31-4606-b148-d07bda97ee3f - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 22:48:11.193 1 INFO cinder.rpc [req-913680bd-3b31-4606-b148-d07bda97ee3f - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 22:48:11.222 1 WARNING oslo_config.cfg [req-913680bd-3b31-4606-b148-d07bda97ee3f - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 22:48:11.224 1 WARNING oslo_config.cfg [req-913680bd-3b31-4606-b148-d07bda97ee3f - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:48:11.225 1 WARNING oslo_config.cfg [req-913680bd-3b31-4606-b148-d07bda97ee3f - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:48:11.225 1 WARNING oslo_config.cfg [req-913680bd-3b31-4606-b148-d07bda97ee3f - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:48:11.231 1 WARNING oslo_config.cfg [req-913680bd-3b31-4606-b148-d07bda97ee3f - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 22:48:11.232 1 WARNING oslo_config.cfg [req-913680bd-3b31-4606-b148-d07bda97ee3f - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 22:48:11.235 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 22:48:11.243 1 INFO cinder.manager [req-44ea5798-8cec-41ea-a582-5f4b278e4ebe - - - - -] Initiating service 5 cleanup
>2018-06-25 22:48:11.248 1 INFO cinder.manager [req-44ea5798-8cec-41ea-a582-5f4b278e4ebe - - - - -] Service 5 cleanup completed.
>2018-06-25 22:50:23.144 1 ERROR oslo.messaging._drivers.impl_rabbit [req-44ea5798-8cec-41ea-a582-5f4b278e4ebe - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:50:23.146 1 ERROR oslo.messaging._drivers.impl_rabbit [req-44ea5798-8cec-41ea-a582-5f4b278e4ebe - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:50:23.147 1 ERROR oslo_service.service [req-44ea5798-8cec-41ea-a582-5f4b278e4ebe - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:50:23.147 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 22:50:23.147 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 22:50:23.147 1 ERROR oslo_service.service     service.start()
>2018-06-25 22:50:23.147 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 22:50:23.147 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 22:50:23.147 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 22:50:23.147 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 22:50:23.147 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 22:50:23.147 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 22:50:23.147 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 22:50:23.147 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 22:50:23.147 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 22:50:23.147 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 22:50:23.147 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 22:50:23.147 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 22:50:23.147 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 22:50:23.147 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 22:50:23.147 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 22:50:23.147 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 22:50:23.147 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 22:50:23.147 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 22:50:23.147 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 22:50:23.147 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 22:50:23.147 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 22:50:23.147 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 22:50:23.147 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:50:23.147 1 ERROR oslo_service.service 
>2018-06-25 22:50:23.150 1 CRITICAL cinder [req-913680bd-3b31-4606-b148-d07bda97ee3f - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 22:50:23.150 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 22:50:23.150 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 22:50:23.150 1 ERROR cinder     sys.exit(main())
>2018-06-25 22:50:23.150 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 22:50:23.150 1 ERROR cinder     service.wait()
>2018-06-25 22:50:23.150 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 22:50:23.150 1 ERROR cinder     _launcher.wait()
>2018-06-25 22:50:23.150 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 22:50:23.150 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 22:50:23.150 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 22:50:23.150 1 ERROR cinder     self.services.wait()
>2018-06-25 22:50:23.150 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 22:50:23.150 1 ERROR cinder     service.wait()
>2018-06-25 22:50:23.150 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 22:50:23.150 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 22:50:23.150 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 22:50:23.150 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 22:50:23.150 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 22:50:23.150 1 ERROR cinder     post_fn = fn()
>2018-06-25 22:50:23.150 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 22:50:23.150 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 22:50:23.150 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 22:50:23.150 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 22:50:23.150 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 22:50:23.150 1 ERROR cinder 
>2018-06-25 22:50:25.908 1 WARNING cinder.scheduler.host_manager [req-ecb1c8cc-c215-4aba-8f3a-61c4a6cb31f7 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 22:50:25.914 1 INFO cinder.rpc [req-ecb1c8cc-c215-4aba-8f3a-61c4a6cb31f7 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 22:50:25.921 1 INFO cinder.rpc [req-ecb1c8cc-c215-4aba-8f3a-61c4a6cb31f7 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 22:50:25.933 1 INFO cinder.rpc [req-ecb1c8cc-c215-4aba-8f3a-61c4a6cb31f7 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 22:50:25.940 1 INFO cinder.rpc [req-ecb1c8cc-c215-4aba-8f3a-61c4a6cb31f7 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 22:50:25.968 1 WARNING oslo_config.cfg [req-ecb1c8cc-c215-4aba-8f3a-61c4a6cb31f7 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 22:50:25.973 1 WARNING oslo_config.cfg [req-ecb1c8cc-c215-4aba-8f3a-61c4a6cb31f7 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:50:25.974 1 WARNING oslo_config.cfg [req-ecb1c8cc-c215-4aba-8f3a-61c4a6cb31f7 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:50:25.974 1 WARNING oslo_config.cfg [req-ecb1c8cc-c215-4aba-8f3a-61c4a6cb31f7 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:50:25.980 1 WARNING oslo_config.cfg [req-ecb1c8cc-c215-4aba-8f3a-61c4a6cb31f7 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 22:50:25.982 1 WARNING oslo_config.cfg [req-ecb1c8cc-c215-4aba-8f3a-61c4a6cb31f7 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 22:50:25.985 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 22:50:25.994 1 INFO cinder.manager [req-1aa281c7-2f9f-47ff-a5f7-00a6b26edb1f - - - - -] Initiating service 5 cleanup
>2018-06-25 22:50:26.000 1 INFO cinder.manager [req-1aa281c7-2f9f-47ff-a5f7-00a6b26edb1f - - - - -] Service 5 cleanup completed.
>2018-06-25 22:52:32.102 1 ERROR oslo.messaging._drivers.impl_rabbit [req-1aa281c7-2f9f-47ff-a5f7-00a6b26edb1f - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:52:32.104 1 ERROR oslo.messaging._drivers.impl_rabbit [req-1aa281c7-2f9f-47ff-a5f7-00a6b26edb1f - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:52:32.104 1 ERROR oslo_service.service [req-1aa281c7-2f9f-47ff-a5f7-00a6b26edb1f - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:52:32.104 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 22:52:32.104 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 22:52:32.104 1 ERROR oslo_service.service     service.start()
>2018-06-25 22:52:32.104 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 22:52:32.104 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 22:52:32.104 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 22:52:32.104 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 22:52:32.104 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 22:52:32.104 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 22:52:32.104 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 22:52:32.104 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 22:52:32.104 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 22:52:32.104 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 22:52:32.104 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 22:52:32.104 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 22:52:32.104 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 22:52:32.104 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 22:52:32.104 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 22:52:32.104 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 22:52:32.104 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 22:52:32.104 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 22:52:32.104 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 22:52:32.104 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 22:52:32.104 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 22:52:32.104 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 22:52:32.104 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:52:32.104 1 ERROR oslo_service.service 
>2018-06-25 22:52:32.107 1 CRITICAL cinder [req-ecb1c8cc-c215-4aba-8f3a-61c4a6cb31f7 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 22:52:32.107 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 22:52:32.107 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 22:52:32.107 1 ERROR cinder     sys.exit(main())
>2018-06-25 22:52:32.107 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 22:52:32.107 1 ERROR cinder     service.wait()
>2018-06-25 22:52:32.107 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 22:52:32.107 1 ERROR cinder     _launcher.wait()
>2018-06-25 22:52:32.107 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 22:52:32.107 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 22:52:32.107 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 22:52:32.107 1 ERROR cinder     self.services.wait()
>2018-06-25 22:52:32.107 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 22:52:32.107 1 ERROR cinder     service.wait()
>2018-06-25 22:52:32.107 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 22:52:32.107 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 22:52:32.107 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 22:52:32.107 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 22:52:32.107 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 22:52:32.107 1 ERROR cinder     post_fn = fn()
>2018-06-25 22:52:32.107 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 22:52:32.107 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 22:52:32.107 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 22:52:32.107 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 22:52:32.107 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 22:52:32.107 1 ERROR cinder 
>2018-06-25 22:52:34.721 1 WARNING cinder.scheduler.host_manager [req-33d32983-931a-42ac-bcdb-128217b6a322 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 22:52:34.727 1 INFO cinder.rpc [req-33d32983-931a-42ac-bcdb-128217b6a322 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 22:52:34.733 1 INFO cinder.rpc [req-33d32983-931a-42ac-bcdb-128217b6a322 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 22:52:34.746 1 INFO cinder.rpc [req-33d32983-931a-42ac-bcdb-128217b6a322 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 22:52:34.752 1 INFO cinder.rpc [req-33d32983-931a-42ac-bcdb-128217b6a322 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 22:52:34.780 1 WARNING oslo_config.cfg [req-33d32983-931a-42ac-bcdb-128217b6a322 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 22:52:34.782 1 WARNING oslo_config.cfg [req-33d32983-931a-42ac-bcdb-128217b6a322 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:52:34.783 1 WARNING oslo_config.cfg [req-33d32983-931a-42ac-bcdb-128217b6a322 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:52:34.783 1 WARNING oslo_config.cfg [req-33d32983-931a-42ac-bcdb-128217b6a322 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:52:34.789 1 WARNING oslo_config.cfg [req-33d32983-931a-42ac-bcdb-128217b6a322 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 22:52:34.790 1 WARNING oslo_config.cfg [req-33d32983-931a-42ac-bcdb-128217b6a322 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 22:52:34.793 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 22:52:34.800 1 INFO cinder.manager [req-4e053046-84c7-4531-aac3-5179f2de5808 - - - - -] Initiating service 5 cleanup
>2018-06-25 22:52:34.806 1 INFO cinder.manager [req-4e053046-84c7-4531-aac3-5179f2de5808 - - - - -] Service 5 cleanup completed.
>2018-06-25 22:54:39.259 1 ERROR oslo.messaging._drivers.impl_rabbit [req-4e053046-84c7-4531-aac3-5179f2de5808 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:54:39.261 1 ERROR oslo.messaging._drivers.impl_rabbit [req-4e053046-84c7-4531-aac3-5179f2de5808 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:54:39.261 1 ERROR oslo_service.service [req-4e053046-84c7-4531-aac3-5179f2de5808 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:54:39.261 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 22:54:39.261 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 22:54:39.261 1 ERROR oslo_service.service     service.start()
>2018-06-25 22:54:39.261 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 22:54:39.261 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 22:54:39.261 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 22:54:39.261 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 22:54:39.261 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 22:54:39.261 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 22:54:39.261 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 22:54:39.261 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 22:54:39.261 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 22:54:39.261 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 22:54:39.261 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 22:54:39.261 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 22:54:39.261 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 22:54:39.261 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 22:54:39.261 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 22:54:39.261 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 22:54:39.261 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 22:54:39.261 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 22:54:39.261 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 22:54:39.261 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 22:54:39.261 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 22:54:39.261 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 22:54:39.261 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:54:39.261 1 ERROR oslo_service.service 
>2018-06-25 22:54:39.264 1 CRITICAL cinder [req-33d32983-931a-42ac-bcdb-128217b6a322 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 22:54:39.264 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 22:54:39.264 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 22:54:39.264 1 ERROR cinder     sys.exit(main())
>2018-06-25 22:54:39.264 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 22:54:39.264 1 ERROR cinder     service.wait()
>2018-06-25 22:54:39.264 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 22:54:39.264 1 ERROR cinder     _launcher.wait()
>2018-06-25 22:54:39.264 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 22:54:39.264 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 22:54:39.264 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 22:54:39.264 1 ERROR cinder     self.services.wait()
>2018-06-25 22:54:39.264 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 22:54:39.264 1 ERROR cinder     service.wait()
>2018-06-25 22:54:39.264 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 22:54:39.264 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 22:54:39.264 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 22:54:39.264 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 22:54:39.264 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 22:54:39.264 1 ERROR cinder     post_fn = fn()
>2018-06-25 22:54:39.264 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 22:54:39.264 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 22:54:39.264 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 22:54:39.264 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 22:54:39.264 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 22:54:39.264 1 ERROR cinder 
>2018-06-25 22:54:41.996 1 WARNING cinder.scheduler.host_manager [req-49f173ca-6423-41c3-bb62-8ad73cc510ea - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 22:54:42.002 1 INFO cinder.rpc [req-49f173ca-6423-41c3-bb62-8ad73cc510ea - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 22:54:42.008 1 INFO cinder.rpc [req-49f173ca-6423-41c3-bb62-8ad73cc510ea - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 22:54:42.021 1 INFO cinder.rpc [req-49f173ca-6423-41c3-bb62-8ad73cc510ea - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 22:54:42.027 1 INFO cinder.rpc [req-49f173ca-6423-41c3-bb62-8ad73cc510ea - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 22:54:42.052 1 WARNING oslo_config.cfg [req-49f173ca-6423-41c3-bb62-8ad73cc510ea - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 22:54:42.054 1 WARNING oslo_config.cfg [req-49f173ca-6423-41c3-bb62-8ad73cc510ea - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:54:42.054 1 WARNING oslo_config.cfg [req-49f173ca-6423-41c3-bb62-8ad73cc510ea - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:54:42.055 1 WARNING oslo_config.cfg [req-49f173ca-6423-41c3-bb62-8ad73cc510ea - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:54:42.060 1 WARNING oslo_config.cfg [req-49f173ca-6423-41c3-bb62-8ad73cc510ea - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 22:54:42.061 1 WARNING oslo_config.cfg [req-49f173ca-6423-41c3-bb62-8ad73cc510ea - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 22:54:42.064 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 22:54:42.069 1 INFO cinder.manager [req-7c0b2654-6b5c-449d-9b7c-6053abec42b5 - - - - -] Initiating service 5 cleanup
>2018-06-25 22:54:42.073 1 INFO cinder.manager [req-7c0b2654-6b5c-449d-9b7c-6053abec42b5 - - - - -] Service 5 cleanup completed.
>2018-06-25 22:56:46.496 1 ERROR oslo.messaging._drivers.impl_rabbit [req-7c0b2654-6b5c-449d-9b7c-6053abec42b5 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:56:46.498 1 ERROR oslo.messaging._drivers.impl_rabbit [req-7c0b2654-6b5c-449d-9b7c-6053abec42b5 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:56:46.499 1 ERROR oslo_service.service [req-7c0b2654-6b5c-449d-9b7c-6053abec42b5 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:56:46.499 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 22:56:46.499 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 22:56:46.499 1 ERROR oslo_service.service     service.start()
>2018-06-25 22:56:46.499 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 22:56:46.499 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 22:56:46.499 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 22:56:46.499 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 22:56:46.499 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 22:56:46.499 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 22:56:46.499 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 22:56:46.499 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 22:56:46.499 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 22:56:46.499 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 22:56:46.499 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 22:56:46.499 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 22:56:46.499 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 22:56:46.499 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 22:56:46.499 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 22:56:46.499 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 22:56:46.499 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 22:56:46.499 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 22:56:46.499 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 22:56:46.499 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 22:56:46.499 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 22:56:46.499 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 22:56:46.499 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:56:46.499 1 ERROR oslo_service.service 
>2018-06-25 22:56:46.502 1 CRITICAL cinder [req-49f173ca-6423-41c3-bb62-8ad73cc510ea - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 22:56:46.502 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 22:56:46.502 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 22:56:46.502 1 ERROR cinder     sys.exit(main())
>2018-06-25 22:56:46.502 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 22:56:46.502 1 ERROR cinder     service.wait()
>2018-06-25 22:56:46.502 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 22:56:46.502 1 ERROR cinder     _launcher.wait()
>2018-06-25 22:56:46.502 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 22:56:46.502 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 22:56:46.502 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 22:56:46.502 1 ERROR cinder     self.services.wait()
>2018-06-25 22:56:46.502 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 22:56:46.502 1 ERROR cinder     service.wait()
>2018-06-25 22:56:46.502 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 22:56:46.502 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 22:56:46.502 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 22:56:46.502 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 22:56:46.502 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 22:56:46.502 1 ERROR cinder     post_fn = fn()
>2018-06-25 22:56:46.502 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 22:56:46.502 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 22:56:46.502 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 22:56:46.502 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 22:56:46.502 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 22:56:46.502 1 ERROR cinder 
>2018-06-25 22:56:49.106 1 WARNING cinder.scheduler.host_manager [req-fb77299d-c86f-41c8-aafa-613a1ac1a278 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 22:56:49.113 1 INFO cinder.rpc [req-fb77299d-c86f-41c8-aafa-613a1ac1a278 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 22:56:49.120 1 INFO cinder.rpc [req-fb77299d-c86f-41c8-aafa-613a1ac1a278 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 22:56:49.142 1 INFO cinder.rpc [req-fb77299d-c86f-41c8-aafa-613a1ac1a278 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 22:56:49.150 1 INFO cinder.rpc [req-fb77299d-c86f-41c8-aafa-613a1ac1a278 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 22:56:49.188 1 WARNING oslo_config.cfg [req-fb77299d-c86f-41c8-aafa-613a1ac1a278 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 22:56:49.190 1 WARNING oslo_config.cfg [req-fb77299d-c86f-41c8-aafa-613a1ac1a278 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:56:49.191 1 WARNING oslo_config.cfg [req-fb77299d-c86f-41c8-aafa-613a1ac1a278 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:56:49.192 1 WARNING oslo_config.cfg [req-fb77299d-c86f-41c8-aafa-613a1ac1a278 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:56:49.197 1 WARNING oslo_config.cfg [req-fb77299d-c86f-41c8-aafa-613a1ac1a278 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 22:56:49.198 1 WARNING oslo_config.cfg [req-fb77299d-c86f-41c8-aafa-613a1ac1a278 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 22:56:49.201 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 22:56:49.208 1 INFO cinder.manager [req-203054fe-d852-4871-b43d-42e66a1f7189 - - - - -] Initiating service 5 cleanup
>2018-06-25 22:56:49.214 1 INFO cinder.manager [req-203054fe-d852-4871-b43d-42e66a1f7189 - - - - -] Service 5 cleanup completed.
>2018-06-25 22:59:01.020 1 ERROR oslo.messaging._drivers.impl_rabbit [req-203054fe-d852-4871-b43d-42e66a1f7189 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:59:01.022 1 ERROR oslo.messaging._drivers.impl_rabbit [req-203054fe-d852-4871-b43d-42e66a1f7189 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:59:01.023 1 ERROR oslo_service.service [req-203054fe-d852-4871-b43d-42e66a1f7189 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:59:01.023 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 22:59:01.023 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 22:59:01.023 1 ERROR oslo_service.service     service.start()
>2018-06-25 22:59:01.023 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 22:59:01.023 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 22:59:01.023 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 22:59:01.023 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 22:59:01.023 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 22:59:01.023 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 22:59:01.023 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 22:59:01.023 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 22:59:01.023 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 22:59:01.023 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 22:59:01.023 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 22:59:01.023 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 22:59:01.023 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 22:59:01.023 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 22:59:01.023 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 22:59:01.023 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 22:59:01.023 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 22:59:01.023 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 22:59:01.023 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 22:59:01.023 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 22:59:01.023 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 22:59:01.023 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 22:59:01.023 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 22:59:01.023 1 ERROR oslo_service.service 
>2018-06-25 22:59:01.025 1 CRITICAL cinder [req-fb77299d-c86f-41c8-aafa-613a1ac1a278 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 22:59:01.025 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 22:59:01.025 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 22:59:01.025 1 ERROR cinder     sys.exit(main())
>2018-06-25 22:59:01.025 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 22:59:01.025 1 ERROR cinder     service.wait()
>2018-06-25 22:59:01.025 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 22:59:01.025 1 ERROR cinder     _launcher.wait()
>2018-06-25 22:59:01.025 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 22:59:01.025 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 22:59:01.025 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 22:59:01.025 1 ERROR cinder     self.services.wait()
>2018-06-25 22:59:01.025 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 22:59:01.025 1 ERROR cinder     service.wait()
>2018-06-25 22:59:01.025 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 22:59:01.025 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 22:59:01.025 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 22:59:01.025 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 22:59:01.025 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 22:59:01.025 1 ERROR cinder     post_fn = fn()
>2018-06-25 22:59:01.025 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 22:59:01.025 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 22:59:01.025 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 22:59:01.025 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 22:59:01.025 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 22:59:01.025 1 ERROR cinder 
>2018-06-25 22:59:03.901 1 WARNING cinder.scheduler.host_manager [req-a4da0368-0b9d-4eeb-b7c3-80259177323a - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 22:59:03.907 1 INFO cinder.rpc [req-a4da0368-0b9d-4eeb-b7c3-80259177323a - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 22:59:03.913 1 INFO cinder.rpc [req-a4da0368-0b9d-4eeb-b7c3-80259177323a - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 22:59:03.923 1 INFO cinder.rpc [req-a4da0368-0b9d-4eeb-b7c3-80259177323a - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 22:59:03.929 1 INFO cinder.rpc [req-a4da0368-0b9d-4eeb-b7c3-80259177323a - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 22:59:03.953 1 WARNING oslo_config.cfg [req-a4da0368-0b9d-4eeb-b7c3-80259177323a - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 22:59:03.955 1 WARNING oslo_config.cfg [req-a4da0368-0b9d-4eeb-b7c3-80259177323a - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:59:03.956 1 WARNING oslo_config.cfg [req-a4da0368-0b9d-4eeb-b7c3-80259177323a - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:59:03.956 1 WARNING oslo_config.cfg [req-a4da0368-0b9d-4eeb-b7c3-80259177323a - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 22:59:03.961 1 WARNING oslo_config.cfg [req-a4da0368-0b9d-4eeb-b7c3-80259177323a - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 22:59:03.962 1 WARNING oslo_config.cfg [req-a4da0368-0b9d-4eeb-b7c3-80259177323a - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 22:59:03.965 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 22:59:03.971 1 INFO cinder.manager [req-e227f6a9-102c-4153-8b6e-1f736adb2461 - - - - -] Initiating service 5 cleanup
>2018-06-25 22:59:03.979 1 INFO cinder.manager [req-e227f6a9-102c-4153-8b6e-1f736adb2461 - - - - -] Service 5 cleanup completed.
>2018-06-25 23:01:10.285 1 ERROR oslo.messaging._drivers.impl_rabbit [req-e227f6a9-102c-4153-8b6e-1f736adb2461 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:01:10.287 1 ERROR oslo.messaging._drivers.impl_rabbit [req-e227f6a9-102c-4153-8b6e-1f736adb2461 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:01:10.287 1 ERROR oslo_service.service [req-e227f6a9-102c-4153-8b6e-1f736adb2461 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:01:10.287 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 23:01:10.287 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 23:01:10.287 1 ERROR oslo_service.service     service.start()
>2018-06-25 23:01:10.287 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 23:01:10.287 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 23:01:10.287 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 23:01:10.287 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 23:01:10.287 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 23:01:10.287 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 23:01:10.287 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 23:01:10.287 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 23:01:10.287 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 23:01:10.287 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 23:01:10.287 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 23:01:10.287 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 23:01:10.287 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 23:01:10.287 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 23:01:10.287 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 23:01:10.287 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 23:01:10.287 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 23:01:10.287 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 23:01:10.287 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 23:01:10.287 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 23:01:10.287 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 23:01:10.287 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 23:01:10.287 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:01:10.287 1 ERROR oslo_service.service 
>2018-06-25 23:01:10.290 1 CRITICAL cinder [req-a4da0368-0b9d-4eeb-b7c3-80259177323a - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 23:01:10.290 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 23:01:10.290 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 23:01:10.290 1 ERROR cinder     sys.exit(main())
>2018-06-25 23:01:10.290 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 23:01:10.290 1 ERROR cinder     service.wait()
>2018-06-25 23:01:10.290 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 23:01:10.290 1 ERROR cinder     _launcher.wait()
>2018-06-25 23:01:10.290 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 23:01:10.290 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 23:01:10.290 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 23:01:10.290 1 ERROR cinder     self.services.wait()
>2018-06-25 23:01:10.290 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 23:01:10.290 1 ERROR cinder     service.wait()
>2018-06-25 23:01:10.290 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 23:01:10.290 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 23:01:10.290 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 23:01:10.290 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 23:01:10.290 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 23:01:10.290 1 ERROR cinder     post_fn = fn()
>2018-06-25 23:01:10.290 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 23:01:10.290 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 23:01:10.290 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 23:01:10.290 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 23:01:10.290 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 23:01:10.290 1 ERROR cinder 
>2018-06-25 23:01:13.085 1 WARNING cinder.scheduler.host_manager [req-d7c7d06a-67a3-481e-90d3-6bdb65b7ad15 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 23:01:13.091 1 INFO cinder.rpc [req-d7c7d06a-67a3-481e-90d3-6bdb65b7ad15 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 23:01:13.097 1 INFO cinder.rpc [req-d7c7d06a-67a3-481e-90d3-6bdb65b7ad15 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 23:01:13.108 1 INFO cinder.rpc [req-d7c7d06a-67a3-481e-90d3-6bdb65b7ad15 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 23:01:13.114 1 INFO cinder.rpc [req-d7c7d06a-67a3-481e-90d3-6bdb65b7ad15 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 23:01:13.139 1 WARNING oslo_config.cfg [req-d7c7d06a-67a3-481e-90d3-6bdb65b7ad15 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 23:01:13.141 1 WARNING oslo_config.cfg [req-d7c7d06a-67a3-481e-90d3-6bdb65b7ad15 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:01:13.142 1 WARNING oslo_config.cfg [req-d7c7d06a-67a3-481e-90d3-6bdb65b7ad15 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:01:13.143 1 WARNING oslo_config.cfg [req-d7c7d06a-67a3-481e-90d3-6bdb65b7ad15 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:01:13.150 1 WARNING oslo_config.cfg [req-d7c7d06a-67a3-481e-90d3-6bdb65b7ad15 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 23:01:13.151 1 WARNING oslo_config.cfg [req-d7c7d06a-67a3-481e-90d3-6bdb65b7ad15 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 23:01:13.156 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 23:01:13.167 1 INFO cinder.manager [req-21f40970-1b94-4a7d-b910-d192306212e1 - - - - -] Initiating service 5 cleanup
>2018-06-25 23:01:13.172 1 INFO cinder.manager [req-21f40970-1b94-4a7d-b910-d192306212e1 - - - - -] Service 5 cleanup completed.
>2018-06-25 23:03:18.940 1 ERROR oslo.messaging._drivers.impl_rabbit [req-21f40970-1b94-4a7d-b910-d192306212e1 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:03:18.941 1 ERROR oslo.messaging._drivers.impl_rabbit [req-21f40970-1b94-4a7d-b910-d192306212e1 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:03:18.942 1 ERROR oslo_service.service [req-21f40970-1b94-4a7d-b910-d192306212e1 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:03:18.942 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 23:03:18.942 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 23:03:18.942 1 ERROR oslo_service.service     service.start()
>2018-06-25 23:03:18.942 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 23:03:18.942 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 23:03:18.942 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 23:03:18.942 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 23:03:18.942 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 23:03:18.942 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 23:03:18.942 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 23:03:18.942 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 23:03:18.942 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 23:03:18.942 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 23:03:18.942 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 23:03:18.942 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 23:03:18.942 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 23:03:18.942 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 23:03:18.942 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 23:03:18.942 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 23:03:18.942 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 23:03:18.942 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 23:03:18.942 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 23:03:18.942 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 23:03:18.942 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 23:03:18.942 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 23:03:18.942 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:03:18.942 1 ERROR oslo_service.service 
>2018-06-25 23:03:18.944 1 CRITICAL cinder [req-d7c7d06a-67a3-481e-90d3-6bdb65b7ad15 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 23:03:18.944 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 23:03:18.944 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 23:03:18.944 1 ERROR cinder     sys.exit(main())
>2018-06-25 23:03:18.944 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 23:03:18.944 1 ERROR cinder     service.wait()
>2018-06-25 23:03:18.944 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 23:03:18.944 1 ERROR cinder     _launcher.wait()
>2018-06-25 23:03:18.944 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 23:03:18.944 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 23:03:18.944 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 23:03:18.944 1 ERROR cinder     self.services.wait()
>2018-06-25 23:03:18.944 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 23:03:18.944 1 ERROR cinder     service.wait()
>2018-06-25 23:03:18.944 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 23:03:18.944 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 23:03:18.944 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 23:03:18.944 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 23:03:18.944 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 23:03:18.944 1 ERROR cinder     post_fn = fn()
>2018-06-25 23:03:18.944 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 23:03:18.944 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 23:03:18.944 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 23:03:18.944 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 23:03:18.944 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 23:03:18.944 1 ERROR cinder 
>2018-06-25 23:03:21.731 1 WARNING cinder.scheduler.host_manager [req-4bdb955c-dc3a-450a-82d1-fb5a4a115d40 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 23:03:21.738 1 INFO cinder.rpc [req-4bdb955c-dc3a-450a-82d1-fb5a4a115d40 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 23:03:21.743 1 INFO cinder.rpc [req-4bdb955c-dc3a-450a-82d1-fb5a4a115d40 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 23:03:21.757 1 INFO cinder.rpc [req-4bdb955c-dc3a-450a-82d1-fb5a4a115d40 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 23:03:21.763 1 INFO cinder.rpc [req-4bdb955c-dc3a-450a-82d1-fb5a4a115d40 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 23:03:21.789 1 WARNING oslo_config.cfg [req-4bdb955c-dc3a-450a-82d1-fb5a4a115d40 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 23:03:21.791 1 WARNING oslo_config.cfg [req-4bdb955c-dc3a-450a-82d1-fb5a4a115d40 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:03:21.792 1 WARNING oslo_config.cfg [req-4bdb955c-dc3a-450a-82d1-fb5a4a115d40 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:03:21.792 1 WARNING oslo_config.cfg [req-4bdb955c-dc3a-450a-82d1-fb5a4a115d40 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:03:21.797 1 WARNING oslo_config.cfg [req-4bdb955c-dc3a-450a-82d1-fb5a4a115d40 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 23:03:21.799 1 WARNING oslo_config.cfg [req-4bdb955c-dc3a-450a-82d1-fb5a4a115d40 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 23:03:21.801 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 23:03:21.807 1 INFO cinder.manager [req-be1ea886-8c91-45dd-9ad1-10327065bfda - - - - -] Initiating service 5 cleanup
>2018-06-25 23:03:21.811 1 INFO cinder.manager [req-be1ea886-8c91-45dd-9ad1-10327065bfda - - - - -] Service 5 cleanup completed.
>2018-06-25 23:05:33.495 1 ERROR oslo.messaging._drivers.impl_rabbit [req-be1ea886-8c91-45dd-9ad1-10327065bfda - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:05:33.497 1 ERROR oslo.messaging._drivers.impl_rabbit [req-be1ea886-8c91-45dd-9ad1-10327065bfda - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:05:33.497 1 ERROR oslo_service.service [req-be1ea886-8c91-45dd-9ad1-10327065bfda - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:05:33.497 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 23:05:33.497 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 23:05:33.497 1 ERROR oslo_service.service     service.start()
>2018-06-25 23:05:33.497 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 23:05:33.497 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 23:05:33.497 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 23:05:33.497 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 23:05:33.497 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 23:05:33.497 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 23:05:33.497 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 23:05:33.497 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 23:05:33.497 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 23:05:33.497 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 23:05:33.497 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 23:05:33.497 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 23:05:33.497 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 23:05:33.497 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 23:05:33.497 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 23:05:33.497 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 23:05:33.497 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 23:05:33.497 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 23:05:33.497 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 23:05:33.497 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 23:05:33.497 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 23:05:33.497 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 23:05:33.497 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:05:33.497 1 ERROR oslo_service.service 
>2018-06-25 23:05:33.500 1 CRITICAL cinder [req-4bdb955c-dc3a-450a-82d1-fb5a4a115d40 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 23:05:33.500 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 23:05:33.500 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 23:05:33.500 1 ERROR cinder     sys.exit(main())
>2018-06-25 23:05:33.500 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 23:05:33.500 1 ERROR cinder     service.wait()
>2018-06-25 23:05:33.500 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 23:05:33.500 1 ERROR cinder     _launcher.wait()
>2018-06-25 23:05:33.500 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 23:05:33.500 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 23:05:33.500 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 23:05:33.500 1 ERROR cinder     self.services.wait()
>2018-06-25 23:05:33.500 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 23:05:33.500 1 ERROR cinder     service.wait()
>2018-06-25 23:05:33.500 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 23:05:33.500 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 23:05:33.500 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 23:05:33.500 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 23:05:33.500 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 23:05:33.500 1 ERROR cinder     post_fn = fn()
>2018-06-25 23:05:33.500 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 23:05:33.500 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 23:05:33.500 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 23:05:33.500 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 23:05:33.500 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 23:05:33.500 1 ERROR cinder 
>2018-06-25 23:05:36.189 1 WARNING cinder.scheduler.host_manager [req-90e79ba2-a55d-4959-9b2e-8eab159fbfe9 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 23:05:36.196 1 INFO cinder.rpc [req-90e79ba2-a55d-4959-9b2e-8eab159fbfe9 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 23:05:36.202 1 INFO cinder.rpc [req-90e79ba2-a55d-4959-9b2e-8eab159fbfe9 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 23:05:36.221 1 INFO cinder.rpc [req-90e79ba2-a55d-4959-9b2e-8eab159fbfe9 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 23:05:36.232 1 INFO cinder.rpc [req-90e79ba2-a55d-4959-9b2e-8eab159fbfe9 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 23:05:36.257 1 WARNING oslo_config.cfg [req-90e79ba2-a55d-4959-9b2e-8eab159fbfe9 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 23:05:36.259 1 WARNING oslo_config.cfg [req-90e79ba2-a55d-4959-9b2e-8eab159fbfe9 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:05:36.259 1 WARNING oslo_config.cfg [req-90e79ba2-a55d-4959-9b2e-8eab159fbfe9 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:05:36.260 1 WARNING oslo_config.cfg [req-90e79ba2-a55d-4959-9b2e-8eab159fbfe9 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:05:36.266 1 WARNING oslo_config.cfg [req-90e79ba2-a55d-4959-9b2e-8eab159fbfe9 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 23:05:36.267 1 WARNING oslo_config.cfg [req-90e79ba2-a55d-4959-9b2e-8eab159fbfe9 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 23:05:36.269 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 23:05:36.276 1 INFO cinder.manager [req-c314ad0c-baae-4328-868e-12c825851fd2 - - - - -] Initiating service 5 cleanup
>2018-06-25 23:05:36.281 1 INFO cinder.manager [req-c314ad0c-baae-4328-868e-12c825851fd2 - - - - -] Service 5 cleanup completed.
>2018-06-25 23:07:42.623 1 ERROR oslo.messaging._drivers.impl_rabbit [req-c314ad0c-baae-4328-868e-12c825851fd2 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:07:42.625 1 ERROR oslo.messaging._drivers.impl_rabbit [req-c314ad0c-baae-4328-868e-12c825851fd2 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:07:42.625 1 ERROR oslo_service.service [req-c314ad0c-baae-4328-868e-12c825851fd2 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:07:42.625 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 23:07:42.625 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 23:07:42.625 1 ERROR oslo_service.service     service.start()
>2018-06-25 23:07:42.625 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 23:07:42.625 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 23:07:42.625 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 23:07:42.625 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 23:07:42.625 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 23:07:42.625 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 23:07:42.625 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 23:07:42.625 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 23:07:42.625 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 23:07:42.625 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 23:07:42.625 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 23:07:42.625 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 23:07:42.625 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 23:07:42.625 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 23:07:42.625 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 23:07:42.625 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 23:07:42.625 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 23:07:42.625 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 23:07:42.625 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 23:07:42.625 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 23:07:42.625 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 23:07:42.625 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 23:07:42.625 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:07:42.625 1 ERROR oslo_service.service 
>2018-06-25 23:07:42.628 1 CRITICAL cinder [req-90e79ba2-a55d-4959-9b2e-8eab159fbfe9 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 23:07:42.628 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 23:07:42.628 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 23:07:42.628 1 ERROR cinder     sys.exit(main())
>2018-06-25 23:07:42.628 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 23:07:42.628 1 ERROR cinder     service.wait()
>2018-06-25 23:07:42.628 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 23:07:42.628 1 ERROR cinder     _launcher.wait()
>2018-06-25 23:07:42.628 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 23:07:42.628 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 23:07:42.628 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 23:07:42.628 1 ERROR cinder     self.services.wait()
>2018-06-25 23:07:42.628 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 23:07:42.628 1 ERROR cinder     service.wait()
>2018-06-25 23:07:42.628 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 23:07:42.628 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 23:07:42.628 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 23:07:42.628 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 23:07:42.628 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 23:07:42.628 1 ERROR cinder     post_fn = fn()
>2018-06-25 23:07:42.628 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 23:07:42.628 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 23:07:42.628 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 23:07:42.628 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 23:07:42.628 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 23:07:42.628 1 ERROR cinder 
>2018-06-25 23:07:45.310 1 WARNING cinder.scheduler.host_manager [req-37f12a25-b4e2-41be-ab26-ea81caa1ec8c - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 23:07:45.316 1 INFO cinder.rpc [req-37f12a25-b4e2-41be-ab26-ea81caa1ec8c - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 23:07:45.321 1 INFO cinder.rpc [req-37f12a25-b4e2-41be-ab26-ea81caa1ec8c - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 23:07:45.332 1 INFO cinder.rpc [req-37f12a25-b4e2-41be-ab26-ea81caa1ec8c - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 23:07:45.339 1 INFO cinder.rpc [req-37f12a25-b4e2-41be-ab26-ea81caa1ec8c - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 23:07:45.362 1 WARNING oslo_config.cfg [req-37f12a25-b4e2-41be-ab26-ea81caa1ec8c - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 23:07:45.364 1 WARNING oslo_config.cfg [req-37f12a25-b4e2-41be-ab26-ea81caa1ec8c - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:07:45.364 1 WARNING oslo_config.cfg [req-37f12a25-b4e2-41be-ab26-ea81caa1ec8c - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:07:45.365 1 WARNING oslo_config.cfg [req-37f12a25-b4e2-41be-ab26-ea81caa1ec8c - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:07:45.370 1 WARNING oslo_config.cfg [req-37f12a25-b4e2-41be-ab26-ea81caa1ec8c - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 23:07:45.372 1 WARNING oslo_config.cfg [req-37f12a25-b4e2-41be-ab26-ea81caa1ec8c - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 23:07:45.374 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 23:07:45.381 1 INFO cinder.manager [req-c82b0a21-b88d-45cc-b6b7-1498920d8027 - - - - -] Initiating service 5 cleanup
>2018-06-25 23:07:45.386 1 INFO cinder.manager [req-c82b0a21-b88d-45cc-b6b7-1498920d8027 - - - - -] Service 5 cleanup completed.
>2018-06-25 23:09:57.088 1 ERROR oslo.messaging._drivers.impl_rabbit [req-c82b0a21-b88d-45cc-b6b7-1498920d8027 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:09:57.090 1 ERROR oslo.messaging._drivers.impl_rabbit [req-c82b0a21-b88d-45cc-b6b7-1498920d8027 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:09:57.091 1 ERROR oslo_service.service [req-c82b0a21-b88d-45cc-b6b7-1498920d8027 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:09:57.091 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 23:09:57.091 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 23:09:57.091 1 ERROR oslo_service.service     service.start()
>2018-06-25 23:09:57.091 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 23:09:57.091 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 23:09:57.091 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 23:09:57.091 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 23:09:57.091 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 23:09:57.091 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 23:09:57.091 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 23:09:57.091 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 23:09:57.091 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 23:09:57.091 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 23:09:57.091 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 23:09:57.091 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 23:09:57.091 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 23:09:57.091 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 23:09:57.091 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 23:09:57.091 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 23:09:57.091 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 23:09:57.091 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 23:09:57.091 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 23:09:57.091 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 23:09:57.091 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 23:09:57.091 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 23:09:57.091 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:09:57.091 1 ERROR oslo_service.service 
>2018-06-25 23:09:57.093 1 CRITICAL cinder [req-37f12a25-b4e2-41be-ab26-ea81caa1ec8c - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 23:09:57.093 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 23:09:57.093 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 23:09:57.093 1 ERROR cinder     sys.exit(main())
>2018-06-25 23:09:57.093 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 23:09:57.093 1 ERROR cinder     service.wait()
>2018-06-25 23:09:57.093 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 23:09:57.093 1 ERROR cinder     _launcher.wait()
>2018-06-25 23:09:57.093 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 23:09:57.093 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 23:09:57.093 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 23:09:57.093 1 ERROR cinder     self.services.wait()
>2018-06-25 23:09:57.093 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 23:09:57.093 1 ERROR cinder     service.wait()
>2018-06-25 23:09:57.093 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 23:09:57.093 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 23:09:57.093 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 23:09:57.093 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 23:09:57.093 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 23:09:57.093 1 ERROR cinder     post_fn = fn()
>2018-06-25 23:09:57.093 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 23:09:57.093 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 23:09:57.093 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 23:09:57.093 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 23:09:57.093 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 23:09:57.093 1 ERROR cinder 
>2018-06-25 23:09:59.749 1 WARNING cinder.scheduler.host_manager [req-b42de295-ea49-4cf4-8c87-09559e356e45 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 23:09:59.755 1 INFO cinder.rpc [req-b42de295-ea49-4cf4-8c87-09559e356e45 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 23:09:59.762 1 INFO cinder.rpc [req-b42de295-ea49-4cf4-8c87-09559e356e45 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 23:09:59.775 1 INFO cinder.rpc [req-b42de295-ea49-4cf4-8c87-09559e356e45 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 23:09:59.781 1 INFO cinder.rpc [req-b42de295-ea49-4cf4-8c87-09559e356e45 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 23:09:59.804 1 WARNING oslo_config.cfg [req-b42de295-ea49-4cf4-8c87-09559e356e45 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 23:09:59.806 1 WARNING oslo_config.cfg [req-b42de295-ea49-4cf4-8c87-09559e356e45 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:09:59.806 1 WARNING oslo_config.cfg [req-b42de295-ea49-4cf4-8c87-09559e356e45 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:09:59.807 1 WARNING oslo_config.cfg [req-b42de295-ea49-4cf4-8c87-09559e356e45 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:09:59.812 1 WARNING oslo_config.cfg [req-b42de295-ea49-4cf4-8c87-09559e356e45 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 23:09:59.813 1 WARNING oslo_config.cfg [req-b42de295-ea49-4cf4-8c87-09559e356e45 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 23:09:59.815 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 23:09:59.823 1 INFO cinder.manager [req-b20aa92b-52e6-4667-940c-946c2f298870 - - - - -] Initiating service 5 cleanup
>2018-06-25 23:09:59.828 1 INFO cinder.manager [req-b20aa92b-52e6-4667-940c-946c2f298870 - - - - -] Service 5 cleanup completed.
>2018-06-25 23:12:04.305 1 ERROR oslo.messaging._drivers.impl_rabbit [req-b20aa92b-52e6-4667-940c-946c2f298870 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:12:04.307 1 ERROR oslo.messaging._drivers.impl_rabbit [req-b20aa92b-52e6-4667-940c-946c2f298870 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:12:04.307 1 ERROR oslo_service.service [req-b20aa92b-52e6-4667-940c-946c2f298870 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:12:04.307 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 23:12:04.307 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 23:12:04.307 1 ERROR oslo_service.service     service.start()
>2018-06-25 23:12:04.307 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 23:12:04.307 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 23:12:04.307 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 23:12:04.307 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 23:12:04.307 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 23:12:04.307 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 23:12:04.307 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 23:12:04.307 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 23:12:04.307 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 23:12:04.307 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 23:12:04.307 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 23:12:04.307 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 23:12:04.307 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 23:12:04.307 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 23:12:04.307 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 23:12:04.307 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 23:12:04.307 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 23:12:04.307 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 23:12:04.307 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 23:12:04.307 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 23:12:04.307 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 23:12:04.307 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 23:12:04.307 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:12:04.307 1 ERROR oslo_service.service 
>2018-06-25 23:12:04.310 1 CRITICAL cinder [req-b42de295-ea49-4cf4-8c87-09559e356e45 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 23:12:04.310 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 23:12:04.310 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 23:12:04.310 1 ERROR cinder     sys.exit(main())
>2018-06-25 23:12:04.310 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 23:12:04.310 1 ERROR cinder     service.wait()
>2018-06-25 23:12:04.310 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 23:12:04.310 1 ERROR cinder     _launcher.wait()
>2018-06-25 23:12:04.310 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 23:12:04.310 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 23:12:04.310 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 23:12:04.310 1 ERROR cinder     self.services.wait()
>2018-06-25 23:12:04.310 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 23:12:04.310 1 ERROR cinder     service.wait()
>2018-06-25 23:12:04.310 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 23:12:04.310 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 23:12:04.310 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 23:12:04.310 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 23:12:04.310 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 23:12:04.310 1 ERROR cinder     post_fn = fn()
>2018-06-25 23:12:04.310 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 23:12:04.310 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 23:12:04.310 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 23:12:04.310 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 23:12:04.310 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 23:12:04.310 1 ERROR cinder 
>2018-06-25 23:12:06.887 1 WARNING cinder.scheduler.host_manager [req-60199983-067f-411a-bf52-930b1eac8f5d - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 23:12:06.893 1 INFO cinder.rpc [req-60199983-067f-411a-bf52-930b1eac8f5d - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 23:12:06.898 1 INFO cinder.rpc [req-60199983-067f-411a-bf52-930b1eac8f5d - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 23:12:06.911 1 INFO cinder.rpc [req-60199983-067f-411a-bf52-930b1eac8f5d - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 23:12:06.917 1 INFO cinder.rpc [req-60199983-067f-411a-bf52-930b1eac8f5d - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 23:12:06.940 1 WARNING oslo_config.cfg [req-60199983-067f-411a-bf52-930b1eac8f5d - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 23:12:06.943 1 WARNING oslo_config.cfg [req-60199983-067f-411a-bf52-930b1eac8f5d - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:12:06.943 1 WARNING oslo_config.cfg [req-60199983-067f-411a-bf52-930b1eac8f5d - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:12:06.944 1 WARNING oslo_config.cfg [req-60199983-067f-411a-bf52-930b1eac8f5d - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:12:06.949 1 WARNING oslo_config.cfg [req-60199983-067f-411a-bf52-930b1eac8f5d - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 23:12:06.950 1 WARNING oslo_config.cfg [req-60199983-067f-411a-bf52-930b1eac8f5d - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 23:12:06.952 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 23:12:06.959 1 INFO cinder.manager [req-08e0c1e0-1560-4457-9079-b4e99d3dcf9f - - - - -] Initiating service 5 cleanup
>2018-06-25 23:12:06.964 1 INFO cinder.manager [req-08e0c1e0-1560-4457-9079-b4e99d3dcf9f - - - - -] Service 5 cleanup completed.
>2018-06-25 23:14:11.477 1 ERROR oslo.messaging._drivers.impl_rabbit [req-08e0c1e0-1560-4457-9079-b4e99d3dcf9f - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:14:11.480 1 ERROR oslo.messaging._drivers.impl_rabbit [req-08e0c1e0-1560-4457-9079-b4e99d3dcf9f - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:14:11.481 1 ERROR oslo_service.service [req-08e0c1e0-1560-4457-9079-b4e99d3dcf9f - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:14:11.481 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 23:14:11.481 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 23:14:11.481 1 ERROR oslo_service.service     service.start()
>2018-06-25 23:14:11.481 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 23:14:11.481 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 23:14:11.481 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 23:14:11.481 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 23:14:11.481 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 23:14:11.481 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 23:14:11.481 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 23:14:11.481 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 23:14:11.481 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 23:14:11.481 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 23:14:11.481 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 23:14:11.481 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 23:14:11.481 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 23:14:11.481 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 23:14:11.481 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 23:14:11.481 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 23:14:11.481 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 23:14:11.481 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 23:14:11.481 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 23:14:11.481 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 23:14:11.481 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 23:14:11.481 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 23:14:11.481 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:14:11.481 1 ERROR oslo_service.service 
>2018-06-25 23:14:11.484 1 CRITICAL cinder [req-60199983-067f-411a-bf52-930b1eac8f5d - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 23:14:11.484 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 23:14:11.484 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 23:14:11.484 1 ERROR cinder     sys.exit(main())
>2018-06-25 23:14:11.484 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 23:14:11.484 1 ERROR cinder     service.wait()
>2018-06-25 23:14:11.484 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 23:14:11.484 1 ERROR cinder     _launcher.wait()
>2018-06-25 23:14:11.484 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 23:14:11.484 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 23:14:11.484 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 23:14:11.484 1 ERROR cinder     self.services.wait()
>2018-06-25 23:14:11.484 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 23:14:11.484 1 ERROR cinder     service.wait()
>2018-06-25 23:14:11.484 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 23:14:11.484 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 23:14:11.484 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 23:14:11.484 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 23:14:11.484 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 23:14:11.484 1 ERROR cinder     post_fn = fn()
>2018-06-25 23:14:11.484 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 23:14:11.484 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 23:14:11.484 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 23:14:11.484 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 23:14:11.484 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 23:14:11.484 1 ERROR cinder 
>2018-06-25 23:14:14.011 1 WARNING cinder.scheduler.host_manager [req-484d9d9d-1045-41aa-916c-45a50fd141ae - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 23:14:14.017 1 INFO cinder.rpc [req-484d9d9d-1045-41aa-916c-45a50fd141ae - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 23:14:14.022 1 INFO cinder.rpc [req-484d9d9d-1045-41aa-916c-45a50fd141ae - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 23:14:14.032 1 INFO cinder.rpc [req-484d9d9d-1045-41aa-916c-45a50fd141ae - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 23:14:14.038 1 INFO cinder.rpc [req-484d9d9d-1045-41aa-916c-45a50fd141ae - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 23:14:14.068 1 WARNING oslo_config.cfg [req-484d9d9d-1045-41aa-916c-45a50fd141ae - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 23:14:14.070 1 WARNING oslo_config.cfg [req-484d9d9d-1045-41aa-916c-45a50fd141ae - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:14:14.071 1 WARNING oslo_config.cfg [req-484d9d9d-1045-41aa-916c-45a50fd141ae - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:14:14.071 1 WARNING oslo_config.cfg [req-484d9d9d-1045-41aa-916c-45a50fd141ae - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:14:14.076 1 WARNING oslo_config.cfg [req-484d9d9d-1045-41aa-916c-45a50fd141ae - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 23:14:14.077 1 WARNING oslo_config.cfg [req-484d9d9d-1045-41aa-916c-45a50fd141ae - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 23:14:14.080 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 23:14:14.086 1 INFO cinder.manager [req-046e3b06-a782-4144-a65b-8dae873c4600 - - - - -] Initiating service 5 cleanup
>2018-06-25 23:14:14.091 1 INFO cinder.manager [req-046e3b06-a782-4144-a65b-8dae873c4600 - - - - -] Service 5 cleanup completed.
>2018-06-25 23:16:20.158 1 ERROR oslo.messaging._drivers.impl_rabbit [req-046e3b06-a782-4144-a65b-8dae873c4600 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:16:20.160 1 ERROR oslo.messaging._drivers.impl_rabbit [req-046e3b06-a782-4144-a65b-8dae873c4600 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:16:20.160 1 ERROR oslo_service.service [req-046e3b06-a782-4144-a65b-8dae873c4600 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:16:20.160 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 23:16:20.160 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 23:16:20.160 1 ERROR oslo_service.service     service.start()
>2018-06-25 23:16:20.160 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 23:16:20.160 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 23:16:20.160 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 23:16:20.160 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 23:16:20.160 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 23:16:20.160 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 23:16:20.160 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 23:16:20.160 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 23:16:20.160 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 23:16:20.160 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 23:16:20.160 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 23:16:20.160 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 23:16:20.160 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 23:16:20.160 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 23:16:20.160 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 23:16:20.160 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 23:16:20.160 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 23:16:20.160 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 23:16:20.160 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 23:16:20.160 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 23:16:20.160 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 23:16:20.160 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 23:16:20.160 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:16:20.160 1 ERROR oslo_service.service 
>2018-06-25 23:16:20.163 1 CRITICAL cinder [req-484d9d9d-1045-41aa-916c-45a50fd141ae - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 23:16:20.163 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 23:16:20.163 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 23:16:20.163 1 ERROR cinder     sys.exit(main())
>2018-06-25 23:16:20.163 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 23:16:20.163 1 ERROR cinder     service.wait()
>2018-06-25 23:16:20.163 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 23:16:20.163 1 ERROR cinder     _launcher.wait()
>2018-06-25 23:16:20.163 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 23:16:20.163 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 23:16:20.163 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 23:16:20.163 1 ERROR cinder     self.services.wait()
>2018-06-25 23:16:20.163 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 23:16:20.163 1 ERROR cinder     service.wait()
>2018-06-25 23:16:20.163 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 23:16:20.163 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 23:16:20.163 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 23:16:20.163 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 23:16:20.163 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 23:16:20.163 1 ERROR cinder     post_fn = fn()
>2018-06-25 23:16:20.163 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 23:16:20.163 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 23:16:20.163 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 23:16:20.163 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 23:16:20.163 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 23:16:20.163 1 ERROR cinder 
>2018-06-25 23:16:22.789 1 WARNING cinder.scheduler.host_manager [req-f0aa228c-80f4-400e-bb95-123ca0a2b450 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 23:16:22.796 1 INFO cinder.rpc [req-f0aa228c-80f4-400e-bb95-123ca0a2b450 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 23:16:22.801 1 INFO cinder.rpc [req-f0aa228c-80f4-400e-bb95-123ca0a2b450 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 23:16:22.817 1 INFO cinder.rpc [req-f0aa228c-80f4-400e-bb95-123ca0a2b450 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 23:16:22.823 1 INFO cinder.rpc [req-f0aa228c-80f4-400e-bb95-123ca0a2b450 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 23:16:22.860 1 WARNING oslo_config.cfg [req-f0aa228c-80f4-400e-bb95-123ca0a2b450 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 23:16:22.862 1 WARNING oslo_config.cfg [req-f0aa228c-80f4-400e-bb95-123ca0a2b450 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:16:22.862 1 WARNING oslo_config.cfg [req-f0aa228c-80f4-400e-bb95-123ca0a2b450 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:16:22.863 1 WARNING oslo_config.cfg [req-f0aa228c-80f4-400e-bb95-123ca0a2b450 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:16:22.867 1 WARNING oslo_config.cfg [req-f0aa228c-80f4-400e-bb95-123ca0a2b450 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 23:16:22.868 1 WARNING oslo_config.cfg [req-f0aa228c-80f4-400e-bb95-123ca0a2b450 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 23:16:22.871 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 23:16:22.877 1 INFO cinder.manager [req-7687fe6a-2160-4a58-b274-a2d35f139704 - - - - -] Initiating service 5 cleanup
>2018-06-25 23:16:22.881 1 INFO cinder.manager [req-7687fe6a-2160-4a58-b274-a2d35f139704 - - - - -] Service 5 cleanup completed.
>2018-06-25 23:18:28.975 1 ERROR oslo.messaging._drivers.impl_rabbit [req-7687fe6a-2160-4a58-b274-a2d35f139704 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:18:28.977 1 ERROR oslo.messaging._drivers.impl_rabbit [req-7687fe6a-2160-4a58-b274-a2d35f139704 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:18:28.977 1 ERROR oslo_service.service [req-7687fe6a-2160-4a58-b274-a2d35f139704 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:18:28.977 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 23:18:28.977 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 23:18:28.977 1 ERROR oslo_service.service     service.start()
>2018-06-25 23:18:28.977 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 23:18:28.977 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 23:18:28.977 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 23:18:28.977 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 23:18:28.977 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 23:18:28.977 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 23:18:28.977 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 23:18:28.977 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 23:18:28.977 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 23:18:28.977 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 23:18:28.977 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 23:18:28.977 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 23:18:28.977 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 23:18:28.977 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 23:18:28.977 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 23:18:28.977 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 23:18:28.977 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 23:18:28.977 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 23:18:28.977 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 23:18:28.977 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 23:18:28.977 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 23:18:28.977 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 23:18:28.977 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:18:28.977 1 ERROR oslo_service.service 
>2018-06-25 23:18:28.980 1 CRITICAL cinder [req-f0aa228c-80f4-400e-bb95-123ca0a2b450 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 23:18:28.980 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 23:18:28.980 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 23:18:28.980 1 ERROR cinder     sys.exit(main())
>2018-06-25 23:18:28.980 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 23:18:28.980 1 ERROR cinder     service.wait()
>2018-06-25 23:18:28.980 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 23:18:28.980 1 ERROR cinder     _launcher.wait()
>2018-06-25 23:18:28.980 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 23:18:28.980 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 23:18:28.980 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 23:18:28.980 1 ERROR cinder     self.services.wait()
>2018-06-25 23:18:28.980 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 23:18:28.980 1 ERROR cinder     service.wait()
>2018-06-25 23:18:28.980 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 23:18:28.980 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 23:18:28.980 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 23:18:28.980 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 23:18:28.980 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 23:18:28.980 1 ERROR cinder     post_fn = fn()
>2018-06-25 23:18:28.980 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 23:18:28.980 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 23:18:28.980 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 23:18:28.980 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 23:18:28.980 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 23:18:28.980 1 ERROR cinder 
>2018-06-25 23:18:31.696 1 WARNING cinder.scheduler.host_manager [req-6e07ecb7-545e-47c5-9ea6-e003a3708438 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 23:18:31.703 1 INFO cinder.rpc [req-6e07ecb7-545e-47c5-9ea6-e003a3708438 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 23:18:31.709 1 INFO cinder.rpc [req-6e07ecb7-545e-47c5-9ea6-e003a3708438 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 23:18:31.722 1 INFO cinder.rpc [req-6e07ecb7-545e-47c5-9ea6-e003a3708438 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 23:18:31.730 1 INFO cinder.rpc [req-6e07ecb7-545e-47c5-9ea6-e003a3708438 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 23:18:31.755 1 WARNING oslo_config.cfg [req-6e07ecb7-545e-47c5-9ea6-e003a3708438 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 23:18:31.757 1 WARNING oslo_config.cfg [req-6e07ecb7-545e-47c5-9ea6-e003a3708438 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:18:31.758 1 WARNING oslo_config.cfg [req-6e07ecb7-545e-47c5-9ea6-e003a3708438 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:18:31.758 1 WARNING oslo_config.cfg [req-6e07ecb7-545e-47c5-9ea6-e003a3708438 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:18:31.763 1 WARNING oslo_config.cfg [req-6e07ecb7-545e-47c5-9ea6-e003a3708438 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 23:18:31.764 1 WARNING oslo_config.cfg [req-6e07ecb7-545e-47c5-9ea6-e003a3708438 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 23:18:31.767 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 23:18:31.774 1 INFO cinder.manager [req-81356792-7e8b-49ba-acd0-9cd7fabf7c28 - - - - -] Initiating service 5 cleanup
>2018-06-25 23:18:31.778 1 INFO cinder.manager [req-81356792-7e8b-49ba-acd0-9cd7fabf7c28 - - - - -] Service 5 cleanup completed.
>2018-06-25 23:20:36.270 1 ERROR oslo.messaging._drivers.impl_rabbit [req-81356792-7e8b-49ba-acd0-9cd7fabf7c28 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:20:36.272 1 ERROR oslo.messaging._drivers.impl_rabbit [req-81356792-7e8b-49ba-acd0-9cd7fabf7c28 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:20:36.273 1 ERROR oslo_service.service [req-81356792-7e8b-49ba-acd0-9cd7fabf7c28 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:20:36.273 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 23:20:36.273 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 23:20:36.273 1 ERROR oslo_service.service     service.start()
>2018-06-25 23:20:36.273 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 23:20:36.273 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 23:20:36.273 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 23:20:36.273 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 23:20:36.273 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 23:20:36.273 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 23:20:36.273 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 23:20:36.273 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 23:20:36.273 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 23:20:36.273 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 23:20:36.273 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 23:20:36.273 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 23:20:36.273 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 23:20:36.273 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 23:20:36.273 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 23:20:36.273 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 23:20:36.273 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 23:20:36.273 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 23:20:36.273 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 23:20:36.273 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 23:20:36.273 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 23:20:36.273 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 23:20:36.273 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:20:36.273 1 ERROR oslo_service.service 
>2018-06-25 23:20:36.276 1 CRITICAL cinder [req-6e07ecb7-545e-47c5-9ea6-e003a3708438 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 23:20:36.276 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 23:20:36.276 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 23:20:36.276 1 ERROR cinder     sys.exit(main())
>2018-06-25 23:20:36.276 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 23:20:36.276 1 ERROR cinder     service.wait()
>2018-06-25 23:20:36.276 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 23:20:36.276 1 ERROR cinder     _launcher.wait()
>2018-06-25 23:20:36.276 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 23:20:36.276 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 23:20:36.276 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 23:20:36.276 1 ERROR cinder     self.services.wait()
>2018-06-25 23:20:36.276 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 23:20:36.276 1 ERROR cinder     service.wait()
>2018-06-25 23:20:36.276 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 23:20:36.276 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 23:20:36.276 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 23:20:36.276 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 23:20:36.276 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 23:20:36.276 1 ERROR cinder     post_fn = fn()
>2018-06-25 23:20:36.276 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 23:20:36.276 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 23:20:36.276 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 23:20:36.276 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 23:20:36.276 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 23:20:36.276 1 ERROR cinder 
>2018-06-25 23:20:39.023 1 WARNING cinder.scheduler.host_manager [req-248f9b24-e58c-4d55-87d2-fc137a3e0cf9 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 23:20:39.030 1 INFO cinder.rpc [req-248f9b24-e58c-4d55-87d2-fc137a3e0cf9 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 23:20:39.037 1 INFO cinder.rpc [req-248f9b24-e58c-4d55-87d2-fc137a3e0cf9 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 23:20:39.050 1 INFO cinder.rpc [req-248f9b24-e58c-4d55-87d2-fc137a3e0cf9 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 23:20:39.056 1 INFO cinder.rpc [req-248f9b24-e58c-4d55-87d2-fc137a3e0cf9 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 23:20:39.081 1 WARNING oslo_config.cfg [req-248f9b24-e58c-4d55-87d2-fc137a3e0cf9 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 23:20:39.083 1 WARNING oslo_config.cfg [req-248f9b24-e58c-4d55-87d2-fc137a3e0cf9 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:20:39.084 1 WARNING oslo_config.cfg [req-248f9b24-e58c-4d55-87d2-fc137a3e0cf9 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:20:39.084 1 WARNING oslo_config.cfg [req-248f9b24-e58c-4d55-87d2-fc137a3e0cf9 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:20:39.089 1 WARNING oslo_config.cfg [req-248f9b24-e58c-4d55-87d2-fc137a3e0cf9 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 23:20:39.091 1 WARNING oslo_config.cfg [req-248f9b24-e58c-4d55-87d2-fc137a3e0cf9 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 23:20:39.093 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 23:20:39.101 1 INFO cinder.manager [req-3208d071-d234-401f-89f5-d63f47844c9a - - - - -] Initiating service 5 cleanup
>2018-06-25 23:20:39.106 1 INFO cinder.manager [req-3208d071-d234-401f-89f5-d63f47844c9a - - - - -] Service 5 cleanup completed.
>2018-06-25 23:22:43.636 1 ERROR oslo.messaging._drivers.impl_rabbit [req-3208d071-d234-401f-89f5-d63f47844c9a - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:22:43.637 1 ERROR oslo.messaging._drivers.impl_rabbit [req-3208d071-d234-401f-89f5-d63f47844c9a - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:22:43.638 1 ERROR oslo_service.service [req-3208d071-d234-401f-89f5-d63f47844c9a - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:22:43.638 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 23:22:43.638 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 23:22:43.638 1 ERROR oslo_service.service     service.start()
>2018-06-25 23:22:43.638 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 23:22:43.638 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 23:22:43.638 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 23:22:43.638 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 23:22:43.638 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 23:22:43.638 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 23:22:43.638 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 23:22:43.638 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 23:22:43.638 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 23:22:43.638 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 23:22:43.638 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 23:22:43.638 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 23:22:43.638 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 23:22:43.638 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 23:22:43.638 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 23:22:43.638 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 23:22:43.638 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 23:22:43.638 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 23:22:43.638 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 23:22:43.638 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 23:22:43.638 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 23:22:43.638 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 23:22:43.638 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:22:43.638 1 ERROR oslo_service.service 
>2018-06-25 23:22:43.641 1 CRITICAL cinder [req-248f9b24-e58c-4d55-87d2-fc137a3e0cf9 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 23:22:43.641 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 23:22:43.641 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 23:22:43.641 1 ERROR cinder     sys.exit(main())
>2018-06-25 23:22:43.641 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 23:22:43.641 1 ERROR cinder     service.wait()
>2018-06-25 23:22:43.641 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 23:22:43.641 1 ERROR cinder     _launcher.wait()
>2018-06-25 23:22:43.641 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 23:22:43.641 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 23:22:43.641 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 23:22:43.641 1 ERROR cinder     self.services.wait()
>2018-06-25 23:22:43.641 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 23:22:43.641 1 ERROR cinder     service.wait()
>2018-06-25 23:22:43.641 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 23:22:43.641 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 23:22:43.641 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 23:22:43.641 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 23:22:43.641 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 23:22:43.641 1 ERROR cinder     post_fn = fn()
>2018-06-25 23:22:43.641 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 23:22:43.641 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 23:22:43.641 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 23:22:43.641 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 23:22:43.641 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 23:22:43.641 1 ERROR cinder 
>2018-06-25 23:22:46.488 1 WARNING cinder.scheduler.host_manager [req-a999e3a2-01db-43d8-b23c-4c495c773004 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 23:22:46.494 1 INFO cinder.rpc [req-a999e3a2-01db-43d8-b23c-4c495c773004 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 23:22:46.500 1 INFO cinder.rpc [req-a999e3a2-01db-43d8-b23c-4c495c773004 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 23:22:46.513 1 INFO cinder.rpc [req-a999e3a2-01db-43d8-b23c-4c495c773004 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 23:22:46.520 1 INFO cinder.rpc [req-a999e3a2-01db-43d8-b23c-4c495c773004 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 23:22:46.544 1 WARNING oslo_config.cfg [req-a999e3a2-01db-43d8-b23c-4c495c773004 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 23:22:46.547 1 WARNING oslo_config.cfg [req-a999e3a2-01db-43d8-b23c-4c495c773004 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:22:46.547 1 WARNING oslo_config.cfg [req-a999e3a2-01db-43d8-b23c-4c495c773004 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:22:46.548 1 WARNING oslo_config.cfg [req-a999e3a2-01db-43d8-b23c-4c495c773004 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:22:46.553 1 WARNING oslo_config.cfg [req-a999e3a2-01db-43d8-b23c-4c495c773004 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 23:22:46.554 1 WARNING oslo_config.cfg [req-a999e3a2-01db-43d8-b23c-4c495c773004 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 23:22:46.557 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 23:22:46.564 1 INFO cinder.manager [req-c800dba8-4b52-4ed8-878a-e84e4370cc47 - - - - -] Initiating service 5 cleanup
>2018-06-25 23:22:46.569 1 INFO cinder.manager [req-c800dba8-4b52-4ed8-878a-e84e4370cc47 - - - - -] Service 5 cleanup completed.
>2018-06-25 23:24:52.735 1 ERROR oslo.messaging._drivers.impl_rabbit [req-c800dba8-4b52-4ed8-878a-e84e4370cc47 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:24:52.737 1 ERROR oslo.messaging._drivers.impl_rabbit [req-c800dba8-4b52-4ed8-878a-e84e4370cc47 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:24:52.737 1 ERROR oslo_service.service [req-c800dba8-4b52-4ed8-878a-e84e4370cc47 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:24:52.737 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 23:24:52.737 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 23:24:52.737 1 ERROR oslo_service.service     service.start()
>2018-06-25 23:24:52.737 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 23:24:52.737 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 23:24:52.737 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 23:24:52.737 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 23:24:52.737 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 23:24:52.737 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 23:24:52.737 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 23:24:52.737 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 23:24:52.737 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 23:24:52.737 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 23:24:52.737 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 23:24:52.737 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 23:24:52.737 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 23:24:52.737 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 23:24:52.737 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 23:24:52.737 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 23:24:52.737 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 23:24:52.737 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 23:24:52.737 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 23:24:52.737 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 23:24:52.737 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 23:24:52.737 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 23:24:52.737 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:24:52.737 1 ERROR oslo_service.service 
>2018-06-25 23:24:52.740 1 CRITICAL cinder [req-a999e3a2-01db-43d8-b23c-4c495c773004 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 23:24:52.740 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 23:24:52.740 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 23:24:52.740 1 ERROR cinder     sys.exit(main())
>2018-06-25 23:24:52.740 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 23:24:52.740 1 ERROR cinder     service.wait()
>2018-06-25 23:24:52.740 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 23:24:52.740 1 ERROR cinder     _launcher.wait()
>2018-06-25 23:24:52.740 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 23:24:52.740 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 23:24:52.740 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 23:24:52.740 1 ERROR cinder     self.services.wait()
>2018-06-25 23:24:52.740 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 23:24:52.740 1 ERROR cinder     service.wait()
>2018-06-25 23:24:52.740 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 23:24:52.740 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 23:24:52.740 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 23:24:52.740 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 23:24:52.740 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 23:24:52.740 1 ERROR cinder     post_fn = fn()
>2018-06-25 23:24:52.740 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 23:24:52.740 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 23:24:52.740 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 23:24:52.740 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 23:24:52.740 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 23:24:52.740 1 ERROR cinder 
>2018-06-25 23:24:55.442 1 WARNING cinder.scheduler.host_manager [req-0541a77f-dd52-4c52-aa59-a433c55fffe8 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 23:24:55.449 1 INFO cinder.rpc [req-0541a77f-dd52-4c52-aa59-a433c55fffe8 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 23:24:55.455 1 INFO cinder.rpc [req-0541a77f-dd52-4c52-aa59-a433c55fffe8 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 23:24:55.467 1 INFO cinder.rpc [req-0541a77f-dd52-4c52-aa59-a433c55fffe8 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 23:24:55.472 1 INFO cinder.rpc [req-0541a77f-dd52-4c52-aa59-a433c55fffe8 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 23:24:55.495 1 WARNING oslo_config.cfg [req-0541a77f-dd52-4c52-aa59-a433c55fffe8 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 23:24:55.497 1 WARNING oslo_config.cfg [req-0541a77f-dd52-4c52-aa59-a433c55fffe8 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:24:55.498 1 WARNING oslo_config.cfg [req-0541a77f-dd52-4c52-aa59-a433c55fffe8 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:24:55.498 1 WARNING oslo_config.cfg [req-0541a77f-dd52-4c52-aa59-a433c55fffe8 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:24:55.504 1 WARNING oslo_config.cfg [req-0541a77f-dd52-4c52-aa59-a433c55fffe8 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 23:24:55.505 1 WARNING oslo_config.cfg [req-0541a77f-dd52-4c52-aa59-a433c55fffe8 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 23:24:55.508 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 23:24:55.514 1 INFO cinder.manager [req-592d05e9-807e-43c9-b682-52966ab1c861 - - - - -] Initiating service 5 cleanup
>2018-06-25 23:24:55.519 1 INFO cinder.manager [req-592d05e9-807e-43c9-b682-52966ab1c861 - - - - -] Service 5 cleanup completed.
>2018-06-25 23:26:59.806 1 ERROR oslo.messaging._drivers.impl_rabbit [req-592d05e9-807e-43c9-b682-52966ab1c861 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:26:59.811 1 ERROR oslo.messaging._drivers.impl_rabbit [req-592d05e9-807e-43c9-b682-52966ab1c861 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:26:59.812 1 ERROR oslo_service.service [req-592d05e9-807e-43c9-b682-52966ab1c861 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:26:59.812 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 23:26:59.812 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 23:26:59.812 1 ERROR oslo_service.service     service.start()
>2018-06-25 23:26:59.812 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 23:26:59.812 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 23:26:59.812 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 23:26:59.812 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 23:26:59.812 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 23:26:59.812 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 23:26:59.812 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 23:26:59.812 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 23:26:59.812 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 23:26:59.812 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 23:26:59.812 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 23:26:59.812 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 23:26:59.812 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 23:26:59.812 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 23:26:59.812 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 23:26:59.812 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 23:26:59.812 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 23:26:59.812 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 23:26:59.812 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 23:26:59.812 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 23:26:59.812 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 23:26:59.812 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 23:26:59.812 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:26:59.812 1 ERROR oslo_service.service 
>2018-06-25 23:26:59.815 1 CRITICAL cinder [req-0541a77f-dd52-4c52-aa59-a433c55fffe8 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 23:26:59.815 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 23:26:59.815 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 23:26:59.815 1 ERROR cinder     sys.exit(main())
>2018-06-25 23:26:59.815 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 23:26:59.815 1 ERROR cinder     service.wait()
>2018-06-25 23:26:59.815 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 23:26:59.815 1 ERROR cinder     _launcher.wait()
>2018-06-25 23:26:59.815 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 23:26:59.815 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 23:26:59.815 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 23:26:59.815 1 ERROR cinder     self.services.wait()
>2018-06-25 23:26:59.815 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 23:26:59.815 1 ERROR cinder     service.wait()
>2018-06-25 23:26:59.815 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 23:26:59.815 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 23:26:59.815 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 23:26:59.815 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 23:26:59.815 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 23:26:59.815 1 ERROR cinder     post_fn = fn()
>2018-06-25 23:26:59.815 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 23:26:59.815 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 23:26:59.815 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 23:26:59.815 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 23:26:59.815 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 23:26:59.815 1 ERROR cinder 
>2018-06-25 23:27:02.492 1 WARNING cinder.scheduler.host_manager [req-894c9b93-2b2e-4841-9565-b3ffbf3b59a0 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 23:27:02.499 1 INFO cinder.rpc [req-894c9b93-2b2e-4841-9565-b3ffbf3b59a0 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 23:27:02.505 1 INFO cinder.rpc [req-894c9b93-2b2e-4841-9565-b3ffbf3b59a0 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 23:27:02.522 1 INFO cinder.rpc [req-894c9b93-2b2e-4841-9565-b3ffbf3b59a0 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 23:27:02.537 1 INFO cinder.rpc [req-894c9b93-2b2e-4841-9565-b3ffbf3b59a0 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 23:27:02.568 1 WARNING oslo_config.cfg [req-894c9b93-2b2e-4841-9565-b3ffbf3b59a0 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 23:27:02.571 1 WARNING oslo_config.cfg [req-894c9b93-2b2e-4841-9565-b3ffbf3b59a0 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:27:02.571 1 WARNING oslo_config.cfg [req-894c9b93-2b2e-4841-9565-b3ffbf3b59a0 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:27:02.572 1 WARNING oslo_config.cfg [req-894c9b93-2b2e-4841-9565-b3ffbf3b59a0 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:27:02.577 1 WARNING oslo_config.cfg [req-894c9b93-2b2e-4841-9565-b3ffbf3b59a0 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 23:27:02.578 1 WARNING oslo_config.cfg [req-894c9b93-2b2e-4841-9565-b3ffbf3b59a0 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 23:27:02.581 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 23:27:02.589 1 INFO cinder.manager [req-f6c68ab6-4008-4389-b2a6-6fde40974ccf - - - - -] Initiating service 5 cleanup
>2018-06-25 23:27:02.594 1 INFO cinder.manager [req-f6c68ab6-4008-4389-b2a6-6fde40974ccf - - - - -] Service 5 cleanup completed.
>2018-06-25 23:29:06.974 1 ERROR oslo.messaging._drivers.impl_rabbit [req-f6c68ab6-4008-4389-b2a6-6fde40974ccf - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:29:06.976 1 ERROR oslo.messaging._drivers.impl_rabbit [req-f6c68ab6-4008-4389-b2a6-6fde40974ccf - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:29:06.976 1 ERROR oslo_service.service [req-f6c68ab6-4008-4389-b2a6-6fde40974ccf - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:29:06.976 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 23:29:06.976 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 23:29:06.976 1 ERROR oslo_service.service     service.start()
>2018-06-25 23:29:06.976 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 23:29:06.976 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 23:29:06.976 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 23:29:06.976 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 23:29:06.976 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 23:29:06.976 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 23:29:06.976 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 23:29:06.976 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 23:29:06.976 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 23:29:06.976 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 23:29:06.976 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 23:29:06.976 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 23:29:06.976 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 23:29:06.976 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 23:29:06.976 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 23:29:06.976 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 23:29:06.976 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 23:29:06.976 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 23:29:06.976 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 23:29:06.976 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 23:29:06.976 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 23:29:06.976 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 23:29:06.976 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:29:06.976 1 ERROR oslo_service.service 
>2018-06-25 23:29:06.979 1 CRITICAL cinder [req-894c9b93-2b2e-4841-9565-b3ffbf3b59a0 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 23:29:06.979 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 23:29:06.979 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 23:29:06.979 1 ERROR cinder     sys.exit(main())
>2018-06-25 23:29:06.979 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 23:29:06.979 1 ERROR cinder     service.wait()
>2018-06-25 23:29:06.979 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 23:29:06.979 1 ERROR cinder     _launcher.wait()
>2018-06-25 23:29:06.979 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 23:29:06.979 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 23:29:06.979 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 23:29:06.979 1 ERROR cinder     self.services.wait()
>2018-06-25 23:29:06.979 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 23:29:06.979 1 ERROR cinder     service.wait()
>2018-06-25 23:29:06.979 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 23:29:06.979 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 23:29:06.979 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 23:29:06.979 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 23:29:06.979 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 23:29:06.979 1 ERROR cinder     post_fn = fn()
>2018-06-25 23:29:06.979 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 23:29:06.979 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 23:29:06.979 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 23:29:06.979 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 23:29:06.979 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 23:29:06.979 1 ERROR cinder 
>2018-06-25 23:29:09.700 1 WARNING cinder.scheduler.host_manager [req-7944ac4b-b7e5-459f-80c1-4659d29a49e8 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 23:29:09.706 1 INFO cinder.rpc [req-7944ac4b-b7e5-459f-80c1-4659d29a49e8 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 23:29:09.713 1 INFO cinder.rpc [req-7944ac4b-b7e5-459f-80c1-4659d29a49e8 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 23:29:09.724 1 INFO cinder.rpc [req-7944ac4b-b7e5-459f-80c1-4659d29a49e8 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 23:29:09.732 1 INFO cinder.rpc [req-7944ac4b-b7e5-459f-80c1-4659d29a49e8 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 23:29:09.754 1 WARNING oslo_config.cfg [req-7944ac4b-b7e5-459f-80c1-4659d29a49e8 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 23:29:09.756 1 WARNING oslo_config.cfg [req-7944ac4b-b7e5-459f-80c1-4659d29a49e8 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:29:09.757 1 WARNING oslo_config.cfg [req-7944ac4b-b7e5-459f-80c1-4659d29a49e8 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:29:09.758 1 WARNING oslo_config.cfg [req-7944ac4b-b7e5-459f-80c1-4659d29a49e8 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:29:09.763 1 WARNING oslo_config.cfg [req-7944ac4b-b7e5-459f-80c1-4659d29a49e8 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 23:29:09.764 1 WARNING oslo_config.cfg [req-7944ac4b-b7e5-459f-80c1-4659d29a49e8 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 23:29:09.767 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 23:29:09.773 1 INFO cinder.manager [req-69f9f9c6-cbb1-4b0f-9478-54fdb02de562 - - - - -] Initiating service 5 cleanup
>2018-06-25 23:29:09.778 1 INFO cinder.manager [req-69f9f9c6-cbb1-4b0f-9478-54fdb02de562 - - - - -] Service 5 cleanup completed.
>2018-06-25 23:31:14.156 1 ERROR oslo.messaging._drivers.impl_rabbit [req-69f9f9c6-cbb1-4b0f-9478-54fdb02de562 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:31:14.158 1 ERROR oslo.messaging._drivers.impl_rabbit [req-69f9f9c6-cbb1-4b0f-9478-54fdb02de562 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:31:14.158 1 ERROR oslo_service.service [req-69f9f9c6-cbb1-4b0f-9478-54fdb02de562 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:31:14.158 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 23:31:14.158 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 23:31:14.158 1 ERROR oslo_service.service     service.start()
>2018-06-25 23:31:14.158 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 23:31:14.158 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 23:31:14.158 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 23:31:14.158 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 23:31:14.158 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 23:31:14.158 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 23:31:14.158 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 23:31:14.158 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 23:31:14.158 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 23:31:14.158 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 23:31:14.158 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 23:31:14.158 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 23:31:14.158 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 23:31:14.158 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 23:31:14.158 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 23:31:14.158 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 23:31:14.158 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 23:31:14.158 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 23:31:14.158 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 23:31:14.158 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 23:31:14.158 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 23:31:14.158 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 23:31:14.158 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:31:14.158 1 ERROR oslo_service.service 
>2018-06-25 23:31:14.162 1 CRITICAL cinder [req-7944ac4b-b7e5-459f-80c1-4659d29a49e8 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 23:31:14.162 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 23:31:14.162 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 23:31:14.162 1 ERROR cinder     sys.exit(main())
>2018-06-25 23:31:14.162 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 23:31:14.162 1 ERROR cinder     service.wait()
>2018-06-25 23:31:14.162 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 23:31:14.162 1 ERROR cinder     _launcher.wait()
>2018-06-25 23:31:14.162 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 23:31:14.162 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 23:31:14.162 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 23:31:14.162 1 ERROR cinder     self.services.wait()
>2018-06-25 23:31:14.162 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 23:31:14.162 1 ERROR cinder     service.wait()
>2018-06-25 23:31:14.162 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 23:31:14.162 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 23:31:14.162 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 23:31:14.162 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 23:31:14.162 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 23:31:14.162 1 ERROR cinder     post_fn = fn()
>2018-06-25 23:31:14.162 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 23:31:14.162 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 23:31:14.162 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 23:31:14.162 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 23:31:14.162 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 23:31:14.162 1 ERROR cinder 
>2018-06-25 23:31:16.913 1 WARNING cinder.scheduler.host_manager [req-e2be607c-d367-4aca-93b2-c8650343d85c - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 23:31:16.924 1 INFO cinder.rpc [req-e2be607c-d367-4aca-93b2-c8650343d85c - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 23:31:16.931 1 INFO cinder.rpc [req-e2be607c-d367-4aca-93b2-c8650343d85c - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 23:31:16.945 1 INFO cinder.rpc [req-e2be607c-d367-4aca-93b2-c8650343d85c - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 23:31:16.952 1 INFO cinder.rpc [req-e2be607c-d367-4aca-93b2-c8650343d85c - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 23:31:16.981 1 WARNING oslo_config.cfg [req-e2be607c-d367-4aca-93b2-c8650343d85c - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 23:31:16.984 1 WARNING oslo_config.cfg [req-e2be607c-d367-4aca-93b2-c8650343d85c - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:31:16.985 1 WARNING oslo_config.cfg [req-e2be607c-d367-4aca-93b2-c8650343d85c - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:31:16.985 1 WARNING oslo_config.cfg [req-e2be607c-d367-4aca-93b2-c8650343d85c - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:31:16.991 1 WARNING oslo_config.cfg [req-e2be607c-d367-4aca-93b2-c8650343d85c - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 23:31:16.992 1 WARNING oslo_config.cfg [req-e2be607c-d367-4aca-93b2-c8650343d85c - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 23:31:16.995 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 23:31:17.002 1 INFO cinder.manager [req-afac373c-fa02-4dee-b217-97d6dd015220 - - - - -] Initiating service 5 cleanup
>2018-06-25 23:31:17.010 1 INFO cinder.manager [req-afac373c-fa02-4dee-b217-97d6dd015220 - - - - -] Service 5 cleanup completed.
>2018-06-25 23:33:21.510 1 ERROR oslo.messaging._drivers.impl_rabbit [req-afac373c-fa02-4dee-b217-97d6dd015220 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:33:21.512 1 ERROR oslo.messaging._drivers.impl_rabbit [req-afac373c-fa02-4dee-b217-97d6dd015220 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:33:21.512 1 ERROR oslo_service.service [req-afac373c-fa02-4dee-b217-97d6dd015220 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:33:21.512 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 23:33:21.512 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 23:33:21.512 1 ERROR oslo_service.service     service.start()
>2018-06-25 23:33:21.512 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 23:33:21.512 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 23:33:21.512 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 23:33:21.512 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 23:33:21.512 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 23:33:21.512 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 23:33:21.512 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 23:33:21.512 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 23:33:21.512 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 23:33:21.512 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 23:33:21.512 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 23:33:21.512 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 23:33:21.512 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 23:33:21.512 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 23:33:21.512 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 23:33:21.512 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 23:33:21.512 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 23:33:21.512 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 23:33:21.512 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 23:33:21.512 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 23:33:21.512 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 23:33:21.512 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 23:33:21.512 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:33:21.512 1 ERROR oslo_service.service 
>2018-06-25 23:33:21.515 1 CRITICAL cinder [req-e2be607c-d367-4aca-93b2-c8650343d85c - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 23:33:21.515 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 23:33:21.515 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 23:33:21.515 1 ERROR cinder     sys.exit(main())
>2018-06-25 23:33:21.515 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 23:33:21.515 1 ERROR cinder     service.wait()
>2018-06-25 23:33:21.515 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 23:33:21.515 1 ERROR cinder     _launcher.wait()
>2018-06-25 23:33:21.515 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 23:33:21.515 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 23:33:21.515 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 23:33:21.515 1 ERROR cinder     self.services.wait()
>2018-06-25 23:33:21.515 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 23:33:21.515 1 ERROR cinder     service.wait()
>2018-06-25 23:33:21.515 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 23:33:21.515 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 23:33:21.515 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 23:33:21.515 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 23:33:21.515 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 23:33:21.515 1 ERROR cinder     post_fn = fn()
>2018-06-25 23:33:21.515 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 23:33:21.515 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 23:33:21.515 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 23:33:21.515 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 23:33:21.515 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 23:33:21.515 1 ERROR cinder 
>2018-06-25 23:33:24.108 1 WARNING cinder.scheduler.host_manager [req-4e696917-624f-4ee7-aef3-a6cedbc82b83 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 23:33:24.114 1 INFO cinder.rpc [req-4e696917-624f-4ee7-aef3-a6cedbc82b83 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 23:33:24.119 1 INFO cinder.rpc [req-4e696917-624f-4ee7-aef3-a6cedbc82b83 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 23:33:24.129 1 INFO cinder.rpc [req-4e696917-624f-4ee7-aef3-a6cedbc82b83 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 23:33:24.134 1 INFO cinder.rpc [req-4e696917-624f-4ee7-aef3-a6cedbc82b83 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 23:33:24.156 1 WARNING oslo_config.cfg [req-4e696917-624f-4ee7-aef3-a6cedbc82b83 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 23:33:24.158 1 WARNING oslo_config.cfg [req-4e696917-624f-4ee7-aef3-a6cedbc82b83 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:33:24.159 1 WARNING oslo_config.cfg [req-4e696917-624f-4ee7-aef3-a6cedbc82b83 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:33:24.159 1 WARNING oslo_config.cfg [req-4e696917-624f-4ee7-aef3-a6cedbc82b83 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:33:24.164 1 WARNING oslo_config.cfg [req-4e696917-624f-4ee7-aef3-a6cedbc82b83 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 23:33:24.165 1 WARNING oslo_config.cfg [req-4e696917-624f-4ee7-aef3-a6cedbc82b83 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 23:33:24.167 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 23:33:24.174 1 INFO cinder.manager [req-82d3a737-e5fc-4c95-8bed-52815078c812 - - - - -] Initiating service 5 cleanup
>2018-06-25 23:33:24.179 1 INFO cinder.manager [req-82d3a737-e5fc-4c95-8bed-52815078c812 - - - - -] Service 5 cleanup completed.
>2018-06-25 23:35:28.563 1 ERROR oslo.messaging._drivers.impl_rabbit [req-82d3a737-e5fc-4c95-8bed-52815078c812 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:35:28.566 1 ERROR oslo.messaging._drivers.impl_rabbit [req-82d3a737-e5fc-4c95-8bed-52815078c812 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:35:28.566 1 ERROR oslo_service.service [req-82d3a737-e5fc-4c95-8bed-52815078c812 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:35:28.566 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 23:35:28.566 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 23:35:28.566 1 ERROR oslo_service.service     service.start()
>2018-06-25 23:35:28.566 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 23:35:28.566 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 23:35:28.566 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 23:35:28.566 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 23:35:28.566 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 23:35:28.566 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 23:35:28.566 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 23:35:28.566 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 23:35:28.566 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 23:35:28.566 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 23:35:28.566 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 23:35:28.566 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 23:35:28.566 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 23:35:28.566 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 23:35:28.566 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 23:35:28.566 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 23:35:28.566 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 23:35:28.566 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 23:35:28.566 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 23:35:28.566 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 23:35:28.566 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 23:35:28.566 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 23:35:28.566 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:35:28.566 1 ERROR oslo_service.service 
>2018-06-25 23:35:28.569 1 CRITICAL cinder [req-4e696917-624f-4ee7-aef3-a6cedbc82b83 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 23:35:28.569 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 23:35:28.569 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 23:35:28.569 1 ERROR cinder     sys.exit(main())
>2018-06-25 23:35:28.569 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 23:35:28.569 1 ERROR cinder     service.wait()
>2018-06-25 23:35:28.569 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 23:35:28.569 1 ERROR cinder     _launcher.wait()
>2018-06-25 23:35:28.569 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 23:35:28.569 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 23:35:28.569 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 23:35:28.569 1 ERROR cinder     self.services.wait()
>2018-06-25 23:35:28.569 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 23:35:28.569 1 ERROR cinder     service.wait()
>2018-06-25 23:35:28.569 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 23:35:28.569 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 23:35:28.569 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 23:35:28.569 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 23:35:28.569 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 23:35:28.569 1 ERROR cinder     post_fn = fn()
>2018-06-25 23:35:28.569 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 23:35:28.569 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 23:35:28.569 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 23:35:28.569 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 23:35:28.569 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 23:35:28.569 1 ERROR cinder 
>2018-06-25 23:35:31.221 1 WARNING cinder.scheduler.host_manager [req-9631cf1e-7d5c-4515-b56e-baee7be1f53a - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 23:35:31.227 1 INFO cinder.rpc [req-9631cf1e-7d5c-4515-b56e-baee7be1f53a - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 23:35:31.233 1 INFO cinder.rpc [req-9631cf1e-7d5c-4515-b56e-baee7be1f53a - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 23:35:31.246 1 INFO cinder.rpc [req-9631cf1e-7d5c-4515-b56e-baee7be1f53a - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 23:35:31.254 1 INFO cinder.rpc [req-9631cf1e-7d5c-4515-b56e-baee7be1f53a - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 23:35:31.280 1 WARNING oslo_config.cfg [req-9631cf1e-7d5c-4515-b56e-baee7be1f53a - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 23:35:31.282 1 WARNING oslo_config.cfg [req-9631cf1e-7d5c-4515-b56e-baee7be1f53a - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:35:31.283 1 WARNING oslo_config.cfg [req-9631cf1e-7d5c-4515-b56e-baee7be1f53a - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:35:31.284 1 WARNING oslo_config.cfg [req-9631cf1e-7d5c-4515-b56e-baee7be1f53a - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:35:31.289 1 WARNING oslo_config.cfg [req-9631cf1e-7d5c-4515-b56e-baee7be1f53a - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 23:35:31.290 1 WARNING oslo_config.cfg [req-9631cf1e-7d5c-4515-b56e-baee7be1f53a - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 23:35:31.292 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 23:35:31.299 1 INFO cinder.manager [req-fad5ebb7-d864-4b7f-a214-b17067044f85 - - - - -] Initiating service 5 cleanup
>2018-06-25 23:35:31.304 1 INFO cinder.manager [req-fad5ebb7-d864-4b7f-a214-b17067044f85 - - - - -] Service 5 cleanup completed.
>2018-06-25 23:37:43.410 1 ERROR oslo.messaging._drivers.impl_rabbit [req-fad5ebb7-d864-4b7f-a214-b17067044f85 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:37:43.412 1 ERROR oslo.messaging._drivers.impl_rabbit [req-fad5ebb7-d864-4b7f-a214-b17067044f85 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:37:43.413 1 ERROR oslo_service.service [req-fad5ebb7-d864-4b7f-a214-b17067044f85 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:37:43.413 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 23:37:43.413 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 23:37:43.413 1 ERROR oslo_service.service     service.start()
>2018-06-25 23:37:43.413 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 23:37:43.413 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 23:37:43.413 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 23:37:43.413 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 23:37:43.413 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 23:37:43.413 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 23:37:43.413 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 23:37:43.413 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 23:37:43.413 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 23:37:43.413 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 23:37:43.413 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 23:37:43.413 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 23:37:43.413 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 23:37:43.413 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 23:37:43.413 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 23:37:43.413 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 23:37:43.413 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 23:37:43.413 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 23:37:43.413 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 23:37:43.413 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 23:37:43.413 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 23:37:43.413 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 23:37:43.413 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:37:43.413 1 ERROR oslo_service.service 
>2018-06-25 23:37:43.416 1 CRITICAL cinder [req-9631cf1e-7d5c-4515-b56e-baee7be1f53a - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 23:37:43.416 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 23:37:43.416 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 23:37:43.416 1 ERROR cinder     sys.exit(main())
>2018-06-25 23:37:43.416 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 23:37:43.416 1 ERROR cinder     service.wait()
>2018-06-25 23:37:43.416 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 23:37:43.416 1 ERROR cinder     _launcher.wait()
>2018-06-25 23:37:43.416 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 23:37:43.416 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 23:37:43.416 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 23:37:43.416 1 ERROR cinder     self.services.wait()
>2018-06-25 23:37:43.416 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 23:37:43.416 1 ERROR cinder     service.wait()
>2018-06-25 23:37:43.416 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 23:37:43.416 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 23:37:43.416 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 23:37:43.416 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 23:37:43.416 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 23:37:43.416 1 ERROR cinder     post_fn = fn()
>2018-06-25 23:37:43.416 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 23:37:43.416 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 23:37:43.416 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 23:37:43.416 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 23:37:43.416 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 23:37:43.416 1 ERROR cinder 
>2018-06-25 23:37:46.209 1 WARNING cinder.scheduler.host_manager [req-d1a23c92-964c-4336-ad0c-eaa968491307 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 23:37:46.217 1 INFO cinder.rpc [req-d1a23c92-964c-4336-ad0c-eaa968491307 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 23:37:46.223 1 INFO cinder.rpc [req-d1a23c92-964c-4336-ad0c-eaa968491307 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 23:37:46.238 1 INFO cinder.rpc [req-d1a23c92-964c-4336-ad0c-eaa968491307 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 23:37:46.244 1 INFO cinder.rpc [req-d1a23c92-964c-4336-ad0c-eaa968491307 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 23:37:46.276 1 WARNING oslo_config.cfg [req-d1a23c92-964c-4336-ad0c-eaa968491307 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 23:37:46.279 1 WARNING oslo_config.cfg [req-d1a23c92-964c-4336-ad0c-eaa968491307 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:37:46.279 1 WARNING oslo_config.cfg [req-d1a23c92-964c-4336-ad0c-eaa968491307 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:37:46.280 1 WARNING oslo_config.cfg [req-d1a23c92-964c-4336-ad0c-eaa968491307 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:37:46.288 1 WARNING oslo_config.cfg [req-d1a23c92-964c-4336-ad0c-eaa968491307 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 23:37:46.290 1 WARNING oslo_config.cfg [req-d1a23c92-964c-4336-ad0c-eaa968491307 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 23:37:46.292 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 23:37:46.302 1 INFO cinder.manager [req-145a6997-0360-4f77-93c0-cb4b740e5de9 - - - - -] Initiating service 5 cleanup
>2018-06-25 23:37:46.307 1 INFO cinder.manager [req-145a6997-0360-4f77-93c0-cb4b740e5de9 - - - - -] Service 5 cleanup completed.
>2018-06-25 23:39:58.672 1 ERROR oslo.messaging._drivers.impl_rabbit [req-145a6997-0360-4f77-93c0-cb4b740e5de9 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:39:58.674 1 ERROR oslo.messaging._drivers.impl_rabbit [req-145a6997-0360-4f77-93c0-cb4b740e5de9 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:39:58.674 1 ERROR oslo_service.service [req-145a6997-0360-4f77-93c0-cb4b740e5de9 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:39:58.674 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 23:39:58.674 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 23:39:58.674 1 ERROR oslo_service.service     service.start()
>2018-06-25 23:39:58.674 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 23:39:58.674 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 23:39:58.674 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 23:39:58.674 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 23:39:58.674 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 23:39:58.674 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 23:39:58.674 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 23:39:58.674 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 23:39:58.674 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 23:39:58.674 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 23:39:58.674 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 23:39:58.674 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 23:39:58.674 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 23:39:58.674 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 23:39:58.674 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 23:39:58.674 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 23:39:58.674 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 23:39:58.674 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 23:39:58.674 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 23:39:58.674 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 23:39:58.674 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 23:39:58.674 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 23:39:58.674 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:39:58.674 1 ERROR oslo_service.service 
>2018-06-25 23:39:58.678 1 CRITICAL cinder [req-d1a23c92-964c-4336-ad0c-eaa968491307 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 23:39:58.678 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 23:39:58.678 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 23:39:58.678 1 ERROR cinder     sys.exit(main())
>2018-06-25 23:39:58.678 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 23:39:58.678 1 ERROR cinder     service.wait()
>2018-06-25 23:39:58.678 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 23:39:58.678 1 ERROR cinder     _launcher.wait()
>2018-06-25 23:39:58.678 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 23:39:58.678 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 23:39:58.678 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 23:39:58.678 1 ERROR cinder     self.services.wait()
>2018-06-25 23:39:58.678 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 23:39:58.678 1 ERROR cinder     service.wait()
>2018-06-25 23:39:58.678 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 23:39:58.678 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 23:39:58.678 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 23:39:58.678 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 23:39:58.678 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 23:39:58.678 1 ERROR cinder     post_fn = fn()
>2018-06-25 23:39:58.678 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 23:39:58.678 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 23:39:58.678 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 23:39:58.678 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 23:39:58.678 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 23:39:58.678 1 ERROR cinder 
>2018-06-25 23:40:01.544 1 WARNING cinder.scheduler.host_manager [req-55705658-9ef3-43de-b6ed-5673feab394b - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 23:40:01.555 1 INFO cinder.rpc [req-55705658-9ef3-43de-b6ed-5673feab394b - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 23:40:01.568 1 INFO cinder.rpc [req-55705658-9ef3-43de-b6ed-5673feab394b - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 23:40:01.590 1 INFO cinder.rpc [req-55705658-9ef3-43de-b6ed-5673feab394b - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 23:40:01.600 1 INFO cinder.rpc [req-55705658-9ef3-43de-b6ed-5673feab394b - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 23:40:01.642 1 WARNING oslo_config.cfg [req-55705658-9ef3-43de-b6ed-5673feab394b - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 23:40:01.644 1 WARNING oslo_config.cfg [req-55705658-9ef3-43de-b6ed-5673feab394b - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:40:01.645 1 WARNING oslo_config.cfg [req-55705658-9ef3-43de-b6ed-5673feab394b - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:40:01.645 1 WARNING oslo_config.cfg [req-55705658-9ef3-43de-b6ed-5673feab394b - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:40:01.651 1 WARNING oslo_config.cfg [req-55705658-9ef3-43de-b6ed-5673feab394b - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 23:40:01.652 1 WARNING oslo_config.cfg [req-55705658-9ef3-43de-b6ed-5673feab394b - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 23:40:01.655 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 23:40:01.664 1 INFO cinder.manager [req-904b1912-7af3-49d1-8e9b-10fb28fb301a - - - - -] Initiating service 5 cleanup
>2018-06-25 23:40:01.670 1 INFO cinder.manager [req-904b1912-7af3-49d1-8e9b-10fb28fb301a - - - - -] Service 5 cleanup completed.
>2018-06-25 23:42:07.737 1 ERROR oslo.messaging._drivers.impl_rabbit [req-904b1912-7af3-49d1-8e9b-10fb28fb301a - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:42:07.740 1 ERROR oslo.messaging._drivers.impl_rabbit [req-904b1912-7af3-49d1-8e9b-10fb28fb301a - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:42:07.740 1 ERROR oslo_service.service [req-904b1912-7af3-49d1-8e9b-10fb28fb301a - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:42:07.740 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 23:42:07.740 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 23:42:07.740 1 ERROR oslo_service.service     service.start()
>2018-06-25 23:42:07.740 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 23:42:07.740 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 23:42:07.740 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 23:42:07.740 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 23:42:07.740 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 23:42:07.740 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 23:42:07.740 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 23:42:07.740 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 23:42:07.740 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 23:42:07.740 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 23:42:07.740 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 23:42:07.740 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 23:42:07.740 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 23:42:07.740 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 23:42:07.740 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 23:42:07.740 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 23:42:07.740 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 23:42:07.740 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 23:42:07.740 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 23:42:07.740 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 23:42:07.740 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 23:42:07.740 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 23:42:07.740 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:42:07.740 1 ERROR oslo_service.service 
>2018-06-25 23:42:07.743 1 CRITICAL cinder [req-55705658-9ef3-43de-b6ed-5673feab394b - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 23:42:07.743 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 23:42:07.743 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 23:42:07.743 1 ERROR cinder     sys.exit(main())
>2018-06-25 23:42:07.743 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 23:42:07.743 1 ERROR cinder     service.wait()
>2018-06-25 23:42:07.743 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 23:42:07.743 1 ERROR cinder     _launcher.wait()
>2018-06-25 23:42:07.743 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 23:42:07.743 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 23:42:07.743 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 23:42:07.743 1 ERROR cinder     self.services.wait()
>2018-06-25 23:42:07.743 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 23:42:07.743 1 ERROR cinder     service.wait()
>2018-06-25 23:42:07.743 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 23:42:07.743 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 23:42:07.743 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 23:42:07.743 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 23:42:07.743 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 23:42:07.743 1 ERROR cinder     post_fn = fn()
>2018-06-25 23:42:07.743 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 23:42:07.743 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 23:42:07.743 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 23:42:07.743 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 23:42:07.743 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 23:42:07.743 1 ERROR cinder 
>2018-06-25 23:42:10.370 1 WARNING cinder.scheduler.host_manager [req-acc9cf7e-1aab-405c-aa04-26d16fe208ed - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 23:42:10.377 1 INFO cinder.rpc [req-acc9cf7e-1aab-405c-aa04-26d16fe208ed - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 23:42:10.382 1 INFO cinder.rpc [req-acc9cf7e-1aab-405c-aa04-26d16fe208ed - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 23:42:10.394 1 INFO cinder.rpc [req-acc9cf7e-1aab-405c-aa04-26d16fe208ed - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 23:42:10.400 1 INFO cinder.rpc [req-acc9cf7e-1aab-405c-aa04-26d16fe208ed - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 23:42:10.422 1 WARNING oslo_config.cfg [req-acc9cf7e-1aab-405c-aa04-26d16fe208ed - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 23:42:10.424 1 WARNING oslo_config.cfg [req-acc9cf7e-1aab-405c-aa04-26d16fe208ed - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:42:10.425 1 WARNING oslo_config.cfg [req-acc9cf7e-1aab-405c-aa04-26d16fe208ed - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:42:10.425 1 WARNING oslo_config.cfg [req-acc9cf7e-1aab-405c-aa04-26d16fe208ed - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:42:10.430 1 WARNING oslo_config.cfg [req-acc9cf7e-1aab-405c-aa04-26d16fe208ed - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 23:42:10.431 1 WARNING oslo_config.cfg [req-acc9cf7e-1aab-405c-aa04-26d16fe208ed - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 23:42:10.433 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 23:42:10.440 1 INFO cinder.manager [req-cc27071d-51f8-4e0b-9b1d-0c12fd44efb4 - - - - -] Initiating service 5 cleanup
>2018-06-25 23:42:10.445 1 INFO cinder.manager [req-cc27071d-51f8-4e0b-9b1d-0c12fd44efb4 - - - - -] Service 5 cleanup completed.
>2018-06-25 23:44:14.989 1 ERROR oslo.messaging._drivers.impl_rabbit [req-cc27071d-51f8-4e0b-9b1d-0c12fd44efb4 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:44:14.991 1 ERROR oslo.messaging._drivers.impl_rabbit [req-cc27071d-51f8-4e0b-9b1d-0c12fd44efb4 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:44:14.991 1 ERROR oslo_service.service [req-cc27071d-51f8-4e0b-9b1d-0c12fd44efb4 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:44:14.991 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 23:44:14.991 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 23:44:14.991 1 ERROR oslo_service.service     service.start()
>2018-06-25 23:44:14.991 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 23:44:14.991 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 23:44:14.991 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 23:44:14.991 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 23:44:14.991 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 23:44:14.991 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 23:44:14.991 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 23:44:14.991 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 23:44:14.991 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 23:44:14.991 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 23:44:14.991 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 23:44:14.991 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 23:44:14.991 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 23:44:14.991 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 23:44:14.991 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 23:44:14.991 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 23:44:14.991 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 23:44:14.991 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 23:44:14.991 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 23:44:14.991 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 23:44:14.991 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 23:44:14.991 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 23:44:14.991 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:44:14.991 1 ERROR oslo_service.service 
>2018-06-25 23:44:14.994 1 CRITICAL cinder [req-acc9cf7e-1aab-405c-aa04-26d16fe208ed - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 23:44:14.994 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 23:44:14.994 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 23:44:14.994 1 ERROR cinder     sys.exit(main())
>2018-06-25 23:44:14.994 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 23:44:14.994 1 ERROR cinder     service.wait()
>2018-06-25 23:44:14.994 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 23:44:14.994 1 ERROR cinder     _launcher.wait()
>2018-06-25 23:44:14.994 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 23:44:14.994 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 23:44:14.994 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 23:44:14.994 1 ERROR cinder     self.services.wait()
>2018-06-25 23:44:14.994 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 23:44:14.994 1 ERROR cinder     service.wait()
>2018-06-25 23:44:14.994 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 23:44:14.994 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 23:44:14.994 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 23:44:14.994 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 23:44:14.994 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 23:44:14.994 1 ERROR cinder     post_fn = fn()
>2018-06-25 23:44:14.994 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 23:44:14.994 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 23:44:14.994 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 23:44:14.994 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 23:44:14.994 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 23:44:14.994 1 ERROR cinder 
>2018-06-25 23:44:17.632 1 WARNING cinder.scheduler.host_manager [req-c2a35823-947c-41d6-b3cf-f4c99eee0da4 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 23:44:17.638 1 INFO cinder.rpc [req-c2a35823-947c-41d6-b3cf-f4c99eee0da4 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 23:44:17.643 1 INFO cinder.rpc [req-c2a35823-947c-41d6-b3cf-f4c99eee0da4 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 23:44:17.655 1 INFO cinder.rpc [req-c2a35823-947c-41d6-b3cf-f4c99eee0da4 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 23:44:17.661 1 INFO cinder.rpc [req-c2a35823-947c-41d6-b3cf-f4c99eee0da4 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 23:44:17.685 1 WARNING oslo_config.cfg [req-c2a35823-947c-41d6-b3cf-f4c99eee0da4 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 23:44:17.688 1 WARNING oslo_config.cfg [req-c2a35823-947c-41d6-b3cf-f4c99eee0da4 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:44:17.689 1 WARNING oslo_config.cfg [req-c2a35823-947c-41d6-b3cf-f4c99eee0da4 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:44:17.689 1 WARNING oslo_config.cfg [req-c2a35823-947c-41d6-b3cf-f4c99eee0da4 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:44:17.695 1 WARNING oslo_config.cfg [req-c2a35823-947c-41d6-b3cf-f4c99eee0da4 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 23:44:17.696 1 WARNING oslo_config.cfg [req-c2a35823-947c-41d6-b3cf-f4c99eee0da4 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 23:44:17.699 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 23:44:17.705 1 INFO cinder.manager [req-5e31fadf-b807-4756-85d4-8b75a657e531 - - - - -] Initiating service 5 cleanup
>2018-06-25 23:44:17.711 1 INFO cinder.manager [req-5e31fadf-b807-4756-85d4-8b75a657e531 - - - - -] Service 5 cleanup completed.
>2018-06-25 23:46:29.700 1 ERROR oslo.messaging._drivers.impl_rabbit [req-5e31fadf-b807-4756-85d4-8b75a657e531 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:46:29.702 1 ERROR oslo.messaging._drivers.impl_rabbit [req-5e31fadf-b807-4756-85d4-8b75a657e531 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:46:29.702 1 ERROR oslo_service.service [req-5e31fadf-b807-4756-85d4-8b75a657e531 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:46:29.702 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 23:46:29.702 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 23:46:29.702 1 ERROR oslo_service.service     service.start()
>2018-06-25 23:46:29.702 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 23:46:29.702 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 23:46:29.702 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 23:46:29.702 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 23:46:29.702 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 23:46:29.702 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 23:46:29.702 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 23:46:29.702 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 23:46:29.702 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 23:46:29.702 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 23:46:29.702 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 23:46:29.702 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 23:46:29.702 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 23:46:29.702 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 23:46:29.702 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 23:46:29.702 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 23:46:29.702 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 23:46:29.702 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 23:46:29.702 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 23:46:29.702 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 23:46:29.702 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 23:46:29.702 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 23:46:29.702 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:46:29.702 1 ERROR oslo_service.service 
>2018-06-25 23:46:29.705 1 CRITICAL cinder [req-c2a35823-947c-41d6-b3cf-f4c99eee0da4 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 23:46:29.705 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 23:46:29.705 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 23:46:29.705 1 ERROR cinder     sys.exit(main())
>2018-06-25 23:46:29.705 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 23:46:29.705 1 ERROR cinder     service.wait()
>2018-06-25 23:46:29.705 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 23:46:29.705 1 ERROR cinder     _launcher.wait()
>2018-06-25 23:46:29.705 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 23:46:29.705 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 23:46:29.705 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 23:46:29.705 1 ERROR cinder     self.services.wait()
>2018-06-25 23:46:29.705 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 23:46:29.705 1 ERROR cinder     service.wait()
>2018-06-25 23:46:29.705 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 23:46:29.705 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 23:46:29.705 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 23:46:29.705 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 23:46:29.705 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 23:46:29.705 1 ERROR cinder     post_fn = fn()
>2018-06-25 23:46:29.705 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 23:46:29.705 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 23:46:29.705 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 23:46:29.705 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 23:46:29.705 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 23:46:29.705 1 ERROR cinder 
>2018-06-25 23:46:32.355 1 WARNING cinder.scheduler.host_manager [req-e42ede7c-63fa-4d7a-bcb0-eea3974f91a8 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 23:46:32.362 1 INFO cinder.rpc [req-e42ede7c-63fa-4d7a-bcb0-eea3974f91a8 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 23:46:32.368 1 INFO cinder.rpc [req-e42ede7c-63fa-4d7a-bcb0-eea3974f91a8 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 23:46:32.379 1 INFO cinder.rpc [req-e42ede7c-63fa-4d7a-bcb0-eea3974f91a8 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 23:46:32.385 1 INFO cinder.rpc [req-e42ede7c-63fa-4d7a-bcb0-eea3974f91a8 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 23:46:32.408 1 WARNING oslo_config.cfg [req-e42ede7c-63fa-4d7a-bcb0-eea3974f91a8 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 23:46:32.410 1 WARNING oslo_config.cfg [req-e42ede7c-63fa-4d7a-bcb0-eea3974f91a8 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:46:32.410 1 WARNING oslo_config.cfg [req-e42ede7c-63fa-4d7a-bcb0-eea3974f91a8 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:46:32.411 1 WARNING oslo_config.cfg [req-e42ede7c-63fa-4d7a-bcb0-eea3974f91a8 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:46:32.416 1 WARNING oslo_config.cfg [req-e42ede7c-63fa-4d7a-bcb0-eea3974f91a8 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 23:46:32.417 1 WARNING oslo_config.cfg [req-e42ede7c-63fa-4d7a-bcb0-eea3974f91a8 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 23:46:32.420 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 23:46:32.425 1 INFO cinder.manager [req-64ec5ffd-2eff-4836-a2c5-323c9b3d62fa - - - - -] Initiating service 5 cleanup
>2018-06-25 23:46:32.430 1 INFO cinder.manager [req-64ec5ffd-2eff-4836-a2c5-323c9b3d62fa - - - - -] Service 5 cleanup completed.
>2018-06-25 23:48:38.479 1 ERROR oslo.messaging._drivers.impl_rabbit [req-64ec5ffd-2eff-4836-a2c5-323c9b3d62fa - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:48:38.482 1 ERROR oslo.messaging._drivers.impl_rabbit [req-64ec5ffd-2eff-4836-a2c5-323c9b3d62fa - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:48:38.483 1 ERROR oslo_service.service [req-64ec5ffd-2eff-4836-a2c5-323c9b3d62fa - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:48:38.483 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 23:48:38.483 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 23:48:38.483 1 ERROR oslo_service.service     service.start()
>2018-06-25 23:48:38.483 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 23:48:38.483 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 23:48:38.483 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 23:48:38.483 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 23:48:38.483 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 23:48:38.483 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 23:48:38.483 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 23:48:38.483 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 23:48:38.483 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 23:48:38.483 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 23:48:38.483 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 23:48:38.483 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 23:48:38.483 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 23:48:38.483 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 23:48:38.483 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 23:48:38.483 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 23:48:38.483 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 23:48:38.483 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 23:48:38.483 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 23:48:38.483 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 23:48:38.483 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 23:48:38.483 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 23:48:38.483 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:48:38.483 1 ERROR oslo_service.service 
>2018-06-25 23:48:38.488 1 CRITICAL cinder [req-e42ede7c-63fa-4d7a-bcb0-eea3974f91a8 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 23:48:38.488 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 23:48:38.488 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 23:48:38.488 1 ERROR cinder     sys.exit(main())
>2018-06-25 23:48:38.488 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 23:48:38.488 1 ERROR cinder     service.wait()
>2018-06-25 23:48:38.488 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 23:48:38.488 1 ERROR cinder     _launcher.wait()
>2018-06-25 23:48:38.488 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 23:48:38.488 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 23:48:38.488 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 23:48:38.488 1 ERROR cinder     self.services.wait()
>2018-06-25 23:48:38.488 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 23:48:38.488 1 ERROR cinder     service.wait()
>2018-06-25 23:48:38.488 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 23:48:38.488 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 23:48:38.488 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 23:48:38.488 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 23:48:38.488 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 23:48:38.488 1 ERROR cinder     post_fn = fn()
>2018-06-25 23:48:38.488 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 23:48:38.488 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 23:48:38.488 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 23:48:38.488 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 23:48:38.488 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 23:48:38.488 1 ERROR cinder 
>2018-06-25 23:48:41.178 1 WARNING cinder.scheduler.host_manager [req-332e8689-f186-486f-a82c-77101567a72a - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 23:48:41.183 1 INFO cinder.rpc [req-332e8689-f186-486f-a82c-77101567a72a - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 23:48:41.188 1 INFO cinder.rpc [req-332e8689-f186-486f-a82c-77101567a72a - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 23:48:41.200 1 INFO cinder.rpc [req-332e8689-f186-486f-a82c-77101567a72a - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 23:48:41.206 1 INFO cinder.rpc [req-332e8689-f186-486f-a82c-77101567a72a - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 23:48:41.227 1 WARNING oslo_config.cfg [req-332e8689-f186-486f-a82c-77101567a72a - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 23:48:41.229 1 WARNING oslo_config.cfg [req-332e8689-f186-486f-a82c-77101567a72a - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:48:41.230 1 WARNING oslo_config.cfg [req-332e8689-f186-486f-a82c-77101567a72a - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:48:41.231 1 WARNING oslo_config.cfg [req-332e8689-f186-486f-a82c-77101567a72a - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:48:41.236 1 WARNING oslo_config.cfg [req-332e8689-f186-486f-a82c-77101567a72a - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 23:48:41.237 1 WARNING oslo_config.cfg [req-332e8689-f186-486f-a82c-77101567a72a - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 23:48:41.240 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 23:48:41.246 1 INFO cinder.manager [req-a9d62c4a-1001-4a19-8c96-8d1e1b5f0200 - - - - -] Initiating service 5 cleanup
>2018-06-25 23:48:41.251 1 INFO cinder.manager [req-a9d62c4a-1001-4a19-8c96-8d1e1b5f0200 - - - - -] Service 5 cleanup completed.
>2018-06-25 23:50:47.388 1 ERROR oslo.messaging._drivers.impl_rabbit [req-a9d62c4a-1001-4a19-8c96-8d1e1b5f0200 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:50:47.393 1 ERROR oslo.messaging._drivers.impl_rabbit [req-a9d62c4a-1001-4a19-8c96-8d1e1b5f0200 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:50:47.393 1 ERROR oslo_service.service [req-a9d62c4a-1001-4a19-8c96-8d1e1b5f0200 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:50:47.393 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 23:50:47.393 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 23:50:47.393 1 ERROR oslo_service.service     service.start()
>2018-06-25 23:50:47.393 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 23:50:47.393 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 23:50:47.393 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 23:50:47.393 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 23:50:47.393 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 23:50:47.393 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 23:50:47.393 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 23:50:47.393 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 23:50:47.393 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 23:50:47.393 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 23:50:47.393 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 23:50:47.393 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 23:50:47.393 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 23:50:47.393 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 23:50:47.393 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 23:50:47.393 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 23:50:47.393 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 23:50:47.393 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 23:50:47.393 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 23:50:47.393 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 23:50:47.393 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 23:50:47.393 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 23:50:47.393 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:50:47.393 1 ERROR oslo_service.service 
>2018-06-25 23:50:47.396 1 CRITICAL cinder [req-332e8689-f186-486f-a82c-77101567a72a - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 23:50:47.396 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 23:50:47.396 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 23:50:47.396 1 ERROR cinder     sys.exit(main())
>2018-06-25 23:50:47.396 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 23:50:47.396 1 ERROR cinder     service.wait()
>2018-06-25 23:50:47.396 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 23:50:47.396 1 ERROR cinder     _launcher.wait()
>2018-06-25 23:50:47.396 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 23:50:47.396 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 23:50:47.396 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 23:50:47.396 1 ERROR cinder     self.services.wait()
>2018-06-25 23:50:47.396 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 23:50:47.396 1 ERROR cinder     service.wait()
>2018-06-25 23:50:47.396 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 23:50:47.396 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 23:50:47.396 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 23:50:47.396 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 23:50:47.396 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 23:50:47.396 1 ERROR cinder     post_fn = fn()
>2018-06-25 23:50:47.396 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 23:50:47.396 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 23:50:47.396 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 23:50:47.396 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 23:50:47.396 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 23:50:47.396 1 ERROR cinder 
>2018-06-25 23:50:50.126 1 WARNING cinder.scheduler.host_manager [req-f003d0db-f3fe-43fe-aa85-b9b35d29ee25 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 23:50:50.132 1 INFO cinder.rpc [req-f003d0db-f3fe-43fe-aa85-b9b35d29ee25 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 23:50:50.138 1 INFO cinder.rpc [req-f003d0db-f3fe-43fe-aa85-b9b35d29ee25 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 23:50:50.150 1 INFO cinder.rpc [req-f003d0db-f3fe-43fe-aa85-b9b35d29ee25 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 23:50:50.157 1 INFO cinder.rpc [req-f003d0db-f3fe-43fe-aa85-b9b35d29ee25 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 23:50:50.187 1 WARNING oslo_config.cfg [req-f003d0db-f3fe-43fe-aa85-b9b35d29ee25 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 23:50:50.189 1 WARNING oslo_config.cfg [req-f003d0db-f3fe-43fe-aa85-b9b35d29ee25 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:50:50.190 1 WARNING oslo_config.cfg [req-f003d0db-f3fe-43fe-aa85-b9b35d29ee25 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:50:50.190 1 WARNING oslo_config.cfg [req-f003d0db-f3fe-43fe-aa85-b9b35d29ee25 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:50:50.195 1 WARNING oslo_config.cfg [req-f003d0db-f3fe-43fe-aa85-b9b35d29ee25 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 23:50:50.196 1 WARNING oslo_config.cfg [req-f003d0db-f3fe-43fe-aa85-b9b35d29ee25 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 23:50:50.199 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 23:50:50.205 1 INFO cinder.manager [req-5f815448-3cb8-402b-99e8-b499b21a4113 - - - - -] Initiating service 5 cleanup
>2018-06-25 23:50:50.210 1 INFO cinder.manager [req-5f815448-3cb8-402b-99e8-b499b21a4113 - - - - -] Service 5 cleanup completed.
>2018-06-25 23:52:54.641 1 ERROR oslo.messaging._drivers.impl_rabbit [req-5f815448-3cb8-402b-99e8-b499b21a4113 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:52:54.643 1 ERROR oslo.messaging._drivers.impl_rabbit [req-5f815448-3cb8-402b-99e8-b499b21a4113 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:52:54.643 1 ERROR oslo_service.service [req-5f815448-3cb8-402b-99e8-b499b21a4113 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:52:54.643 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 23:52:54.643 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 23:52:54.643 1 ERROR oslo_service.service     service.start()
>2018-06-25 23:52:54.643 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 23:52:54.643 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 23:52:54.643 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 23:52:54.643 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 23:52:54.643 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 23:52:54.643 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 23:52:54.643 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 23:52:54.643 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 23:52:54.643 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 23:52:54.643 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 23:52:54.643 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 23:52:54.643 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 23:52:54.643 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 23:52:54.643 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 23:52:54.643 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 23:52:54.643 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 23:52:54.643 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 23:52:54.643 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 23:52:54.643 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 23:52:54.643 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 23:52:54.643 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 23:52:54.643 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 23:52:54.643 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:52:54.643 1 ERROR oslo_service.service 
>2018-06-25 23:52:54.646 1 CRITICAL cinder [req-f003d0db-f3fe-43fe-aa85-b9b35d29ee25 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 23:52:54.646 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 23:52:54.646 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 23:52:54.646 1 ERROR cinder     sys.exit(main())
>2018-06-25 23:52:54.646 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 23:52:54.646 1 ERROR cinder     service.wait()
>2018-06-25 23:52:54.646 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 23:52:54.646 1 ERROR cinder     _launcher.wait()
>2018-06-25 23:52:54.646 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 23:52:54.646 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 23:52:54.646 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 23:52:54.646 1 ERROR cinder     self.services.wait()
>2018-06-25 23:52:54.646 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 23:52:54.646 1 ERROR cinder     service.wait()
>2018-06-25 23:52:54.646 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 23:52:54.646 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 23:52:54.646 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 23:52:54.646 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 23:52:54.646 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 23:52:54.646 1 ERROR cinder     post_fn = fn()
>2018-06-25 23:52:54.646 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 23:52:54.646 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 23:52:54.646 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 23:52:54.646 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 23:52:54.646 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 23:52:54.646 1 ERROR cinder 
>2018-06-25 23:52:57.294 1 WARNING cinder.scheduler.host_manager [req-b1150204-399b-41e4-b811-f4a10fb133b2 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 23:52:57.301 1 INFO cinder.rpc [req-b1150204-399b-41e4-b811-f4a10fb133b2 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 23:52:57.307 1 INFO cinder.rpc [req-b1150204-399b-41e4-b811-f4a10fb133b2 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 23:52:57.319 1 INFO cinder.rpc [req-b1150204-399b-41e4-b811-f4a10fb133b2 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 23:52:57.324 1 INFO cinder.rpc [req-b1150204-399b-41e4-b811-f4a10fb133b2 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 23:52:57.347 1 WARNING oslo_config.cfg [req-b1150204-399b-41e4-b811-f4a10fb133b2 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 23:52:57.349 1 WARNING oslo_config.cfg [req-b1150204-399b-41e4-b811-f4a10fb133b2 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:52:57.350 1 WARNING oslo_config.cfg [req-b1150204-399b-41e4-b811-f4a10fb133b2 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:52:57.350 1 WARNING oslo_config.cfg [req-b1150204-399b-41e4-b811-f4a10fb133b2 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:52:57.355 1 WARNING oslo_config.cfg [req-b1150204-399b-41e4-b811-f4a10fb133b2 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 23:52:57.357 1 WARNING oslo_config.cfg [req-b1150204-399b-41e4-b811-f4a10fb133b2 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 23:52:57.359 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 23:52:57.366 1 INFO cinder.manager [req-4d12321b-4ab3-4019-8849-3bced33b86ae - - - - -] Initiating service 5 cleanup
>2018-06-25 23:52:57.371 1 INFO cinder.manager [req-4d12321b-4ab3-4019-8849-3bced33b86ae - - - - -] Service 5 cleanup completed.
>2018-06-25 23:55:11.115 1 ERROR oslo.messaging._drivers.impl_rabbit [req-4d12321b-4ab3-4019-8849-3bced33b86ae - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:55:11.117 1 ERROR oslo.messaging._drivers.impl_rabbit [req-4d12321b-4ab3-4019-8849-3bced33b86ae - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:55:11.117 1 ERROR oslo_service.service [req-4d12321b-4ab3-4019-8849-3bced33b86ae - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:55:11.117 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 23:55:11.117 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 23:55:11.117 1 ERROR oslo_service.service     service.start()
>2018-06-25 23:55:11.117 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 23:55:11.117 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 23:55:11.117 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 23:55:11.117 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 23:55:11.117 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 23:55:11.117 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 23:55:11.117 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 23:55:11.117 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 23:55:11.117 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 23:55:11.117 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 23:55:11.117 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 23:55:11.117 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 23:55:11.117 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 23:55:11.117 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 23:55:11.117 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 23:55:11.117 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 23:55:11.117 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 23:55:11.117 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 23:55:11.117 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 23:55:11.117 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 23:55:11.117 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 23:55:11.117 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 23:55:11.117 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:55:11.117 1 ERROR oslo_service.service 
>2018-06-25 23:55:11.120 1 CRITICAL cinder [req-b1150204-399b-41e4-b811-f4a10fb133b2 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 23:55:11.120 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 23:55:11.120 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 23:55:11.120 1 ERROR cinder     sys.exit(main())
>2018-06-25 23:55:11.120 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 23:55:11.120 1 ERROR cinder     service.wait()
>2018-06-25 23:55:11.120 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 23:55:11.120 1 ERROR cinder     _launcher.wait()
>2018-06-25 23:55:11.120 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 23:55:11.120 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 23:55:11.120 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 23:55:11.120 1 ERROR cinder     self.services.wait()
>2018-06-25 23:55:11.120 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 23:55:11.120 1 ERROR cinder     service.wait()
>2018-06-25 23:55:11.120 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 23:55:11.120 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 23:55:11.120 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 23:55:11.120 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 23:55:11.120 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 23:55:11.120 1 ERROR cinder     post_fn = fn()
>2018-06-25 23:55:11.120 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 23:55:11.120 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 23:55:11.120 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 23:55:11.120 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 23:55:11.120 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 23:55:11.120 1 ERROR cinder 
>2018-06-25 23:55:13.821 1 WARNING cinder.scheduler.host_manager [req-792a6141-00ec-444a-9fce-0642393fedf5 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 23:55:13.840 1 INFO cinder.rpc [req-792a6141-00ec-444a-9fce-0642393fedf5 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 23:55:13.846 1 INFO cinder.rpc [req-792a6141-00ec-444a-9fce-0642393fedf5 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 23:55:13.862 1 INFO cinder.rpc [req-792a6141-00ec-444a-9fce-0642393fedf5 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 23:55:13.870 1 INFO cinder.rpc [req-792a6141-00ec-444a-9fce-0642393fedf5 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 23:55:13.905 1 WARNING oslo_config.cfg [req-792a6141-00ec-444a-9fce-0642393fedf5 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 23:55:13.908 1 WARNING oslo_config.cfg [req-792a6141-00ec-444a-9fce-0642393fedf5 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:55:13.908 1 WARNING oslo_config.cfg [req-792a6141-00ec-444a-9fce-0642393fedf5 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:55:13.909 1 WARNING oslo_config.cfg [req-792a6141-00ec-444a-9fce-0642393fedf5 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:55:13.914 1 WARNING oslo_config.cfg [req-792a6141-00ec-444a-9fce-0642393fedf5 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 23:55:13.915 1 WARNING oslo_config.cfg [req-792a6141-00ec-444a-9fce-0642393fedf5 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 23:55:13.918 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 23:55:13.927 1 INFO cinder.manager [req-5030c331-d1e5-46c6-80d4-44698b666c44 - - - - -] Initiating service 5 cleanup
>2018-06-25 23:55:13.934 1 INFO cinder.manager [req-5030c331-d1e5-46c6-80d4-44698b666c44 - - - - -] Service 5 cleanup completed.
>2018-06-25 23:57:20.308 1 ERROR oslo.messaging._drivers.impl_rabbit [req-5030c331-d1e5-46c6-80d4-44698b666c44 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:57:20.309 1 ERROR oslo.messaging._drivers.impl_rabbit [req-5030c331-d1e5-46c6-80d4-44698b666c44 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:57:20.310 1 ERROR oslo_service.service [req-5030c331-d1e5-46c6-80d4-44698b666c44 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:57:20.310 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 23:57:20.310 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 23:57:20.310 1 ERROR oslo_service.service     service.start()
>2018-06-25 23:57:20.310 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 23:57:20.310 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 23:57:20.310 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 23:57:20.310 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 23:57:20.310 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 23:57:20.310 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 23:57:20.310 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 23:57:20.310 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 23:57:20.310 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 23:57:20.310 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 23:57:20.310 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 23:57:20.310 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 23:57:20.310 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 23:57:20.310 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 23:57:20.310 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 23:57:20.310 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 23:57:20.310 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 23:57:20.310 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 23:57:20.310 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 23:57:20.310 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 23:57:20.310 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 23:57:20.310 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 23:57:20.310 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:57:20.310 1 ERROR oslo_service.service 
>2018-06-25 23:57:20.313 1 CRITICAL cinder [req-792a6141-00ec-444a-9fce-0642393fedf5 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 23:57:20.313 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 23:57:20.313 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 23:57:20.313 1 ERROR cinder     sys.exit(main())
>2018-06-25 23:57:20.313 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 23:57:20.313 1 ERROR cinder     service.wait()
>2018-06-25 23:57:20.313 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 23:57:20.313 1 ERROR cinder     _launcher.wait()
>2018-06-25 23:57:20.313 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 23:57:20.313 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 23:57:20.313 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 23:57:20.313 1 ERROR cinder     self.services.wait()
>2018-06-25 23:57:20.313 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 23:57:20.313 1 ERROR cinder     service.wait()
>2018-06-25 23:57:20.313 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 23:57:20.313 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 23:57:20.313 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 23:57:20.313 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 23:57:20.313 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 23:57:20.313 1 ERROR cinder     post_fn = fn()
>2018-06-25 23:57:20.313 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 23:57:20.313 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 23:57:20.313 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 23:57:20.313 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 23:57:20.313 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 23:57:20.313 1 ERROR cinder 
>2018-06-25 23:57:23.056 1 WARNING cinder.scheduler.host_manager [req-79b166a4-01cd-43e1-8204-75fad7913434 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 23:57:23.063 1 INFO cinder.rpc [req-79b166a4-01cd-43e1-8204-75fad7913434 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 23:57:23.070 1 INFO cinder.rpc [req-79b166a4-01cd-43e1-8204-75fad7913434 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 23:57:23.085 1 INFO cinder.rpc [req-79b166a4-01cd-43e1-8204-75fad7913434 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 23:57:23.094 1 INFO cinder.rpc [req-79b166a4-01cd-43e1-8204-75fad7913434 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 23:57:23.124 1 WARNING oslo_config.cfg [req-79b166a4-01cd-43e1-8204-75fad7913434 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 23:57:23.126 1 WARNING oslo_config.cfg [req-79b166a4-01cd-43e1-8204-75fad7913434 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:57:23.127 1 WARNING oslo_config.cfg [req-79b166a4-01cd-43e1-8204-75fad7913434 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:57:23.127 1 WARNING oslo_config.cfg [req-79b166a4-01cd-43e1-8204-75fad7913434 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:57:23.133 1 WARNING oslo_config.cfg [req-79b166a4-01cd-43e1-8204-75fad7913434 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 23:57:23.134 1 WARNING oslo_config.cfg [req-79b166a4-01cd-43e1-8204-75fad7913434 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 23:57:23.137 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 23:57:23.146 1 INFO cinder.manager [req-8b0c4b2a-6e9b-452c-8a84-88ef95805549 - - - - -] Initiating service 5 cleanup
>2018-06-25 23:57:23.153 1 INFO cinder.manager [req-8b0c4b2a-6e9b-452c-8a84-88ef95805549 - - - - -] Service 5 cleanup completed.
>2018-06-25 23:59:29.594 1 ERROR oslo.messaging._drivers.impl_rabbit [req-8b0c4b2a-6e9b-452c-8a84-88ef95805549 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:59:29.596 1 ERROR oslo.messaging._drivers.impl_rabbit [req-8b0c4b2a-6e9b-452c-8a84-88ef95805549 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:59:29.596 1 ERROR oslo_service.service [req-8b0c4b2a-6e9b-452c-8a84-88ef95805549 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:59:29.596 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-25 23:59:29.596 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-25 23:59:29.596 1 ERROR oslo_service.service     service.start()
>2018-06-25 23:59:29.596 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-25 23:59:29.596 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-25 23:59:29.596 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 23:59:29.596 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-25 23:59:29.596 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 23:59:29.596 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-25 23:59:29.596 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 23:59:29.596 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 23:59:29.596 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-25 23:59:29.596 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-25 23:59:29.596 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-25 23:59:29.596 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-25 23:59:29.596 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-25 23:59:29.596 1 ERROR oslo_service.service     batch_timeout)
>2018-06-25 23:59:29.596 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-25 23:59:29.596 1 ERROR oslo_service.service     callback=listener)
>2018-06-25 23:59:29.596 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-25 23:59:29.596 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-25 23:59:29.596 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-25 23:59:29.596 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-25 23:59:29.596 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-25 23:59:29.596 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-25 23:59:29.596 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-25 23:59:29.596 1 ERROR oslo_service.service 
>2018-06-25 23:59:29.599 1 CRITICAL cinder [req-79b166a4-01cd-43e1-8204-75fad7913434 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 23:59:29.599 1 ERROR cinder Traceback (most recent call last):
>2018-06-25 23:59:29.599 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-25 23:59:29.599 1 ERROR cinder     sys.exit(main())
>2018-06-25 23:59:29.599 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-25 23:59:29.599 1 ERROR cinder     service.wait()
>2018-06-25 23:59:29.599 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-25 23:59:29.599 1 ERROR cinder     _launcher.wait()
>2018-06-25 23:59:29.599 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-25 23:59:29.599 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-25 23:59:29.599 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-25 23:59:29.599 1 ERROR cinder     self.services.wait()
>2018-06-25 23:59:29.599 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-25 23:59:29.599 1 ERROR cinder     service.wait()
>2018-06-25 23:59:29.599 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-25 23:59:29.599 1 ERROR cinder     self.rpcserver.wait()
>2018-06-25 23:59:29.599 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-25 23:59:29.599 1 ERROR cinder     log_after, timeout_timer)
>2018-06-25 23:59:29.599 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-25 23:59:29.599 1 ERROR cinder     post_fn = fn()
>2018-06-25 23:59:29.599 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-25 23:59:29.599 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-25 23:59:29.599 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-25 23:59:29.599 1 ERROR cinder     self.listener.cleanup()
>2018-06-25 23:59:29.599 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-25 23:59:29.599 1 ERROR cinder 
>2018-06-25 23:59:32.265 1 WARNING cinder.scheduler.host_manager [req-eab86696-1b44-44e5-96b1-b40b4b618c28 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-25 23:59:32.270 1 INFO cinder.rpc [req-eab86696-1b44-44e5-96b1-b40b4b618c28 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-25 23:59:32.276 1 INFO cinder.rpc [req-eab86696-1b44-44e5-96b1-b40b4b618c28 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-25 23:59:32.287 1 INFO cinder.rpc [req-eab86696-1b44-44e5-96b1-b40b4b618c28 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-25 23:59:32.294 1 INFO cinder.rpc [req-eab86696-1b44-44e5-96b1-b40b4b618c28 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-25 23:59:32.317 1 WARNING oslo_config.cfg [req-eab86696-1b44-44e5-96b1-b40b4b618c28 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-25 23:59:32.319 1 WARNING oslo_config.cfg [req-eab86696-1b44-44e5-96b1-b40b4b618c28 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:59:32.319 1 WARNING oslo_config.cfg [req-eab86696-1b44-44e5-96b1-b40b4b618c28 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:59:32.320 1 WARNING oslo_config.cfg [req-eab86696-1b44-44e5-96b1-b40b4b618c28 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-25 23:59:32.325 1 WARNING oslo_config.cfg [req-eab86696-1b44-44e5-96b1-b40b4b618c28 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-25 23:59:32.326 1 WARNING oslo_config.cfg [req-eab86696-1b44-44e5-96b1-b40b4b618c28 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-25 23:59:32.329 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-25 23:59:32.335 1 INFO cinder.manager [req-3fc5eddf-17a5-466a-9bc0-c374f07ab327 - - - - -] Initiating service 5 cleanup
>2018-06-25 23:59:32.340 1 INFO cinder.manager [req-3fc5eddf-17a5-466a-9bc0-c374f07ab327 - - - - -] Service 5 cleanup completed.
>2018-06-26 00:01:37.067 1 ERROR oslo.messaging._drivers.impl_rabbit [req-3fc5eddf-17a5-466a-9bc0-c374f07ab327 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:01:37.069 1 ERROR oslo.messaging._drivers.impl_rabbit [req-3fc5eddf-17a5-466a-9bc0-c374f07ab327 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:01:37.070 1 ERROR oslo_service.service [req-3fc5eddf-17a5-466a-9bc0-c374f07ab327 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:01:37.070 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 00:01:37.070 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 00:01:37.070 1 ERROR oslo_service.service     service.start()
>2018-06-26 00:01:37.070 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 00:01:37.070 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 00:01:37.070 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 00:01:37.070 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 00:01:37.070 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 00:01:37.070 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 00:01:37.070 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 00:01:37.070 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 00:01:37.070 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 00:01:37.070 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 00:01:37.070 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 00:01:37.070 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 00:01:37.070 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 00:01:37.070 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 00:01:37.070 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 00:01:37.070 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 00:01:37.070 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 00:01:37.070 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 00:01:37.070 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 00:01:37.070 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 00:01:37.070 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 00:01:37.070 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 00:01:37.070 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:01:37.070 1 ERROR oslo_service.service 
>2018-06-26 00:01:37.073 1 CRITICAL cinder [req-eab86696-1b44-44e5-96b1-b40b4b618c28 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 00:01:37.073 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 00:01:37.073 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 00:01:37.073 1 ERROR cinder     sys.exit(main())
>2018-06-26 00:01:37.073 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 00:01:37.073 1 ERROR cinder     service.wait()
>2018-06-26 00:01:37.073 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 00:01:37.073 1 ERROR cinder     _launcher.wait()
>2018-06-26 00:01:37.073 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 00:01:37.073 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 00:01:37.073 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 00:01:37.073 1 ERROR cinder     self.services.wait()
>2018-06-26 00:01:37.073 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 00:01:37.073 1 ERROR cinder     service.wait()
>2018-06-26 00:01:37.073 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 00:01:37.073 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 00:01:37.073 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 00:01:37.073 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 00:01:37.073 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 00:01:37.073 1 ERROR cinder     post_fn = fn()
>2018-06-26 00:01:37.073 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 00:01:37.073 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 00:01:37.073 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 00:01:37.073 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 00:01:37.073 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 00:01:37.073 1 ERROR cinder 
>2018-06-26 00:01:39.723 1 WARNING cinder.scheduler.host_manager [req-b12c57a9-e722-4985-9555-c2ecf8bfacf2 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 00:01:39.734 1 INFO cinder.rpc [req-b12c57a9-e722-4985-9555-c2ecf8bfacf2 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 00:01:39.740 1 INFO cinder.rpc [req-b12c57a9-e722-4985-9555-c2ecf8bfacf2 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 00:01:39.754 1 INFO cinder.rpc [req-b12c57a9-e722-4985-9555-c2ecf8bfacf2 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 00:01:39.761 1 INFO cinder.rpc [req-b12c57a9-e722-4985-9555-c2ecf8bfacf2 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 00:01:39.783 1 WARNING oslo_config.cfg [req-b12c57a9-e722-4985-9555-c2ecf8bfacf2 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 00:01:39.786 1 WARNING oslo_config.cfg [req-b12c57a9-e722-4985-9555-c2ecf8bfacf2 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:01:39.786 1 WARNING oslo_config.cfg [req-b12c57a9-e722-4985-9555-c2ecf8bfacf2 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:01:39.787 1 WARNING oslo_config.cfg [req-b12c57a9-e722-4985-9555-c2ecf8bfacf2 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:01:39.792 1 WARNING oslo_config.cfg [req-b12c57a9-e722-4985-9555-c2ecf8bfacf2 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 00:01:39.793 1 WARNING oslo_config.cfg [req-b12c57a9-e722-4985-9555-c2ecf8bfacf2 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 00:01:39.795 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 00:01:39.802 1 INFO cinder.manager [req-947a7e70-0b15-4f34-b214-ac5b97c3fad5 - - - - -] Initiating service 5 cleanup
>2018-06-26 00:01:39.807 1 INFO cinder.manager [req-947a7e70-0b15-4f34-b214-ac5b97c3fad5 - - - - -] Service 5 cleanup completed.
>2018-06-26 00:03:45.758 1 ERROR oslo.messaging._drivers.impl_rabbit [req-947a7e70-0b15-4f34-b214-ac5b97c3fad5 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:03:45.760 1 ERROR oslo.messaging._drivers.impl_rabbit [req-947a7e70-0b15-4f34-b214-ac5b97c3fad5 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:03:45.760 1 ERROR oslo_service.service [req-947a7e70-0b15-4f34-b214-ac5b97c3fad5 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:03:45.760 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 00:03:45.760 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 00:03:45.760 1 ERROR oslo_service.service     service.start()
>2018-06-26 00:03:45.760 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 00:03:45.760 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 00:03:45.760 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 00:03:45.760 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 00:03:45.760 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 00:03:45.760 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 00:03:45.760 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 00:03:45.760 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 00:03:45.760 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 00:03:45.760 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 00:03:45.760 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 00:03:45.760 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 00:03:45.760 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 00:03:45.760 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 00:03:45.760 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 00:03:45.760 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 00:03:45.760 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 00:03:45.760 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 00:03:45.760 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 00:03:45.760 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 00:03:45.760 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 00:03:45.760 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 00:03:45.760 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:03:45.760 1 ERROR oslo_service.service 
>2018-06-26 00:03:45.763 1 CRITICAL cinder [req-b12c57a9-e722-4985-9555-c2ecf8bfacf2 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 00:03:45.763 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 00:03:45.763 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 00:03:45.763 1 ERROR cinder     sys.exit(main())
>2018-06-26 00:03:45.763 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 00:03:45.763 1 ERROR cinder     service.wait()
>2018-06-26 00:03:45.763 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 00:03:45.763 1 ERROR cinder     _launcher.wait()
>2018-06-26 00:03:45.763 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 00:03:45.763 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 00:03:45.763 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 00:03:45.763 1 ERROR cinder     self.services.wait()
>2018-06-26 00:03:45.763 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 00:03:45.763 1 ERROR cinder     service.wait()
>2018-06-26 00:03:45.763 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 00:03:45.763 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 00:03:45.763 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 00:03:45.763 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 00:03:45.763 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 00:03:45.763 1 ERROR cinder     post_fn = fn()
>2018-06-26 00:03:45.763 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 00:03:45.763 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 00:03:45.763 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 00:03:45.763 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 00:03:45.763 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 00:03:45.763 1 ERROR cinder 
>2018-06-26 00:03:48.481 1 WARNING cinder.scheduler.host_manager [req-5c26d536-b504-47fa-a80e-2ddaa09fecdb - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 00:03:48.486 1 INFO cinder.rpc [req-5c26d536-b504-47fa-a80e-2ddaa09fecdb - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 00:03:48.491 1 INFO cinder.rpc [req-5c26d536-b504-47fa-a80e-2ddaa09fecdb - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 00:03:48.502 1 INFO cinder.rpc [req-5c26d536-b504-47fa-a80e-2ddaa09fecdb - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 00:03:48.507 1 INFO cinder.rpc [req-5c26d536-b504-47fa-a80e-2ddaa09fecdb - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 00:03:48.529 1 WARNING oslo_config.cfg [req-5c26d536-b504-47fa-a80e-2ddaa09fecdb - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 00:03:48.531 1 WARNING oslo_config.cfg [req-5c26d536-b504-47fa-a80e-2ddaa09fecdb - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:03:48.531 1 WARNING oslo_config.cfg [req-5c26d536-b504-47fa-a80e-2ddaa09fecdb - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:03:48.532 1 WARNING oslo_config.cfg [req-5c26d536-b504-47fa-a80e-2ddaa09fecdb - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:03:48.537 1 WARNING oslo_config.cfg [req-5c26d536-b504-47fa-a80e-2ddaa09fecdb - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 00:03:48.538 1 WARNING oslo_config.cfg [req-5c26d536-b504-47fa-a80e-2ddaa09fecdb - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 00:03:48.541 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 00:03:48.547 1 INFO cinder.manager [req-05030a28-fafc-4e13-8573-a67d7704af24 - - - - -] Initiating service 5 cleanup
>2018-06-26 00:03:48.552 1 INFO cinder.manager [req-05030a28-fafc-4e13-8573-a67d7704af24 - - - - -] Service 5 cleanup completed.
>2018-06-26 00:05:54.796 1 ERROR oslo.messaging._drivers.impl_rabbit [req-05030a28-fafc-4e13-8573-a67d7704af24 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:05:54.798 1 ERROR oslo.messaging._drivers.impl_rabbit [req-05030a28-fafc-4e13-8573-a67d7704af24 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:05:54.798 1 ERROR oslo_service.service [req-05030a28-fafc-4e13-8573-a67d7704af24 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:05:54.798 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 00:05:54.798 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 00:05:54.798 1 ERROR oslo_service.service     service.start()
>2018-06-26 00:05:54.798 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 00:05:54.798 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 00:05:54.798 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 00:05:54.798 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 00:05:54.798 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 00:05:54.798 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 00:05:54.798 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 00:05:54.798 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 00:05:54.798 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 00:05:54.798 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 00:05:54.798 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 00:05:54.798 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 00:05:54.798 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 00:05:54.798 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 00:05:54.798 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 00:05:54.798 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 00:05:54.798 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 00:05:54.798 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 00:05:54.798 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 00:05:54.798 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 00:05:54.798 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 00:05:54.798 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 00:05:54.798 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:05:54.798 1 ERROR oslo_service.service 
>2018-06-26 00:05:54.801 1 CRITICAL cinder [req-5c26d536-b504-47fa-a80e-2ddaa09fecdb - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 00:05:54.801 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 00:05:54.801 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 00:05:54.801 1 ERROR cinder     sys.exit(main())
>2018-06-26 00:05:54.801 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 00:05:54.801 1 ERROR cinder     service.wait()
>2018-06-26 00:05:54.801 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 00:05:54.801 1 ERROR cinder     _launcher.wait()
>2018-06-26 00:05:54.801 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 00:05:54.801 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 00:05:54.801 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 00:05:54.801 1 ERROR cinder     self.services.wait()
>2018-06-26 00:05:54.801 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 00:05:54.801 1 ERROR cinder     service.wait()
>2018-06-26 00:05:54.801 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 00:05:54.801 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 00:05:54.801 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 00:05:54.801 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 00:05:54.801 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 00:05:54.801 1 ERROR cinder     post_fn = fn()
>2018-06-26 00:05:54.801 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 00:05:54.801 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 00:05:54.801 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 00:05:54.801 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 00:05:54.801 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 00:05:54.801 1 ERROR cinder 
>2018-06-26 00:05:57.393 1 WARNING cinder.scheduler.host_manager [req-ef2a2ff8-e508-4f55-806c-397e7976bf3e - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 00:05:57.401 1 INFO cinder.rpc [req-ef2a2ff8-e508-4f55-806c-397e7976bf3e - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 00:05:57.410 1 INFO cinder.rpc [req-ef2a2ff8-e508-4f55-806c-397e7976bf3e - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 00:05:57.437 1 INFO cinder.rpc [req-ef2a2ff8-e508-4f55-806c-397e7976bf3e - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 00:05:57.445 1 INFO cinder.rpc [req-ef2a2ff8-e508-4f55-806c-397e7976bf3e - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 00:05:57.493 1 WARNING oslo_config.cfg [req-ef2a2ff8-e508-4f55-806c-397e7976bf3e - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 00:05:57.496 1 WARNING oslo_config.cfg [req-ef2a2ff8-e508-4f55-806c-397e7976bf3e - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:05:57.496 1 WARNING oslo_config.cfg [req-ef2a2ff8-e508-4f55-806c-397e7976bf3e - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:05:57.497 1 WARNING oslo_config.cfg [req-ef2a2ff8-e508-4f55-806c-397e7976bf3e - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:05:57.502 1 WARNING oslo_config.cfg [req-ef2a2ff8-e508-4f55-806c-397e7976bf3e - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 00:05:57.503 1 WARNING oslo_config.cfg [req-ef2a2ff8-e508-4f55-806c-397e7976bf3e - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 00:05:57.506 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 00:05:57.514 1 INFO cinder.manager [req-d1d3b237-8b73-46ff-a530-4ce19cf687e0 - - - - -] Initiating service 5 cleanup
>2018-06-26 00:05:57.520 1 INFO cinder.manager [req-d1d3b237-8b73-46ff-a530-4ce19cf687e0 - - - - -] Service 5 cleanup completed.
>2018-06-26 00:08:03.625 1 ERROR oslo.messaging._drivers.impl_rabbit [req-d1d3b237-8b73-46ff-a530-4ce19cf687e0 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:08:03.627 1 ERROR oslo.messaging._drivers.impl_rabbit [req-d1d3b237-8b73-46ff-a530-4ce19cf687e0 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:08:03.627 1 ERROR oslo_service.service [req-d1d3b237-8b73-46ff-a530-4ce19cf687e0 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:08:03.627 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 00:08:03.627 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 00:08:03.627 1 ERROR oslo_service.service     service.start()
>2018-06-26 00:08:03.627 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 00:08:03.627 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 00:08:03.627 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 00:08:03.627 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 00:08:03.627 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 00:08:03.627 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 00:08:03.627 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 00:08:03.627 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 00:08:03.627 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 00:08:03.627 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 00:08:03.627 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 00:08:03.627 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 00:08:03.627 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 00:08:03.627 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 00:08:03.627 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 00:08:03.627 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 00:08:03.627 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 00:08:03.627 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 00:08:03.627 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 00:08:03.627 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 00:08:03.627 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 00:08:03.627 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 00:08:03.627 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:08:03.627 1 ERROR oslo_service.service 
>2018-06-26 00:08:03.630 1 CRITICAL cinder [req-ef2a2ff8-e508-4f55-806c-397e7976bf3e - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 00:08:03.630 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 00:08:03.630 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 00:08:03.630 1 ERROR cinder     sys.exit(main())
>2018-06-26 00:08:03.630 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 00:08:03.630 1 ERROR cinder     service.wait()
>2018-06-26 00:08:03.630 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 00:08:03.630 1 ERROR cinder     _launcher.wait()
>2018-06-26 00:08:03.630 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 00:08:03.630 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 00:08:03.630 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 00:08:03.630 1 ERROR cinder     self.services.wait()
>2018-06-26 00:08:03.630 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 00:08:03.630 1 ERROR cinder     service.wait()
>2018-06-26 00:08:03.630 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 00:08:03.630 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 00:08:03.630 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 00:08:03.630 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 00:08:03.630 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 00:08:03.630 1 ERROR cinder     post_fn = fn()
>2018-06-26 00:08:03.630 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 00:08:03.630 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 00:08:03.630 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 00:08:03.630 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 00:08:03.630 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 00:08:03.630 1 ERROR cinder 
>2018-06-26 00:08:06.391 1 WARNING cinder.scheduler.host_manager [req-328dcd58-4f74-4bee-b7a0-54a6e8c20df0 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 00:08:06.397 1 INFO cinder.rpc [req-328dcd58-4f74-4bee-b7a0-54a6e8c20df0 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 00:08:06.402 1 INFO cinder.rpc [req-328dcd58-4f74-4bee-b7a0-54a6e8c20df0 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 00:08:06.415 1 INFO cinder.rpc [req-328dcd58-4f74-4bee-b7a0-54a6e8c20df0 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 00:08:06.421 1 INFO cinder.rpc [req-328dcd58-4f74-4bee-b7a0-54a6e8c20df0 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 00:08:06.447 1 WARNING oslo_config.cfg [req-328dcd58-4f74-4bee-b7a0-54a6e8c20df0 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 00:08:06.449 1 WARNING oslo_config.cfg [req-328dcd58-4f74-4bee-b7a0-54a6e8c20df0 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:08:06.450 1 WARNING oslo_config.cfg [req-328dcd58-4f74-4bee-b7a0-54a6e8c20df0 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:08:06.450 1 WARNING oslo_config.cfg [req-328dcd58-4f74-4bee-b7a0-54a6e8c20df0 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:08:06.455 1 WARNING oslo_config.cfg [req-328dcd58-4f74-4bee-b7a0-54a6e8c20df0 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 00:08:06.457 1 WARNING oslo_config.cfg [req-328dcd58-4f74-4bee-b7a0-54a6e8c20df0 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 00:08:06.459 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 00:08:06.464 1 INFO cinder.manager [req-5727452a-b915-4506-b87a-e58ff009f65d - - - - -] Initiating service 5 cleanup
>2018-06-26 00:08:06.470 1 INFO cinder.manager [req-5727452a-b915-4506-b87a-e58ff009f65d - - - - -] Service 5 cleanup completed.
>2018-06-26 00:10:10.837 1 ERROR oslo.messaging._drivers.impl_rabbit [req-5727452a-b915-4506-b87a-e58ff009f65d - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:10:10.839 1 ERROR oslo.messaging._drivers.impl_rabbit [req-5727452a-b915-4506-b87a-e58ff009f65d - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:10:10.840 1 ERROR oslo_service.service [req-5727452a-b915-4506-b87a-e58ff009f65d - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:10:10.840 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 00:10:10.840 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 00:10:10.840 1 ERROR oslo_service.service     service.start()
>2018-06-26 00:10:10.840 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 00:10:10.840 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 00:10:10.840 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 00:10:10.840 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 00:10:10.840 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 00:10:10.840 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 00:10:10.840 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 00:10:10.840 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 00:10:10.840 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 00:10:10.840 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 00:10:10.840 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 00:10:10.840 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 00:10:10.840 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 00:10:10.840 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 00:10:10.840 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 00:10:10.840 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 00:10:10.840 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 00:10:10.840 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 00:10:10.840 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 00:10:10.840 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 00:10:10.840 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 00:10:10.840 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 00:10:10.840 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:10:10.840 1 ERROR oslo_service.service 
>2018-06-26 00:10:10.843 1 CRITICAL cinder [req-328dcd58-4f74-4bee-b7a0-54a6e8c20df0 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 00:10:10.843 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 00:10:10.843 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 00:10:10.843 1 ERROR cinder     sys.exit(main())
>2018-06-26 00:10:10.843 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 00:10:10.843 1 ERROR cinder     service.wait()
>2018-06-26 00:10:10.843 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 00:10:10.843 1 ERROR cinder     _launcher.wait()
>2018-06-26 00:10:10.843 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 00:10:10.843 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 00:10:10.843 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 00:10:10.843 1 ERROR cinder     self.services.wait()
>2018-06-26 00:10:10.843 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 00:10:10.843 1 ERROR cinder     service.wait()
>2018-06-26 00:10:10.843 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 00:10:10.843 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 00:10:10.843 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 00:10:10.843 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 00:10:10.843 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 00:10:10.843 1 ERROR cinder     post_fn = fn()
>2018-06-26 00:10:10.843 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 00:10:10.843 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 00:10:10.843 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 00:10:10.843 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 00:10:10.843 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 00:10:10.843 1 ERROR cinder 
>2018-06-26 00:10:13.448 1 WARNING cinder.scheduler.host_manager [req-530217b4-7fe5-4aec-8d75-82f126a8b191 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 00:10:13.454 1 INFO cinder.rpc [req-530217b4-7fe5-4aec-8d75-82f126a8b191 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 00:10:13.459 1 INFO cinder.rpc [req-530217b4-7fe5-4aec-8d75-82f126a8b191 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 00:10:13.469 1 INFO cinder.rpc [req-530217b4-7fe5-4aec-8d75-82f126a8b191 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 00:10:13.476 1 INFO cinder.rpc [req-530217b4-7fe5-4aec-8d75-82f126a8b191 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 00:10:13.500 1 WARNING oslo_config.cfg [req-530217b4-7fe5-4aec-8d75-82f126a8b191 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 00:10:13.502 1 WARNING oslo_config.cfg [req-530217b4-7fe5-4aec-8d75-82f126a8b191 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:10:13.503 1 WARNING oslo_config.cfg [req-530217b4-7fe5-4aec-8d75-82f126a8b191 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:10:13.504 1 WARNING oslo_config.cfg [req-530217b4-7fe5-4aec-8d75-82f126a8b191 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:10:13.508 1 WARNING oslo_config.cfg [req-530217b4-7fe5-4aec-8d75-82f126a8b191 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 00:10:13.509 1 WARNING oslo_config.cfg [req-530217b4-7fe5-4aec-8d75-82f126a8b191 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 00:10:13.512 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 00:10:13.518 1 INFO cinder.manager [req-af16bab8-37d0-41a8-b5f7-bb30a7001766 - - - - -] Initiating service 5 cleanup
>2018-06-26 00:10:13.522 1 INFO cinder.manager [req-af16bab8-37d0-41a8-b5f7-bb30a7001766 - - - - -] Service 5 cleanup completed.
>2018-06-26 00:12:26.090 1 ERROR oslo.messaging._drivers.impl_rabbit [req-af16bab8-37d0-41a8-b5f7-bb30a7001766 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:12:26.092 1 ERROR oslo.messaging._drivers.impl_rabbit [req-af16bab8-37d0-41a8-b5f7-bb30a7001766 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:12:26.092 1 ERROR oslo_service.service [req-af16bab8-37d0-41a8-b5f7-bb30a7001766 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:12:26.092 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 00:12:26.092 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 00:12:26.092 1 ERROR oslo_service.service     service.start()
>2018-06-26 00:12:26.092 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 00:12:26.092 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 00:12:26.092 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 00:12:26.092 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 00:12:26.092 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 00:12:26.092 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 00:12:26.092 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 00:12:26.092 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 00:12:26.092 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 00:12:26.092 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 00:12:26.092 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 00:12:26.092 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 00:12:26.092 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 00:12:26.092 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 00:12:26.092 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 00:12:26.092 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 00:12:26.092 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 00:12:26.092 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 00:12:26.092 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 00:12:26.092 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 00:12:26.092 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 00:12:26.092 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 00:12:26.092 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:12:26.092 1 ERROR oslo_service.service 
>2018-06-26 00:12:26.095 1 CRITICAL cinder [req-530217b4-7fe5-4aec-8d75-82f126a8b191 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 00:12:26.095 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 00:12:26.095 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 00:12:26.095 1 ERROR cinder     sys.exit(main())
>2018-06-26 00:12:26.095 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 00:12:26.095 1 ERROR cinder     service.wait()
>2018-06-26 00:12:26.095 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 00:12:26.095 1 ERROR cinder     _launcher.wait()
>2018-06-26 00:12:26.095 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 00:12:26.095 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 00:12:26.095 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 00:12:26.095 1 ERROR cinder     self.services.wait()
>2018-06-26 00:12:26.095 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 00:12:26.095 1 ERROR cinder     service.wait()
>2018-06-26 00:12:26.095 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 00:12:26.095 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 00:12:26.095 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 00:12:26.095 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 00:12:26.095 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 00:12:26.095 1 ERROR cinder     post_fn = fn()
>2018-06-26 00:12:26.095 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 00:12:26.095 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 00:12:26.095 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 00:12:26.095 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 00:12:26.095 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 00:12:26.095 1 ERROR cinder 
>2018-06-26 00:12:28.717 1 WARNING cinder.scheduler.host_manager [req-55cde405-576e-4260-ad92-c97af7895e86 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 00:12:28.722 1 INFO cinder.rpc [req-55cde405-576e-4260-ad92-c97af7895e86 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 00:12:28.727 1 INFO cinder.rpc [req-55cde405-576e-4260-ad92-c97af7895e86 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 00:12:28.738 1 INFO cinder.rpc [req-55cde405-576e-4260-ad92-c97af7895e86 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 00:12:28.744 1 INFO cinder.rpc [req-55cde405-576e-4260-ad92-c97af7895e86 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 00:12:28.769 1 WARNING oslo_config.cfg [req-55cde405-576e-4260-ad92-c97af7895e86 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 00:12:28.771 1 WARNING oslo_config.cfg [req-55cde405-576e-4260-ad92-c97af7895e86 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:12:28.772 1 WARNING oslo_config.cfg [req-55cde405-576e-4260-ad92-c97af7895e86 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:12:28.772 1 WARNING oslo_config.cfg [req-55cde405-576e-4260-ad92-c97af7895e86 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:12:28.778 1 WARNING oslo_config.cfg [req-55cde405-576e-4260-ad92-c97af7895e86 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 00:12:28.779 1 WARNING oslo_config.cfg [req-55cde405-576e-4260-ad92-c97af7895e86 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 00:12:28.781 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 00:12:28.789 1 INFO cinder.manager [req-c3dccd63-7a79-4b5f-adb1-b8a9e93dd8fc - - - - -] Initiating service 5 cleanup
>2018-06-26 00:12:28.793 1 INFO cinder.manager [req-c3dccd63-7a79-4b5f-adb1-b8a9e93dd8fc - - - - -] Service 5 cleanup completed.
>2018-06-26 00:14:33.153 1 ERROR oslo.messaging._drivers.impl_rabbit [req-c3dccd63-7a79-4b5f-adb1-b8a9e93dd8fc - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:14:33.155 1 ERROR oslo.messaging._drivers.impl_rabbit [req-c3dccd63-7a79-4b5f-adb1-b8a9e93dd8fc - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:14:33.156 1 ERROR oslo_service.service [req-c3dccd63-7a79-4b5f-adb1-b8a9e93dd8fc - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:14:33.156 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 00:14:33.156 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 00:14:33.156 1 ERROR oslo_service.service     service.start()
>2018-06-26 00:14:33.156 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 00:14:33.156 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 00:14:33.156 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 00:14:33.156 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 00:14:33.156 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 00:14:33.156 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 00:14:33.156 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 00:14:33.156 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 00:14:33.156 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 00:14:33.156 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 00:14:33.156 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 00:14:33.156 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 00:14:33.156 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 00:14:33.156 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 00:14:33.156 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 00:14:33.156 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 00:14:33.156 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 00:14:33.156 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 00:14:33.156 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 00:14:33.156 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 00:14:33.156 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 00:14:33.156 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 00:14:33.156 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:14:33.156 1 ERROR oslo_service.service 
>2018-06-26 00:14:33.159 1 CRITICAL cinder [req-55cde405-576e-4260-ad92-c97af7895e86 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 00:14:33.159 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 00:14:33.159 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 00:14:33.159 1 ERROR cinder     sys.exit(main())
>2018-06-26 00:14:33.159 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 00:14:33.159 1 ERROR cinder     service.wait()
>2018-06-26 00:14:33.159 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 00:14:33.159 1 ERROR cinder     _launcher.wait()
>2018-06-26 00:14:33.159 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 00:14:33.159 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 00:14:33.159 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 00:14:33.159 1 ERROR cinder     self.services.wait()
>2018-06-26 00:14:33.159 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 00:14:33.159 1 ERROR cinder     service.wait()
>2018-06-26 00:14:33.159 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 00:14:33.159 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 00:14:33.159 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 00:14:33.159 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 00:14:33.159 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 00:14:33.159 1 ERROR cinder     post_fn = fn()
>2018-06-26 00:14:33.159 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 00:14:33.159 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 00:14:33.159 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 00:14:33.159 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 00:14:33.159 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 00:14:33.159 1 ERROR cinder 
>2018-06-26 00:14:35.859 1 WARNING cinder.scheduler.host_manager [req-05b6ccc8-9943-4fc3-888d-50b5d0f74140 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 00:14:35.867 1 INFO cinder.rpc [req-05b6ccc8-9943-4fc3-888d-50b5d0f74140 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 00:14:35.874 1 INFO cinder.rpc [req-05b6ccc8-9943-4fc3-888d-50b5d0f74140 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 00:14:35.886 1 INFO cinder.rpc [req-05b6ccc8-9943-4fc3-888d-50b5d0f74140 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 00:14:35.894 1 INFO cinder.rpc [req-05b6ccc8-9943-4fc3-888d-50b5d0f74140 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 00:14:35.917 1 WARNING oslo_config.cfg [req-05b6ccc8-9943-4fc3-888d-50b5d0f74140 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 00:14:35.919 1 WARNING oslo_config.cfg [req-05b6ccc8-9943-4fc3-888d-50b5d0f74140 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:14:35.920 1 WARNING oslo_config.cfg [req-05b6ccc8-9943-4fc3-888d-50b5d0f74140 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:14:35.921 1 WARNING oslo_config.cfg [req-05b6ccc8-9943-4fc3-888d-50b5d0f74140 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:14:35.926 1 WARNING oslo_config.cfg [req-05b6ccc8-9943-4fc3-888d-50b5d0f74140 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 00:14:35.927 1 WARNING oslo_config.cfg [req-05b6ccc8-9943-4fc3-888d-50b5d0f74140 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 00:14:35.930 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 00:14:35.935 1 INFO cinder.manager [req-4318875e-64fb-4344-b839-7f28960b042c - - - - -] Initiating service 5 cleanup
>2018-06-26 00:14:35.940 1 INFO cinder.manager [req-4318875e-64fb-4344-b839-7f28960b042c - - - - -] Service 5 cleanup completed.
>2018-06-26 00:16:48.003 1 ERROR oslo.messaging._drivers.impl_rabbit [req-4318875e-64fb-4344-b839-7f28960b042c - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:16:48.005 1 ERROR oslo.messaging._drivers.impl_rabbit [req-4318875e-64fb-4344-b839-7f28960b042c - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:16:48.006 1 ERROR oslo_service.service [req-4318875e-64fb-4344-b839-7f28960b042c - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:16:48.006 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 00:16:48.006 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 00:16:48.006 1 ERROR oslo_service.service     service.start()
>2018-06-26 00:16:48.006 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 00:16:48.006 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 00:16:48.006 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 00:16:48.006 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 00:16:48.006 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 00:16:48.006 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 00:16:48.006 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 00:16:48.006 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 00:16:48.006 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 00:16:48.006 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 00:16:48.006 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 00:16:48.006 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 00:16:48.006 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 00:16:48.006 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 00:16:48.006 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 00:16:48.006 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 00:16:48.006 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 00:16:48.006 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 00:16:48.006 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 00:16:48.006 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 00:16:48.006 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 00:16:48.006 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 00:16:48.006 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:16:48.006 1 ERROR oslo_service.service 
>2018-06-26 00:16:48.009 1 CRITICAL cinder [req-05b6ccc8-9943-4fc3-888d-50b5d0f74140 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 00:16:48.009 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 00:16:48.009 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 00:16:48.009 1 ERROR cinder     sys.exit(main())
>2018-06-26 00:16:48.009 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 00:16:48.009 1 ERROR cinder     service.wait()
>2018-06-26 00:16:48.009 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 00:16:48.009 1 ERROR cinder     _launcher.wait()
>2018-06-26 00:16:48.009 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 00:16:48.009 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 00:16:48.009 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 00:16:48.009 1 ERROR cinder     self.services.wait()
>2018-06-26 00:16:48.009 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 00:16:48.009 1 ERROR cinder     service.wait()
>2018-06-26 00:16:48.009 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 00:16:48.009 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 00:16:48.009 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 00:16:48.009 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 00:16:48.009 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 00:16:48.009 1 ERROR cinder     post_fn = fn()
>2018-06-26 00:16:48.009 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 00:16:48.009 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 00:16:48.009 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 00:16:48.009 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 00:16:48.009 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 00:16:48.009 1 ERROR cinder 
>2018-06-26 00:16:50.705 1 WARNING cinder.scheduler.host_manager [req-838da8b6-cb5d-4cc1-af70-e74d94ca7f66 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 00:16:50.712 1 INFO cinder.rpc [req-838da8b6-cb5d-4cc1-af70-e74d94ca7f66 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 00:16:50.718 1 INFO cinder.rpc [req-838da8b6-cb5d-4cc1-af70-e74d94ca7f66 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 00:16:50.729 1 INFO cinder.rpc [req-838da8b6-cb5d-4cc1-af70-e74d94ca7f66 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 00:16:50.736 1 INFO cinder.rpc [req-838da8b6-cb5d-4cc1-af70-e74d94ca7f66 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 00:16:50.774 1 WARNING oslo_config.cfg [req-838da8b6-cb5d-4cc1-af70-e74d94ca7f66 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 00:16:50.776 1 WARNING oslo_config.cfg [req-838da8b6-cb5d-4cc1-af70-e74d94ca7f66 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:16:50.777 1 WARNING oslo_config.cfg [req-838da8b6-cb5d-4cc1-af70-e74d94ca7f66 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:16:50.777 1 WARNING oslo_config.cfg [req-838da8b6-cb5d-4cc1-af70-e74d94ca7f66 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:16:50.782 1 WARNING oslo_config.cfg [req-838da8b6-cb5d-4cc1-af70-e74d94ca7f66 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 00:16:50.783 1 WARNING oslo_config.cfg [req-838da8b6-cb5d-4cc1-af70-e74d94ca7f66 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 00:16:50.786 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 00:16:50.795 1 INFO cinder.manager [req-9fca7fe7-ae3d-49e1-913e-14411323e61e - - - - -] Initiating service 5 cleanup
>2018-06-26 00:16:50.801 1 INFO cinder.manager [req-9fca7fe7-ae3d-49e1-913e-14411323e61e - - - - -] Service 5 cleanup completed.
>2018-06-26 00:18:57.001 1 ERROR oslo.messaging._drivers.impl_rabbit [req-9fca7fe7-ae3d-49e1-913e-14411323e61e - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:18:57.004 1 ERROR oslo.messaging._drivers.impl_rabbit [req-9fca7fe7-ae3d-49e1-913e-14411323e61e - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:18:57.004 1 ERROR oslo_service.service [req-9fca7fe7-ae3d-49e1-913e-14411323e61e - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:18:57.004 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 00:18:57.004 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 00:18:57.004 1 ERROR oslo_service.service     service.start()
>2018-06-26 00:18:57.004 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 00:18:57.004 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 00:18:57.004 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 00:18:57.004 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 00:18:57.004 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 00:18:57.004 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 00:18:57.004 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 00:18:57.004 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 00:18:57.004 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 00:18:57.004 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 00:18:57.004 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 00:18:57.004 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 00:18:57.004 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 00:18:57.004 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 00:18:57.004 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 00:18:57.004 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 00:18:57.004 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 00:18:57.004 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 00:18:57.004 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 00:18:57.004 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 00:18:57.004 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 00:18:57.004 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 00:18:57.004 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:18:57.004 1 ERROR oslo_service.service 
>2018-06-26 00:18:57.007 1 CRITICAL cinder [req-838da8b6-cb5d-4cc1-af70-e74d94ca7f66 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 00:18:57.007 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 00:18:57.007 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 00:18:57.007 1 ERROR cinder     sys.exit(main())
>2018-06-26 00:18:57.007 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 00:18:57.007 1 ERROR cinder     service.wait()
>2018-06-26 00:18:57.007 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 00:18:57.007 1 ERROR cinder     _launcher.wait()
>2018-06-26 00:18:57.007 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 00:18:57.007 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 00:18:57.007 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 00:18:57.007 1 ERROR cinder     self.services.wait()
>2018-06-26 00:18:57.007 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 00:18:57.007 1 ERROR cinder     service.wait()
>2018-06-26 00:18:57.007 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 00:18:57.007 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 00:18:57.007 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 00:18:57.007 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 00:18:57.007 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 00:18:57.007 1 ERROR cinder     post_fn = fn()
>2018-06-26 00:18:57.007 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 00:18:57.007 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 00:18:57.007 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 00:18:57.007 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 00:18:57.007 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 00:18:57.007 1 ERROR cinder 
>2018-06-26 00:18:59.637 1 WARNING cinder.scheduler.host_manager [req-a530b0a7-45f5-40a4-83ab-fd44a57e790d - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 00:18:59.643 1 INFO cinder.rpc [req-a530b0a7-45f5-40a4-83ab-fd44a57e790d - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 00:18:59.649 1 INFO cinder.rpc [req-a530b0a7-45f5-40a4-83ab-fd44a57e790d - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 00:18:59.660 1 INFO cinder.rpc [req-a530b0a7-45f5-40a4-83ab-fd44a57e790d - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 00:18:59.666 1 INFO cinder.rpc [req-a530b0a7-45f5-40a4-83ab-fd44a57e790d - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 00:18:59.689 1 WARNING oslo_config.cfg [req-a530b0a7-45f5-40a4-83ab-fd44a57e790d - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 00:18:59.692 1 WARNING oslo_config.cfg [req-a530b0a7-45f5-40a4-83ab-fd44a57e790d - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:18:59.692 1 WARNING oslo_config.cfg [req-a530b0a7-45f5-40a4-83ab-fd44a57e790d - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:18:59.693 1 WARNING oslo_config.cfg [req-a530b0a7-45f5-40a4-83ab-fd44a57e790d - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:18:59.700 1 WARNING oslo_config.cfg [req-a530b0a7-45f5-40a4-83ab-fd44a57e790d - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 00:18:59.701 1 WARNING oslo_config.cfg [req-a530b0a7-45f5-40a4-83ab-fd44a57e790d - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 00:18:59.704 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 00:18:59.711 1 INFO cinder.manager [req-da5ed2e4-6fa2-4560-bf88-d5c5a3b308b1 - - - - -] Initiating service 5 cleanup
>2018-06-26 00:18:59.716 1 INFO cinder.manager [req-da5ed2e4-6fa2-4560-bf88-d5c5a3b308b1 - - - - -] Service 5 cleanup completed.
>2018-06-26 00:21:04.026 1 ERROR oslo.messaging._drivers.impl_rabbit [req-da5ed2e4-6fa2-4560-bf88-d5c5a3b308b1 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:21:04.028 1 ERROR oslo.messaging._drivers.impl_rabbit [req-da5ed2e4-6fa2-4560-bf88-d5c5a3b308b1 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:21:04.028 1 ERROR oslo_service.service [req-da5ed2e4-6fa2-4560-bf88-d5c5a3b308b1 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:21:04.028 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 00:21:04.028 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 00:21:04.028 1 ERROR oslo_service.service     service.start()
>2018-06-26 00:21:04.028 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 00:21:04.028 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 00:21:04.028 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 00:21:04.028 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 00:21:04.028 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 00:21:04.028 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 00:21:04.028 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 00:21:04.028 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 00:21:04.028 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 00:21:04.028 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 00:21:04.028 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 00:21:04.028 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 00:21:04.028 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 00:21:04.028 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 00:21:04.028 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 00:21:04.028 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 00:21:04.028 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 00:21:04.028 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 00:21:04.028 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 00:21:04.028 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 00:21:04.028 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 00:21:04.028 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 00:21:04.028 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:21:04.028 1 ERROR oslo_service.service 
>2018-06-26 00:21:04.032 1 CRITICAL cinder [req-a530b0a7-45f5-40a4-83ab-fd44a57e790d - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 00:21:04.032 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 00:21:04.032 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 00:21:04.032 1 ERROR cinder     sys.exit(main())
>2018-06-26 00:21:04.032 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 00:21:04.032 1 ERROR cinder     service.wait()
>2018-06-26 00:21:04.032 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 00:21:04.032 1 ERROR cinder     _launcher.wait()
>2018-06-26 00:21:04.032 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 00:21:04.032 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 00:21:04.032 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 00:21:04.032 1 ERROR cinder     self.services.wait()
>2018-06-26 00:21:04.032 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 00:21:04.032 1 ERROR cinder     service.wait()
>2018-06-26 00:21:04.032 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 00:21:04.032 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 00:21:04.032 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 00:21:04.032 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 00:21:04.032 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 00:21:04.032 1 ERROR cinder     post_fn = fn()
>2018-06-26 00:21:04.032 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 00:21:04.032 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 00:21:04.032 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 00:21:04.032 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 00:21:04.032 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 00:21:04.032 1 ERROR cinder 
>2018-06-26 00:21:06.722 1 WARNING cinder.scheduler.host_manager [req-4dd8ed83-e4c9-41ff-a49c-e53b846e239d - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 00:21:06.730 1 INFO cinder.rpc [req-4dd8ed83-e4c9-41ff-a49c-e53b846e239d - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 00:21:06.736 1 INFO cinder.rpc [req-4dd8ed83-e4c9-41ff-a49c-e53b846e239d - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 00:21:06.760 1 INFO cinder.rpc [req-4dd8ed83-e4c9-41ff-a49c-e53b846e239d - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 00:21:06.766 1 INFO cinder.rpc [req-4dd8ed83-e4c9-41ff-a49c-e53b846e239d - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 00:21:06.793 1 WARNING oslo_config.cfg [req-4dd8ed83-e4c9-41ff-a49c-e53b846e239d - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 00:21:06.795 1 WARNING oslo_config.cfg [req-4dd8ed83-e4c9-41ff-a49c-e53b846e239d - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:21:06.796 1 WARNING oslo_config.cfg [req-4dd8ed83-e4c9-41ff-a49c-e53b846e239d - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:21:06.797 1 WARNING oslo_config.cfg [req-4dd8ed83-e4c9-41ff-a49c-e53b846e239d - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:21:06.802 1 WARNING oslo_config.cfg [req-4dd8ed83-e4c9-41ff-a49c-e53b846e239d - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 00:21:06.803 1 WARNING oslo_config.cfg [req-4dd8ed83-e4c9-41ff-a49c-e53b846e239d - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 00:21:06.806 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 00:21:06.813 1 INFO cinder.manager [req-55603d54-437c-4e60-8ac3-5bdeefc85108 - - - - -] Initiating service 5 cleanup
>2018-06-26 00:21:06.818 1 INFO cinder.manager [req-55603d54-437c-4e60-8ac3-5bdeefc85108 - - - - -] Service 5 cleanup completed.
>2018-06-26 00:23:11.078 1 ERROR oslo.messaging._drivers.impl_rabbit [req-55603d54-437c-4e60-8ac3-5bdeefc85108 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:23:11.081 1 ERROR oslo.messaging._drivers.impl_rabbit [req-55603d54-437c-4e60-8ac3-5bdeefc85108 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:23:11.081 1 ERROR oslo_service.service [req-55603d54-437c-4e60-8ac3-5bdeefc85108 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:23:11.081 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 00:23:11.081 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 00:23:11.081 1 ERROR oslo_service.service     service.start()
>2018-06-26 00:23:11.081 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 00:23:11.081 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 00:23:11.081 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 00:23:11.081 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 00:23:11.081 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 00:23:11.081 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 00:23:11.081 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 00:23:11.081 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 00:23:11.081 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 00:23:11.081 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 00:23:11.081 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 00:23:11.081 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 00:23:11.081 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 00:23:11.081 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 00:23:11.081 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 00:23:11.081 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 00:23:11.081 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 00:23:11.081 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 00:23:11.081 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 00:23:11.081 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 00:23:11.081 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 00:23:11.081 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 00:23:11.081 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:23:11.081 1 ERROR oslo_service.service 
>2018-06-26 00:23:11.085 1 CRITICAL cinder [req-4dd8ed83-e4c9-41ff-a49c-e53b846e239d - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 00:23:11.085 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 00:23:11.085 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 00:23:11.085 1 ERROR cinder     sys.exit(main())
>2018-06-26 00:23:11.085 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 00:23:11.085 1 ERROR cinder     service.wait()
>2018-06-26 00:23:11.085 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 00:23:11.085 1 ERROR cinder     _launcher.wait()
>2018-06-26 00:23:11.085 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 00:23:11.085 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 00:23:11.085 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 00:23:11.085 1 ERROR cinder     self.services.wait()
>2018-06-26 00:23:11.085 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 00:23:11.085 1 ERROR cinder     service.wait()
>2018-06-26 00:23:11.085 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 00:23:11.085 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 00:23:11.085 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 00:23:11.085 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 00:23:11.085 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 00:23:11.085 1 ERROR cinder     post_fn = fn()
>2018-06-26 00:23:11.085 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 00:23:11.085 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 00:23:11.085 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 00:23:11.085 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 00:23:11.085 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 00:23:11.085 1 ERROR cinder 
>2018-06-26 00:23:13.801 1 WARNING cinder.scheduler.host_manager [req-c9495fb5-5232-4d54-bf35-71ef8aa074c0 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 00:23:13.807 1 INFO cinder.rpc [req-c9495fb5-5232-4d54-bf35-71ef8aa074c0 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 00:23:13.816 1 INFO cinder.rpc [req-c9495fb5-5232-4d54-bf35-71ef8aa074c0 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 00:23:13.832 1 INFO cinder.rpc [req-c9495fb5-5232-4d54-bf35-71ef8aa074c0 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 00:23:13.837 1 INFO cinder.rpc [req-c9495fb5-5232-4d54-bf35-71ef8aa074c0 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 00:23:13.872 1 WARNING oslo_config.cfg [req-c9495fb5-5232-4d54-bf35-71ef8aa074c0 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 00:23:13.874 1 WARNING oslo_config.cfg [req-c9495fb5-5232-4d54-bf35-71ef8aa074c0 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:23:13.875 1 WARNING oslo_config.cfg [req-c9495fb5-5232-4d54-bf35-71ef8aa074c0 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:23:13.875 1 WARNING oslo_config.cfg [req-c9495fb5-5232-4d54-bf35-71ef8aa074c0 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:23:13.880 1 WARNING oslo_config.cfg [req-c9495fb5-5232-4d54-bf35-71ef8aa074c0 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 00:23:13.881 1 WARNING oslo_config.cfg [req-c9495fb5-5232-4d54-bf35-71ef8aa074c0 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 00:23:13.884 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 00:23:13.890 1 INFO cinder.manager [req-81ceba3e-c707-4ab0-85a1-18c79d9e41d0 - - - - -] Initiating service 5 cleanup
>2018-06-26 00:23:13.896 1 INFO cinder.manager [req-81ceba3e-c707-4ab0-85a1-18c79d9e41d0 - - - - -] Service 5 cleanup completed.
>2018-06-26 00:25:25.866 1 ERROR oslo.messaging._drivers.impl_rabbit [req-81ceba3e-c707-4ab0-85a1-18c79d9e41d0 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:25:25.868 1 ERROR oslo.messaging._drivers.impl_rabbit [req-81ceba3e-c707-4ab0-85a1-18c79d9e41d0 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:25:25.868 1 ERROR oslo_service.service [req-81ceba3e-c707-4ab0-85a1-18c79d9e41d0 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:25:25.868 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 00:25:25.868 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 00:25:25.868 1 ERROR oslo_service.service     service.start()
>2018-06-26 00:25:25.868 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 00:25:25.868 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 00:25:25.868 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 00:25:25.868 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 00:25:25.868 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 00:25:25.868 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 00:25:25.868 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 00:25:25.868 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 00:25:25.868 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 00:25:25.868 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 00:25:25.868 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 00:25:25.868 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 00:25:25.868 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 00:25:25.868 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 00:25:25.868 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 00:25:25.868 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 00:25:25.868 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 00:25:25.868 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 00:25:25.868 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 00:25:25.868 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 00:25:25.868 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 00:25:25.868 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 00:25:25.868 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:25:25.868 1 ERROR oslo_service.service 
>2018-06-26 00:25:25.871 1 CRITICAL cinder [req-c9495fb5-5232-4d54-bf35-71ef8aa074c0 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 00:25:25.871 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 00:25:25.871 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 00:25:25.871 1 ERROR cinder     sys.exit(main())
>2018-06-26 00:25:25.871 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 00:25:25.871 1 ERROR cinder     service.wait()
>2018-06-26 00:25:25.871 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 00:25:25.871 1 ERROR cinder     _launcher.wait()
>2018-06-26 00:25:25.871 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 00:25:25.871 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 00:25:25.871 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 00:25:25.871 1 ERROR cinder     self.services.wait()
>2018-06-26 00:25:25.871 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 00:25:25.871 1 ERROR cinder     service.wait()
>2018-06-26 00:25:25.871 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 00:25:25.871 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 00:25:25.871 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 00:25:25.871 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 00:25:25.871 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 00:25:25.871 1 ERROR cinder     post_fn = fn()
>2018-06-26 00:25:25.871 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 00:25:25.871 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 00:25:25.871 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 00:25:25.871 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 00:25:25.871 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 00:25:25.871 1 ERROR cinder 
>2018-06-26 00:25:28.544 1 WARNING cinder.scheduler.host_manager [req-ff24dcc9-60c1-43d4-a6af-b8962204cba2 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 00:25:28.550 1 INFO cinder.rpc [req-ff24dcc9-60c1-43d4-a6af-b8962204cba2 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 00:25:28.555 1 INFO cinder.rpc [req-ff24dcc9-60c1-43d4-a6af-b8962204cba2 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 00:25:28.567 1 INFO cinder.rpc [req-ff24dcc9-60c1-43d4-a6af-b8962204cba2 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 00:25:28.573 1 INFO cinder.rpc [req-ff24dcc9-60c1-43d4-a6af-b8962204cba2 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 00:25:28.600 1 WARNING oslo_config.cfg [req-ff24dcc9-60c1-43d4-a6af-b8962204cba2 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 00:25:28.602 1 WARNING oslo_config.cfg [req-ff24dcc9-60c1-43d4-a6af-b8962204cba2 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:25:28.603 1 WARNING oslo_config.cfg [req-ff24dcc9-60c1-43d4-a6af-b8962204cba2 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:25:28.603 1 WARNING oslo_config.cfg [req-ff24dcc9-60c1-43d4-a6af-b8962204cba2 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:25:28.609 1 WARNING oslo_config.cfg [req-ff24dcc9-60c1-43d4-a6af-b8962204cba2 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 00:25:28.610 1 WARNING oslo_config.cfg [req-ff24dcc9-60c1-43d4-a6af-b8962204cba2 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 00:25:28.613 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 00:25:28.619 1 INFO cinder.manager [req-6a19c2c2-b0d7-4785-b179-ae92edde3c08 - - - - -] Initiating service 5 cleanup
>2018-06-26 00:25:28.623 1 INFO cinder.manager [req-6a19c2c2-b0d7-4785-b179-ae92edde3c08 - - - - -] Service 5 cleanup completed.
>2018-06-26 00:27:35.099 1 ERROR oslo.messaging._drivers.impl_rabbit [req-6a19c2c2-b0d7-4785-b179-ae92edde3c08 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:27:35.100 1 ERROR oslo.messaging._drivers.impl_rabbit [req-6a19c2c2-b0d7-4785-b179-ae92edde3c08 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:27:35.101 1 ERROR oslo_service.service [req-6a19c2c2-b0d7-4785-b179-ae92edde3c08 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:27:35.101 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 00:27:35.101 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 00:27:35.101 1 ERROR oslo_service.service     service.start()
>2018-06-26 00:27:35.101 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 00:27:35.101 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 00:27:35.101 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 00:27:35.101 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 00:27:35.101 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 00:27:35.101 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 00:27:35.101 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 00:27:35.101 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 00:27:35.101 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 00:27:35.101 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 00:27:35.101 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 00:27:35.101 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 00:27:35.101 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 00:27:35.101 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 00:27:35.101 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 00:27:35.101 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 00:27:35.101 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 00:27:35.101 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 00:27:35.101 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 00:27:35.101 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 00:27:35.101 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 00:27:35.101 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 00:27:35.101 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:27:35.101 1 ERROR oslo_service.service 
>2018-06-26 00:27:35.104 1 CRITICAL cinder [req-ff24dcc9-60c1-43d4-a6af-b8962204cba2 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 00:27:35.104 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 00:27:35.104 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 00:27:35.104 1 ERROR cinder     sys.exit(main())
>2018-06-26 00:27:35.104 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 00:27:35.104 1 ERROR cinder     service.wait()
>2018-06-26 00:27:35.104 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 00:27:35.104 1 ERROR cinder     _launcher.wait()
>2018-06-26 00:27:35.104 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 00:27:35.104 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 00:27:35.104 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 00:27:35.104 1 ERROR cinder     self.services.wait()
>2018-06-26 00:27:35.104 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 00:27:35.104 1 ERROR cinder     service.wait()
>2018-06-26 00:27:35.104 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 00:27:35.104 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 00:27:35.104 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 00:27:35.104 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 00:27:35.104 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 00:27:35.104 1 ERROR cinder     post_fn = fn()
>2018-06-26 00:27:35.104 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 00:27:35.104 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 00:27:35.104 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 00:27:35.104 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 00:27:35.104 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 00:27:35.104 1 ERROR cinder 
>2018-06-26 00:27:37.846 1 WARNING cinder.scheduler.host_manager [req-0e9b39f2-e87c-4281-b56f-82a0349c64c0 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 00:27:37.854 1 INFO cinder.rpc [req-0e9b39f2-e87c-4281-b56f-82a0349c64c0 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 00:27:37.860 1 INFO cinder.rpc [req-0e9b39f2-e87c-4281-b56f-82a0349c64c0 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 00:27:37.873 1 INFO cinder.rpc [req-0e9b39f2-e87c-4281-b56f-82a0349c64c0 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 00:27:37.880 1 INFO cinder.rpc [req-0e9b39f2-e87c-4281-b56f-82a0349c64c0 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 00:27:37.907 1 WARNING oslo_config.cfg [req-0e9b39f2-e87c-4281-b56f-82a0349c64c0 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 00:27:37.909 1 WARNING oslo_config.cfg [req-0e9b39f2-e87c-4281-b56f-82a0349c64c0 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:27:37.910 1 WARNING oslo_config.cfg [req-0e9b39f2-e87c-4281-b56f-82a0349c64c0 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:27:37.910 1 WARNING oslo_config.cfg [req-0e9b39f2-e87c-4281-b56f-82a0349c64c0 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:27:37.915 1 WARNING oslo_config.cfg [req-0e9b39f2-e87c-4281-b56f-82a0349c64c0 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 00:27:37.916 1 WARNING oslo_config.cfg [req-0e9b39f2-e87c-4281-b56f-82a0349c64c0 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 00:27:37.919 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 00:27:37.925 1 INFO cinder.manager [req-1ec93663-566d-415e-9585-262ac2553de8 - - - - -] Initiating service 5 cleanup
>2018-06-26 00:27:37.930 1 INFO cinder.manager [req-1ec93663-566d-415e-9585-262ac2553de8 - - - - -] Service 5 cleanup completed.
>2018-06-26 00:29:50.275 1 ERROR oslo.messaging._drivers.impl_rabbit [req-1ec93663-566d-415e-9585-262ac2553de8 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:29:50.277 1 ERROR oslo.messaging._drivers.impl_rabbit [req-1ec93663-566d-415e-9585-262ac2553de8 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:29:50.277 1 ERROR oslo_service.service [req-1ec93663-566d-415e-9585-262ac2553de8 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:29:50.277 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 00:29:50.277 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 00:29:50.277 1 ERROR oslo_service.service     service.start()
>2018-06-26 00:29:50.277 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 00:29:50.277 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 00:29:50.277 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 00:29:50.277 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 00:29:50.277 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 00:29:50.277 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 00:29:50.277 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 00:29:50.277 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 00:29:50.277 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 00:29:50.277 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 00:29:50.277 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 00:29:50.277 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 00:29:50.277 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 00:29:50.277 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 00:29:50.277 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 00:29:50.277 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 00:29:50.277 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 00:29:50.277 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 00:29:50.277 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 00:29:50.277 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 00:29:50.277 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 00:29:50.277 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 00:29:50.277 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:29:50.277 1 ERROR oslo_service.service 
>2018-06-26 00:29:50.281 1 CRITICAL cinder [req-0e9b39f2-e87c-4281-b56f-82a0349c64c0 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 00:29:50.281 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 00:29:50.281 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 00:29:50.281 1 ERROR cinder     sys.exit(main())
>2018-06-26 00:29:50.281 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 00:29:50.281 1 ERROR cinder     service.wait()
>2018-06-26 00:29:50.281 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 00:29:50.281 1 ERROR cinder     _launcher.wait()
>2018-06-26 00:29:50.281 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 00:29:50.281 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 00:29:50.281 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 00:29:50.281 1 ERROR cinder     self.services.wait()
>2018-06-26 00:29:50.281 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 00:29:50.281 1 ERROR cinder     service.wait()
>2018-06-26 00:29:50.281 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 00:29:50.281 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 00:29:50.281 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 00:29:50.281 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 00:29:50.281 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 00:29:50.281 1 ERROR cinder     post_fn = fn()
>2018-06-26 00:29:50.281 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 00:29:50.281 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 00:29:50.281 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 00:29:50.281 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 00:29:50.281 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 00:29:50.281 1 ERROR cinder 
>2018-06-26 00:29:52.927 1 WARNING cinder.scheduler.host_manager [req-95d437fe-a304-44d3-8de9-f20d2784319b - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 00:29:52.934 1 INFO cinder.rpc [req-95d437fe-a304-44d3-8de9-f20d2784319b - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 00:29:52.939 1 INFO cinder.rpc [req-95d437fe-a304-44d3-8de9-f20d2784319b - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 00:29:52.951 1 INFO cinder.rpc [req-95d437fe-a304-44d3-8de9-f20d2784319b - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 00:29:52.957 1 INFO cinder.rpc [req-95d437fe-a304-44d3-8de9-f20d2784319b - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 00:29:52.979 1 WARNING oslo_config.cfg [req-95d437fe-a304-44d3-8de9-f20d2784319b - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 00:29:52.981 1 WARNING oslo_config.cfg [req-95d437fe-a304-44d3-8de9-f20d2784319b - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:29:52.982 1 WARNING oslo_config.cfg [req-95d437fe-a304-44d3-8de9-f20d2784319b - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:29:52.982 1 WARNING oslo_config.cfg [req-95d437fe-a304-44d3-8de9-f20d2784319b - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:29:52.988 1 WARNING oslo_config.cfg [req-95d437fe-a304-44d3-8de9-f20d2784319b - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 00:29:52.989 1 WARNING oslo_config.cfg [req-95d437fe-a304-44d3-8de9-f20d2784319b - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 00:29:52.992 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 00:29:53.000 1 INFO cinder.manager [req-c30c6440-7b47-4a10-9d30-4ce4207cc5ea - - - - -] Initiating service 5 cleanup
>2018-06-26 00:29:53.008 1 INFO cinder.manager [req-c30c6440-7b47-4a10-9d30-4ce4207cc5ea - - - - -] Service 5 cleanup completed.
>2018-06-26 00:31:57.527 1 ERROR oslo.messaging._drivers.impl_rabbit [req-c30c6440-7b47-4a10-9d30-4ce4207cc5ea - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:31:57.557 1 ERROR oslo.messaging._drivers.impl_rabbit [req-c30c6440-7b47-4a10-9d30-4ce4207cc5ea - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:31:57.558 1 ERROR oslo_service.service [req-c30c6440-7b47-4a10-9d30-4ce4207cc5ea - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:31:57.558 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 00:31:57.558 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 00:31:57.558 1 ERROR oslo_service.service     service.start()
>2018-06-26 00:31:57.558 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 00:31:57.558 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 00:31:57.558 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 00:31:57.558 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 00:31:57.558 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 00:31:57.558 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 00:31:57.558 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 00:31:57.558 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 00:31:57.558 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 00:31:57.558 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 00:31:57.558 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 00:31:57.558 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 00:31:57.558 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 00:31:57.558 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 00:31:57.558 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 00:31:57.558 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 00:31:57.558 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 00:31:57.558 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 00:31:57.558 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 00:31:57.558 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 00:31:57.558 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 00:31:57.558 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 00:31:57.558 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:31:57.558 1 ERROR oslo_service.service 
>2018-06-26 00:31:57.561 1 CRITICAL cinder [req-95d437fe-a304-44d3-8de9-f20d2784319b - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 00:31:57.561 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 00:31:57.561 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 00:31:57.561 1 ERROR cinder     sys.exit(main())
>2018-06-26 00:31:57.561 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 00:31:57.561 1 ERROR cinder     service.wait()
>2018-06-26 00:31:57.561 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 00:31:57.561 1 ERROR cinder     _launcher.wait()
>2018-06-26 00:31:57.561 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 00:31:57.561 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 00:31:57.561 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 00:31:57.561 1 ERROR cinder     self.services.wait()
>2018-06-26 00:31:57.561 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 00:31:57.561 1 ERROR cinder     service.wait()
>2018-06-26 00:31:57.561 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 00:31:57.561 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 00:31:57.561 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 00:31:57.561 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 00:31:57.561 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 00:31:57.561 1 ERROR cinder     post_fn = fn()
>2018-06-26 00:31:57.561 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 00:31:57.561 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 00:31:57.561 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 00:31:57.561 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 00:31:57.561 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 00:31:57.561 1 ERROR cinder 
>2018-06-26 00:32:00.474 1 WARNING cinder.scheduler.host_manager [req-7f6256d6-5ebf-4b01-b5e6-6aa122a27371 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 00:32:00.483 1 INFO cinder.rpc [req-7f6256d6-5ebf-4b01-b5e6-6aa122a27371 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 00:32:00.493 1 INFO cinder.rpc [req-7f6256d6-5ebf-4b01-b5e6-6aa122a27371 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 00:32:00.516 1 INFO cinder.rpc [req-7f6256d6-5ebf-4b01-b5e6-6aa122a27371 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 00:32:00.532 1 INFO cinder.rpc [req-7f6256d6-5ebf-4b01-b5e6-6aa122a27371 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 00:32:00.556 1 WARNING oslo_config.cfg [req-7f6256d6-5ebf-4b01-b5e6-6aa122a27371 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 00:32:00.559 1 WARNING oslo_config.cfg [req-7f6256d6-5ebf-4b01-b5e6-6aa122a27371 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:32:00.559 1 WARNING oslo_config.cfg [req-7f6256d6-5ebf-4b01-b5e6-6aa122a27371 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:32:00.560 1 WARNING oslo_config.cfg [req-7f6256d6-5ebf-4b01-b5e6-6aa122a27371 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:32:00.565 1 WARNING oslo_config.cfg [req-7f6256d6-5ebf-4b01-b5e6-6aa122a27371 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 00:32:00.566 1 WARNING oslo_config.cfg [req-7f6256d6-5ebf-4b01-b5e6-6aa122a27371 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 00:32:00.569 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 00:32:00.575 1 INFO cinder.manager [req-975b4732-6a6f-456d-a7c3-b3602aacf769 - - - - -] Initiating service 5 cleanup
>2018-06-26 00:32:00.585 1 INFO cinder.manager [req-975b4732-6a6f-456d-a7c3-b3602aacf769 - - - - -] Service 5 cleanup completed.
>2018-06-26 00:34:12.571 1 ERROR oslo.messaging._drivers.impl_rabbit [req-975b4732-6a6f-456d-a7c3-b3602aacf769 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:34:12.574 1 ERROR oslo.messaging._drivers.impl_rabbit [req-975b4732-6a6f-456d-a7c3-b3602aacf769 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:34:12.575 1 ERROR oslo_service.service [req-975b4732-6a6f-456d-a7c3-b3602aacf769 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:34:12.575 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 00:34:12.575 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 00:34:12.575 1 ERROR oslo_service.service     service.start()
>2018-06-26 00:34:12.575 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 00:34:12.575 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 00:34:12.575 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 00:34:12.575 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 00:34:12.575 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 00:34:12.575 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 00:34:12.575 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 00:34:12.575 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 00:34:12.575 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 00:34:12.575 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 00:34:12.575 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 00:34:12.575 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 00:34:12.575 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 00:34:12.575 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 00:34:12.575 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 00:34:12.575 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 00:34:12.575 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 00:34:12.575 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 00:34:12.575 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 00:34:12.575 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 00:34:12.575 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 00:34:12.575 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 00:34:12.575 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:34:12.575 1 ERROR oslo_service.service 
>2018-06-26 00:34:12.578 1 CRITICAL cinder [req-7f6256d6-5ebf-4b01-b5e6-6aa122a27371 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 00:34:12.578 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 00:34:12.578 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 00:34:12.578 1 ERROR cinder     sys.exit(main())
>2018-06-26 00:34:12.578 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 00:34:12.578 1 ERROR cinder     service.wait()
>2018-06-26 00:34:12.578 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 00:34:12.578 1 ERROR cinder     _launcher.wait()
>2018-06-26 00:34:12.578 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 00:34:12.578 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 00:34:12.578 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 00:34:12.578 1 ERROR cinder     self.services.wait()
>2018-06-26 00:34:12.578 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 00:34:12.578 1 ERROR cinder     service.wait()
>2018-06-26 00:34:12.578 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 00:34:12.578 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 00:34:12.578 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 00:34:12.578 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 00:34:12.578 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 00:34:12.578 1 ERROR cinder     post_fn = fn()
>2018-06-26 00:34:12.578 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 00:34:12.578 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 00:34:12.578 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 00:34:12.578 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 00:34:12.578 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 00:34:12.578 1 ERROR cinder 
>2018-06-26 00:34:15.244 1 WARNING cinder.scheduler.host_manager [req-b917e265-ffe4-4f8d-9c03-3d7707e169e6 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 00:34:15.251 1 INFO cinder.rpc [req-b917e265-ffe4-4f8d-9c03-3d7707e169e6 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 00:34:15.256 1 INFO cinder.rpc [req-b917e265-ffe4-4f8d-9c03-3d7707e169e6 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 00:34:15.270 1 INFO cinder.rpc [req-b917e265-ffe4-4f8d-9c03-3d7707e169e6 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 00:34:15.275 1 INFO cinder.rpc [req-b917e265-ffe4-4f8d-9c03-3d7707e169e6 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 00:34:15.301 1 WARNING oslo_config.cfg [req-b917e265-ffe4-4f8d-9c03-3d7707e169e6 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 00:34:15.303 1 WARNING oslo_config.cfg [req-b917e265-ffe4-4f8d-9c03-3d7707e169e6 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:34:15.303 1 WARNING oslo_config.cfg [req-b917e265-ffe4-4f8d-9c03-3d7707e169e6 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:34:15.304 1 WARNING oslo_config.cfg [req-b917e265-ffe4-4f8d-9c03-3d7707e169e6 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:34:15.309 1 WARNING oslo_config.cfg [req-b917e265-ffe4-4f8d-9c03-3d7707e169e6 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 00:34:15.312 1 WARNING oslo_config.cfg [req-b917e265-ffe4-4f8d-9c03-3d7707e169e6 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 00:34:15.316 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 00:34:15.329 1 INFO cinder.manager [req-27835e41-53d0-4e8f-bd24-0cc5a3026b53 - - - - -] Initiating service 5 cleanup
>2018-06-26 00:34:15.334 1 INFO cinder.manager [req-27835e41-53d0-4e8f-bd24-0cc5a3026b53 - - - - -] Service 5 cleanup completed.
>2018-06-26 00:36:27.723 1 ERROR oslo.messaging._drivers.impl_rabbit [req-27835e41-53d0-4e8f-bd24-0cc5a3026b53 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:36:27.725 1 ERROR oslo.messaging._drivers.impl_rabbit [req-27835e41-53d0-4e8f-bd24-0cc5a3026b53 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:36:27.725 1 ERROR oslo_service.service [req-27835e41-53d0-4e8f-bd24-0cc5a3026b53 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:36:27.725 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 00:36:27.725 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 00:36:27.725 1 ERROR oslo_service.service     service.start()
>2018-06-26 00:36:27.725 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 00:36:27.725 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 00:36:27.725 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 00:36:27.725 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 00:36:27.725 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 00:36:27.725 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 00:36:27.725 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 00:36:27.725 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 00:36:27.725 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 00:36:27.725 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 00:36:27.725 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 00:36:27.725 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 00:36:27.725 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 00:36:27.725 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 00:36:27.725 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 00:36:27.725 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 00:36:27.725 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 00:36:27.725 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 00:36:27.725 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 00:36:27.725 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 00:36:27.725 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 00:36:27.725 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 00:36:27.725 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:36:27.725 1 ERROR oslo_service.service 
>2018-06-26 00:36:27.728 1 CRITICAL cinder [req-b917e265-ffe4-4f8d-9c03-3d7707e169e6 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 00:36:27.728 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 00:36:27.728 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 00:36:27.728 1 ERROR cinder     sys.exit(main())
>2018-06-26 00:36:27.728 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 00:36:27.728 1 ERROR cinder     service.wait()
>2018-06-26 00:36:27.728 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 00:36:27.728 1 ERROR cinder     _launcher.wait()
>2018-06-26 00:36:27.728 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 00:36:27.728 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 00:36:27.728 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 00:36:27.728 1 ERROR cinder     self.services.wait()
>2018-06-26 00:36:27.728 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 00:36:27.728 1 ERROR cinder     service.wait()
>2018-06-26 00:36:27.728 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 00:36:27.728 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 00:36:27.728 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 00:36:27.728 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 00:36:27.728 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 00:36:27.728 1 ERROR cinder     post_fn = fn()
>2018-06-26 00:36:27.728 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 00:36:27.728 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 00:36:27.728 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 00:36:27.728 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 00:36:27.728 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 00:36:27.728 1 ERROR cinder 
>2018-06-26 00:36:30.299 1 WARNING cinder.scheduler.host_manager [req-9187e670-a97a-473e-ac5c-af72b80c1f01 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 00:36:30.305 1 INFO cinder.rpc [req-9187e670-a97a-473e-ac5c-af72b80c1f01 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 00:36:30.310 1 INFO cinder.rpc [req-9187e670-a97a-473e-ac5c-af72b80c1f01 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 00:36:30.320 1 INFO cinder.rpc [req-9187e670-a97a-473e-ac5c-af72b80c1f01 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 00:36:30.326 1 INFO cinder.rpc [req-9187e670-a97a-473e-ac5c-af72b80c1f01 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 00:36:30.350 1 WARNING oslo_config.cfg [req-9187e670-a97a-473e-ac5c-af72b80c1f01 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 00:36:30.352 1 WARNING oslo_config.cfg [req-9187e670-a97a-473e-ac5c-af72b80c1f01 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:36:30.352 1 WARNING oslo_config.cfg [req-9187e670-a97a-473e-ac5c-af72b80c1f01 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:36:30.353 1 WARNING oslo_config.cfg [req-9187e670-a97a-473e-ac5c-af72b80c1f01 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:36:30.358 1 WARNING oslo_config.cfg [req-9187e670-a97a-473e-ac5c-af72b80c1f01 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 00:36:30.359 1 WARNING oslo_config.cfg [req-9187e670-a97a-473e-ac5c-af72b80c1f01 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 00:36:30.362 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 00:36:30.369 1 INFO cinder.manager [req-4b66ac2b-6607-4099-ae42-f93ffce54940 - - - - -] Initiating service 5 cleanup
>2018-06-26 00:36:30.374 1 INFO cinder.manager [req-4b66ac2b-6607-4099-ae42-f93ffce54940 - - - - -] Service 5 cleanup completed.
>2018-06-26 00:38:42.493 1 ERROR oslo.messaging._drivers.impl_rabbit [req-4b66ac2b-6607-4099-ae42-f93ffce54940 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:38:42.495 1 ERROR oslo.messaging._drivers.impl_rabbit [req-4b66ac2b-6607-4099-ae42-f93ffce54940 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:38:42.495 1 ERROR oslo_service.service [req-4b66ac2b-6607-4099-ae42-f93ffce54940 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:38:42.495 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 00:38:42.495 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 00:38:42.495 1 ERROR oslo_service.service     service.start()
>2018-06-26 00:38:42.495 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 00:38:42.495 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 00:38:42.495 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 00:38:42.495 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 00:38:42.495 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 00:38:42.495 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 00:38:42.495 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 00:38:42.495 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 00:38:42.495 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 00:38:42.495 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 00:38:42.495 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 00:38:42.495 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 00:38:42.495 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 00:38:42.495 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 00:38:42.495 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 00:38:42.495 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 00:38:42.495 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 00:38:42.495 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 00:38:42.495 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 00:38:42.495 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 00:38:42.495 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 00:38:42.495 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 00:38:42.495 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:38:42.495 1 ERROR oslo_service.service 
>2018-06-26 00:38:42.498 1 CRITICAL cinder [req-9187e670-a97a-473e-ac5c-af72b80c1f01 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 00:38:42.498 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 00:38:42.498 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 00:38:42.498 1 ERROR cinder     sys.exit(main())
>2018-06-26 00:38:42.498 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 00:38:42.498 1 ERROR cinder     service.wait()
>2018-06-26 00:38:42.498 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 00:38:42.498 1 ERROR cinder     _launcher.wait()
>2018-06-26 00:38:42.498 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 00:38:42.498 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 00:38:42.498 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 00:38:42.498 1 ERROR cinder     self.services.wait()
>2018-06-26 00:38:42.498 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 00:38:42.498 1 ERROR cinder     service.wait()
>2018-06-26 00:38:42.498 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 00:38:42.498 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 00:38:42.498 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 00:38:42.498 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 00:38:42.498 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 00:38:42.498 1 ERROR cinder     post_fn = fn()
>2018-06-26 00:38:42.498 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 00:38:42.498 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 00:38:42.498 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 00:38:42.498 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 00:38:42.498 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 00:38:42.498 1 ERROR cinder 
>2018-06-26 00:38:45.155 1 WARNING cinder.scheduler.host_manager [req-fb4978ce-aa77-40f5-ab77-5c6d9ff66e47 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 00:38:45.161 1 INFO cinder.rpc [req-fb4978ce-aa77-40f5-ab77-5c6d9ff66e47 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 00:38:45.167 1 INFO cinder.rpc [req-fb4978ce-aa77-40f5-ab77-5c6d9ff66e47 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 00:38:45.183 1 INFO cinder.rpc [req-fb4978ce-aa77-40f5-ab77-5c6d9ff66e47 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 00:38:45.192 1 INFO cinder.rpc [req-fb4978ce-aa77-40f5-ab77-5c6d9ff66e47 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 00:38:45.221 1 WARNING oslo_config.cfg [req-fb4978ce-aa77-40f5-ab77-5c6d9ff66e47 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 00:38:45.223 1 WARNING oslo_config.cfg [req-fb4978ce-aa77-40f5-ab77-5c6d9ff66e47 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:38:45.224 1 WARNING oslo_config.cfg [req-fb4978ce-aa77-40f5-ab77-5c6d9ff66e47 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:38:45.225 1 WARNING oslo_config.cfg [req-fb4978ce-aa77-40f5-ab77-5c6d9ff66e47 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:38:45.230 1 WARNING oslo_config.cfg [req-fb4978ce-aa77-40f5-ab77-5c6d9ff66e47 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 00:38:45.231 1 WARNING oslo_config.cfg [req-fb4978ce-aa77-40f5-ab77-5c6d9ff66e47 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 00:38:45.234 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 00:38:45.241 1 INFO cinder.manager [req-e4d7a7a1-24b5-43bf-bfd3-67caff2fa7fe - - - - -] Initiating service 5 cleanup
>2018-06-26 00:38:45.246 1 INFO cinder.manager [req-e4d7a7a1-24b5-43bf-bfd3-67caff2fa7fe - - - - -] Service 5 cleanup completed.
>2018-06-26 00:40:49.598 1 ERROR oslo.messaging._drivers.impl_rabbit [req-e4d7a7a1-24b5-43bf-bfd3-67caff2fa7fe - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:40:49.601 1 ERROR oslo.messaging._drivers.impl_rabbit [req-e4d7a7a1-24b5-43bf-bfd3-67caff2fa7fe - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:40:49.601 1 ERROR oslo_service.service [req-e4d7a7a1-24b5-43bf-bfd3-67caff2fa7fe - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:40:49.601 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 00:40:49.601 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 00:40:49.601 1 ERROR oslo_service.service     service.start()
>2018-06-26 00:40:49.601 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 00:40:49.601 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 00:40:49.601 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 00:40:49.601 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 00:40:49.601 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 00:40:49.601 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 00:40:49.601 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 00:40:49.601 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 00:40:49.601 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 00:40:49.601 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 00:40:49.601 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 00:40:49.601 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 00:40:49.601 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 00:40:49.601 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 00:40:49.601 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 00:40:49.601 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 00:40:49.601 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 00:40:49.601 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 00:40:49.601 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 00:40:49.601 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 00:40:49.601 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 00:40:49.601 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 00:40:49.601 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:40:49.601 1 ERROR oslo_service.service 
>2018-06-26 00:40:49.604 1 CRITICAL cinder [req-fb4978ce-aa77-40f5-ab77-5c6d9ff66e47 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 00:40:49.604 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 00:40:49.604 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 00:40:49.604 1 ERROR cinder     sys.exit(main())
>2018-06-26 00:40:49.604 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 00:40:49.604 1 ERROR cinder     service.wait()
>2018-06-26 00:40:49.604 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 00:40:49.604 1 ERROR cinder     _launcher.wait()
>2018-06-26 00:40:49.604 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 00:40:49.604 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 00:40:49.604 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 00:40:49.604 1 ERROR cinder     self.services.wait()
>2018-06-26 00:40:49.604 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 00:40:49.604 1 ERROR cinder     service.wait()
>2018-06-26 00:40:49.604 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 00:40:49.604 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 00:40:49.604 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 00:40:49.604 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 00:40:49.604 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 00:40:49.604 1 ERROR cinder     post_fn = fn()
>2018-06-26 00:40:49.604 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 00:40:49.604 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 00:40:49.604 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 00:40:49.604 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 00:40:49.604 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 00:40:49.604 1 ERROR cinder 
>2018-06-26 00:40:52.409 1 WARNING cinder.scheduler.host_manager [req-53a0af74-91be-40e9-b857-aa56d86463a6 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 00:40:52.415 1 INFO cinder.rpc [req-53a0af74-91be-40e9-b857-aa56d86463a6 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 00:40:52.421 1 INFO cinder.rpc [req-53a0af74-91be-40e9-b857-aa56d86463a6 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 00:40:52.432 1 INFO cinder.rpc [req-53a0af74-91be-40e9-b857-aa56d86463a6 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 00:40:52.439 1 INFO cinder.rpc [req-53a0af74-91be-40e9-b857-aa56d86463a6 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 00:40:52.463 1 WARNING oslo_config.cfg [req-53a0af74-91be-40e9-b857-aa56d86463a6 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 00:40:52.465 1 WARNING oslo_config.cfg [req-53a0af74-91be-40e9-b857-aa56d86463a6 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:40:52.466 1 WARNING oslo_config.cfg [req-53a0af74-91be-40e9-b857-aa56d86463a6 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:40:52.466 1 WARNING oslo_config.cfg [req-53a0af74-91be-40e9-b857-aa56d86463a6 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:40:52.473 1 WARNING oslo_config.cfg [req-53a0af74-91be-40e9-b857-aa56d86463a6 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 00:40:52.474 1 WARNING oslo_config.cfg [req-53a0af74-91be-40e9-b857-aa56d86463a6 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 00:40:52.477 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 00:40:52.485 1 INFO cinder.manager [req-ae17cd01-dd9b-4c72-8bf4-2bbb5fa06068 - - - - -] Initiating service 5 cleanup
>2018-06-26 00:40:52.490 1 INFO cinder.manager [req-ae17cd01-dd9b-4c72-8bf4-2bbb5fa06068 - - - - -] Service 5 cleanup completed.
>2018-06-26 00:42:58.748 1 ERROR oslo.messaging._drivers.impl_rabbit [req-ae17cd01-dd9b-4c72-8bf4-2bbb5fa06068 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:42:58.750 1 ERROR oslo.messaging._drivers.impl_rabbit [req-ae17cd01-dd9b-4c72-8bf4-2bbb5fa06068 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:42:58.750 1 ERROR oslo_service.service [req-ae17cd01-dd9b-4c72-8bf4-2bbb5fa06068 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:42:58.750 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 00:42:58.750 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 00:42:58.750 1 ERROR oslo_service.service     service.start()
>2018-06-26 00:42:58.750 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 00:42:58.750 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 00:42:58.750 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 00:42:58.750 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 00:42:58.750 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 00:42:58.750 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 00:42:58.750 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 00:42:58.750 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 00:42:58.750 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 00:42:58.750 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 00:42:58.750 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 00:42:58.750 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 00:42:58.750 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 00:42:58.750 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 00:42:58.750 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 00:42:58.750 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 00:42:58.750 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 00:42:58.750 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 00:42:58.750 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 00:42:58.750 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 00:42:58.750 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 00:42:58.750 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 00:42:58.750 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:42:58.750 1 ERROR oslo_service.service 
>2018-06-26 00:42:58.753 1 CRITICAL cinder [req-53a0af74-91be-40e9-b857-aa56d86463a6 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 00:42:58.753 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 00:42:58.753 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 00:42:58.753 1 ERROR cinder     sys.exit(main())
>2018-06-26 00:42:58.753 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 00:42:58.753 1 ERROR cinder     service.wait()
>2018-06-26 00:42:58.753 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 00:42:58.753 1 ERROR cinder     _launcher.wait()
>2018-06-26 00:42:58.753 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 00:42:58.753 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 00:42:58.753 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 00:42:58.753 1 ERROR cinder     self.services.wait()
>2018-06-26 00:42:58.753 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 00:42:58.753 1 ERROR cinder     service.wait()
>2018-06-26 00:42:58.753 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 00:42:58.753 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 00:42:58.753 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 00:42:58.753 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 00:42:58.753 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 00:42:58.753 1 ERROR cinder     post_fn = fn()
>2018-06-26 00:42:58.753 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 00:42:58.753 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 00:42:58.753 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 00:42:58.753 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 00:42:58.753 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 00:42:58.753 1 ERROR cinder 
>2018-06-26 00:43:01.370 1 WARNING cinder.scheduler.host_manager [req-c64080d7-abec-46d5-8f86-a40f70f5ce64 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 00:43:01.379 1 INFO cinder.rpc [req-c64080d7-abec-46d5-8f86-a40f70f5ce64 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 00:43:01.387 1 INFO cinder.rpc [req-c64080d7-abec-46d5-8f86-a40f70f5ce64 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 00:43:01.406 1 INFO cinder.rpc [req-c64080d7-abec-46d5-8f86-a40f70f5ce64 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 00:43:01.419 1 INFO cinder.rpc [req-c64080d7-abec-46d5-8f86-a40f70f5ce64 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 00:43:01.454 1 WARNING oslo_config.cfg [req-c64080d7-abec-46d5-8f86-a40f70f5ce64 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 00:43:01.456 1 WARNING oslo_config.cfg [req-c64080d7-abec-46d5-8f86-a40f70f5ce64 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:43:01.457 1 WARNING oslo_config.cfg [req-c64080d7-abec-46d5-8f86-a40f70f5ce64 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:43:01.457 1 WARNING oslo_config.cfg [req-c64080d7-abec-46d5-8f86-a40f70f5ce64 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:43:01.463 1 WARNING oslo_config.cfg [req-c64080d7-abec-46d5-8f86-a40f70f5ce64 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 00:43:01.464 1 WARNING oslo_config.cfg [req-c64080d7-abec-46d5-8f86-a40f70f5ce64 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 00:43:01.467 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 00:43:01.475 1 INFO cinder.manager [req-a8516f18-b91d-40af-aab5-1448f620f39e - - - - -] Initiating service 5 cleanup
>2018-06-26 00:43:01.480 1 INFO cinder.manager [req-a8516f18-b91d-40af-aab5-1448f620f39e - - - - -] Service 5 cleanup completed.
>2018-06-26 00:45:07.703 1 ERROR oslo.messaging._drivers.impl_rabbit [req-a8516f18-b91d-40af-aab5-1448f620f39e - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:45:07.705 1 ERROR oslo.messaging._drivers.impl_rabbit [req-a8516f18-b91d-40af-aab5-1448f620f39e - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:45:07.706 1 ERROR oslo_service.service [req-a8516f18-b91d-40af-aab5-1448f620f39e - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:45:07.706 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 00:45:07.706 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 00:45:07.706 1 ERROR oslo_service.service     service.start()
>2018-06-26 00:45:07.706 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 00:45:07.706 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 00:45:07.706 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 00:45:07.706 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 00:45:07.706 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 00:45:07.706 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 00:45:07.706 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 00:45:07.706 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 00:45:07.706 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 00:45:07.706 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 00:45:07.706 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 00:45:07.706 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 00:45:07.706 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 00:45:07.706 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 00:45:07.706 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 00:45:07.706 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 00:45:07.706 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 00:45:07.706 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 00:45:07.706 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 00:45:07.706 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 00:45:07.706 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 00:45:07.706 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 00:45:07.706 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:45:07.706 1 ERROR oslo_service.service 
>2018-06-26 00:45:07.708 1 CRITICAL cinder [req-c64080d7-abec-46d5-8f86-a40f70f5ce64 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 00:45:07.708 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 00:45:07.708 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 00:45:07.708 1 ERROR cinder     sys.exit(main())
>2018-06-26 00:45:07.708 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 00:45:07.708 1 ERROR cinder     service.wait()
>2018-06-26 00:45:07.708 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 00:45:07.708 1 ERROR cinder     _launcher.wait()
>2018-06-26 00:45:07.708 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 00:45:07.708 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 00:45:07.708 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 00:45:07.708 1 ERROR cinder     self.services.wait()
>2018-06-26 00:45:07.708 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 00:45:07.708 1 ERROR cinder     service.wait()
>2018-06-26 00:45:07.708 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 00:45:07.708 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 00:45:07.708 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 00:45:07.708 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 00:45:07.708 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 00:45:07.708 1 ERROR cinder     post_fn = fn()
>2018-06-26 00:45:07.708 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 00:45:07.708 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 00:45:07.708 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 00:45:07.708 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 00:45:07.708 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 00:45:07.708 1 ERROR cinder 
>2018-06-26 00:45:10.365 1 WARNING cinder.scheduler.host_manager [req-717905df-c111-4f16-a4de-80ec500168da - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 00:45:10.371 1 INFO cinder.rpc [req-717905df-c111-4f16-a4de-80ec500168da - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 00:45:10.377 1 INFO cinder.rpc [req-717905df-c111-4f16-a4de-80ec500168da - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 00:45:10.395 1 INFO cinder.rpc [req-717905df-c111-4f16-a4de-80ec500168da - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 00:45:10.401 1 INFO cinder.rpc [req-717905df-c111-4f16-a4de-80ec500168da - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 00:45:10.425 1 WARNING oslo_config.cfg [req-717905df-c111-4f16-a4de-80ec500168da - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 00:45:10.427 1 WARNING oslo_config.cfg [req-717905df-c111-4f16-a4de-80ec500168da - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:45:10.428 1 WARNING oslo_config.cfg [req-717905df-c111-4f16-a4de-80ec500168da - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:45:10.429 1 WARNING oslo_config.cfg [req-717905df-c111-4f16-a4de-80ec500168da - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:45:10.434 1 WARNING oslo_config.cfg [req-717905df-c111-4f16-a4de-80ec500168da - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 00:45:10.436 1 WARNING oslo_config.cfg [req-717905df-c111-4f16-a4de-80ec500168da - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 00:45:10.438 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 00:45:10.444 1 INFO cinder.manager [req-825fb342-ef3f-4ad2-9565-ab9d3eea8505 - - - - -] Initiating service 5 cleanup
>2018-06-26 00:45:10.449 1 INFO cinder.manager [req-825fb342-ef3f-4ad2-9565-ab9d3eea8505 - - - - -] Service 5 cleanup completed.
>2018-06-26 00:47:14.765 1 ERROR oslo.messaging._drivers.impl_rabbit [req-825fb342-ef3f-4ad2-9565-ab9d3eea8505 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:47:14.767 1 ERROR oslo.messaging._drivers.impl_rabbit [req-825fb342-ef3f-4ad2-9565-ab9d3eea8505 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:47:14.767 1 ERROR oslo_service.service [req-825fb342-ef3f-4ad2-9565-ab9d3eea8505 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:47:14.767 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 00:47:14.767 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 00:47:14.767 1 ERROR oslo_service.service     service.start()
>2018-06-26 00:47:14.767 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 00:47:14.767 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 00:47:14.767 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 00:47:14.767 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 00:47:14.767 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 00:47:14.767 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 00:47:14.767 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 00:47:14.767 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 00:47:14.767 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 00:47:14.767 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 00:47:14.767 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 00:47:14.767 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 00:47:14.767 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 00:47:14.767 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 00:47:14.767 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 00:47:14.767 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 00:47:14.767 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 00:47:14.767 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 00:47:14.767 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 00:47:14.767 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 00:47:14.767 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 00:47:14.767 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 00:47:14.767 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:47:14.767 1 ERROR oslo_service.service 
>2018-06-26 00:47:14.770 1 CRITICAL cinder [req-717905df-c111-4f16-a4de-80ec500168da - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 00:47:14.770 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 00:47:14.770 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 00:47:14.770 1 ERROR cinder     sys.exit(main())
>2018-06-26 00:47:14.770 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 00:47:14.770 1 ERROR cinder     service.wait()
>2018-06-26 00:47:14.770 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 00:47:14.770 1 ERROR cinder     _launcher.wait()
>2018-06-26 00:47:14.770 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 00:47:14.770 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 00:47:14.770 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 00:47:14.770 1 ERROR cinder     self.services.wait()
>2018-06-26 00:47:14.770 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 00:47:14.770 1 ERROR cinder     service.wait()
>2018-06-26 00:47:14.770 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 00:47:14.770 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 00:47:14.770 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 00:47:14.770 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 00:47:14.770 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 00:47:14.770 1 ERROR cinder     post_fn = fn()
>2018-06-26 00:47:14.770 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 00:47:14.770 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 00:47:14.770 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 00:47:14.770 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 00:47:14.770 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 00:47:14.770 1 ERROR cinder 
>2018-06-26 00:47:17.349 1 WARNING cinder.scheduler.host_manager [req-d04d6cd7-705f-40fc-a56f-387fc7b58c69 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 00:47:17.355 1 INFO cinder.rpc [req-d04d6cd7-705f-40fc-a56f-387fc7b58c69 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 00:47:17.361 1 INFO cinder.rpc [req-d04d6cd7-705f-40fc-a56f-387fc7b58c69 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 00:47:17.372 1 INFO cinder.rpc [req-d04d6cd7-705f-40fc-a56f-387fc7b58c69 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 00:47:17.379 1 INFO cinder.rpc [req-d04d6cd7-705f-40fc-a56f-387fc7b58c69 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 00:47:17.402 1 WARNING oslo_config.cfg [req-d04d6cd7-705f-40fc-a56f-387fc7b58c69 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 00:47:17.404 1 WARNING oslo_config.cfg [req-d04d6cd7-705f-40fc-a56f-387fc7b58c69 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:47:17.405 1 WARNING oslo_config.cfg [req-d04d6cd7-705f-40fc-a56f-387fc7b58c69 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:47:17.405 1 WARNING oslo_config.cfg [req-d04d6cd7-705f-40fc-a56f-387fc7b58c69 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:47:17.410 1 WARNING oslo_config.cfg [req-d04d6cd7-705f-40fc-a56f-387fc7b58c69 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 00:47:17.411 1 WARNING oslo_config.cfg [req-d04d6cd7-705f-40fc-a56f-387fc7b58c69 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 00:47:17.414 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 00:47:17.420 1 INFO cinder.manager [req-b7e8e5df-3f3e-477b-ab0f-a6a886a6f902 - - - - -] Initiating service 5 cleanup
>2018-06-26 00:47:17.425 1 INFO cinder.manager [req-b7e8e5df-3f3e-477b-ab0f-a6a886a6f902 - - - - -] Service 5 cleanup completed.
>2018-06-26 00:49:21.870 1 ERROR oslo.messaging._drivers.impl_rabbit [req-b7e8e5df-3f3e-477b-ab0f-a6a886a6f902 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:49:21.872 1 ERROR oslo.messaging._drivers.impl_rabbit [req-b7e8e5df-3f3e-477b-ab0f-a6a886a6f902 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:49:21.872 1 ERROR oslo_service.service [req-b7e8e5df-3f3e-477b-ab0f-a6a886a6f902 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:49:21.872 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 00:49:21.872 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 00:49:21.872 1 ERROR oslo_service.service     service.start()
>2018-06-26 00:49:21.872 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 00:49:21.872 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 00:49:21.872 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 00:49:21.872 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 00:49:21.872 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 00:49:21.872 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 00:49:21.872 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 00:49:21.872 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 00:49:21.872 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 00:49:21.872 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 00:49:21.872 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 00:49:21.872 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 00:49:21.872 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 00:49:21.872 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 00:49:21.872 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 00:49:21.872 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 00:49:21.872 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 00:49:21.872 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 00:49:21.872 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 00:49:21.872 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 00:49:21.872 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 00:49:21.872 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 00:49:21.872 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:49:21.872 1 ERROR oslo_service.service 
>2018-06-26 00:49:21.876 1 CRITICAL cinder [req-d04d6cd7-705f-40fc-a56f-387fc7b58c69 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 00:49:21.876 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 00:49:21.876 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 00:49:21.876 1 ERROR cinder     sys.exit(main())
>2018-06-26 00:49:21.876 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 00:49:21.876 1 ERROR cinder     service.wait()
>2018-06-26 00:49:21.876 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 00:49:21.876 1 ERROR cinder     _launcher.wait()
>2018-06-26 00:49:21.876 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 00:49:21.876 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 00:49:21.876 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 00:49:21.876 1 ERROR cinder     self.services.wait()
>2018-06-26 00:49:21.876 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 00:49:21.876 1 ERROR cinder     service.wait()
>2018-06-26 00:49:21.876 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 00:49:21.876 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 00:49:21.876 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 00:49:21.876 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 00:49:21.876 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 00:49:21.876 1 ERROR cinder     post_fn = fn()
>2018-06-26 00:49:21.876 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 00:49:21.876 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 00:49:21.876 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 00:49:21.876 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 00:49:21.876 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 00:49:21.876 1 ERROR cinder 
>2018-06-26 00:49:24.606 1 WARNING cinder.scheduler.host_manager [req-c4cc51bc-c5b9-4546-9e86-a361fd3cb55d - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 00:49:24.613 1 INFO cinder.rpc [req-c4cc51bc-c5b9-4546-9e86-a361fd3cb55d - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 00:49:24.619 1 INFO cinder.rpc [req-c4cc51bc-c5b9-4546-9e86-a361fd3cb55d - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 00:49:24.631 1 INFO cinder.rpc [req-c4cc51bc-c5b9-4546-9e86-a361fd3cb55d - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 00:49:24.638 1 INFO cinder.rpc [req-c4cc51bc-c5b9-4546-9e86-a361fd3cb55d - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 00:49:24.665 1 WARNING oslo_config.cfg [req-c4cc51bc-c5b9-4546-9e86-a361fd3cb55d - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 00:49:24.668 1 WARNING oslo_config.cfg [req-c4cc51bc-c5b9-4546-9e86-a361fd3cb55d - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:49:24.668 1 WARNING oslo_config.cfg [req-c4cc51bc-c5b9-4546-9e86-a361fd3cb55d - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:49:24.669 1 WARNING oslo_config.cfg [req-c4cc51bc-c5b9-4546-9e86-a361fd3cb55d - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:49:24.674 1 WARNING oslo_config.cfg [req-c4cc51bc-c5b9-4546-9e86-a361fd3cb55d - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 00:49:24.675 1 WARNING oslo_config.cfg [req-c4cc51bc-c5b9-4546-9e86-a361fd3cb55d - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 00:49:24.678 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 00:49:24.688 1 INFO cinder.manager [req-bec5beb0-3e8f-40a1-b624-a60940defa5e - - - - -] Initiating service 5 cleanup
>2018-06-26 00:49:24.695 1 INFO cinder.manager [req-bec5beb0-3e8f-40a1-b624-a60940defa5e - - - - -] Service 5 cleanup completed.
>2018-06-26 00:51:36.581 1 ERROR oslo.messaging._drivers.impl_rabbit [req-bec5beb0-3e8f-40a1-b624-a60940defa5e - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:51:36.583 1 ERROR oslo.messaging._drivers.impl_rabbit [req-bec5beb0-3e8f-40a1-b624-a60940defa5e - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:51:36.584 1 ERROR oslo_service.service [req-bec5beb0-3e8f-40a1-b624-a60940defa5e - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:51:36.584 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 00:51:36.584 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 00:51:36.584 1 ERROR oslo_service.service     service.start()
>2018-06-26 00:51:36.584 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 00:51:36.584 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 00:51:36.584 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 00:51:36.584 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 00:51:36.584 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 00:51:36.584 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 00:51:36.584 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 00:51:36.584 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 00:51:36.584 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 00:51:36.584 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 00:51:36.584 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 00:51:36.584 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 00:51:36.584 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 00:51:36.584 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 00:51:36.584 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 00:51:36.584 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 00:51:36.584 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 00:51:36.584 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 00:51:36.584 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 00:51:36.584 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 00:51:36.584 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 00:51:36.584 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 00:51:36.584 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:51:36.584 1 ERROR oslo_service.service 
>2018-06-26 00:51:36.586 1 CRITICAL cinder [req-c4cc51bc-c5b9-4546-9e86-a361fd3cb55d - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 00:51:36.586 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 00:51:36.586 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 00:51:36.586 1 ERROR cinder     sys.exit(main())
>2018-06-26 00:51:36.586 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 00:51:36.586 1 ERROR cinder     service.wait()
>2018-06-26 00:51:36.586 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 00:51:36.586 1 ERROR cinder     _launcher.wait()
>2018-06-26 00:51:36.586 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 00:51:36.586 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 00:51:36.586 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 00:51:36.586 1 ERROR cinder     self.services.wait()
>2018-06-26 00:51:36.586 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 00:51:36.586 1 ERROR cinder     service.wait()
>2018-06-26 00:51:36.586 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 00:51:36.586 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 00:51:36.586 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 00:51:36.586 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 00:51:36.586 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 00:51:36.586 1 ERROR cinder     post_fn = fn()
>2018-06-26 00:51:36.586 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 00:51:36.586 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 00:51:36.586 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 00:51:36.586 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 00:51:36.586 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 00:51:36.586 1 ERROR cinder 
>2018-06-26 00:51:39.481 1 WARNING cinder.scheduler.host_manager [req-4ffd1f77-314b-4aea-af3c-99459271a098 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 00:51:39.487 1 INFO cinder.rpc [req-4ffd1f77-314b-4aea-af3c-99459271a098 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 00:51:39.493 1 INFO cinder.rpc [req-4ffd1f77-314b-4aea-af3c-99459271a098 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 00:51:39.505 1 INFO cinder.rpc [req-4ffd1f77-314b-4aea-af3c-99459271a098 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 00:51:39.512 1 INFO cinder.rpc [req-4ffd1f77-314b-4aea-af3c-99459271a098 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 00:51:39.536 1 WARNING oslo_config.cfg [req-4ffd1f77-314b-4aea-af3c-99459271a098 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 00:51:39.538 1 WARNING oslo_config.cfg [req-4ffd1f77-314b-4aea-af3c-99459271a098 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:51:39.538 1 WARNING oslo_config.cfg [req-4ffd1f77-314b-4aea-af3c-99459271a098 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:51:39.539 1 WARNING oslo_config.cfg [req-4ffd1f77-314b-4aea-af3c-99459271a098 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:51:39.544 1 WARNING oslo_config.cfg [req-4ffd1f77-314b-4aea-af3c-99459271a098 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 00:51:39.546 1 WARNING oslo_config.cfg [req-4ffd1f77-314b-4aea-af3c-99459271a098 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 00:51:39.548 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 00:51:39.554 1 INFO cinder.manager [req-0bfa722a-958b-4dd2-94a9-5ce54351b795 - - - - -] Initiating service 5 cleanup
>2018-06-26 00:51:39.560 1 INFO cinder.manager [req-0bfa722a-958b-4dd2-94a9-5ce54351b795 - - - - -] Service 5 cleanup completed.
>2018-06-26 00:53:51.022 1 ERROR oslo.messaging._drivers.impl_rabbit [req-0bfa722a-958b-4dd2-94a9-5ce54351b795 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:53:51.025 1 ERROR oslo.messaging._drivers.impl_rabbit [req-0bfa722a-958b-4dd2-94a9-5ce54351b795 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:53:51.026 1 ERROR oslo_service.service [req-0bfa722a-958b-4dd2-94a9-5ce54351b795 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:53:51.026 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 00:53:51.026 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 00:53:51.026 1 ERROR oslo_service.service     service.start()
>2018-06-26 00:53:51.026 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 00:53:51.026 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 00:53:51.026 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 00:53:51.026 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 00:53:51.026 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 00:53:51.026 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 00:53:51.026 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 00:53:51.026 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 00:53:51.026 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 00:53:51.026 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 00:53:51.026 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 00:53:51.026 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 00:53:51.026 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 00:53:51.026 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 00:53:51.026 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 00:53:51.026 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 00:53:51.026 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 00:53:51.026 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 00:53:51.026 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 00:53:51.026 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 00:53:51.026 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 00:53:51.026 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 00:53:51.026 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:53:51.026 1 ERROR oslo_service.service 
>2018-06-26 00:53:51.029 1 CRITICAL cinder [req-4ffd1f77-314b-4aea-af3c-99459271a098 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 00:53:51.029 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 00:53:51.029 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 00:53:51.029 1 ERROR cinder     sys.exit(main())
>2018-06-26 00:53:51.029 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 00:53:51.029 1 ERROR cinder     service.wait()
>2018-06-26 00:53:51.029 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 00:53:51.029 1 ERROR cinder     _launcher.wait()
>2018-06-26 00:53:51.029 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 00:53:51.029 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 00:53:51.029 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 00:53:51.029 1 ERROR cinder     self.services.wait()
>2018-06-26 00:53:51.029 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 00:53:51.029 1 ERROR cinder     service.wait()
>2018-06-26 00:53:51.029 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 00:53:51.029 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 00:53:51.029 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 00:53:51.029 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 00:53:51.029 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 00:53:51.029 1 ERROR cinder     post_fn = fn()
>2018-06-26 00:53:51.029 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 00:53:51.029 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 00:53:51.029 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 00:53:51.029 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 00:53:51.029 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 00:53:51.029 1 ERROR cinder 
>2018-06-26 00:53:53.815 1 WARNING cinder.scheduler.host_manager [req-5bca5edb-77ca-40f4-96c7-734905be4459 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 00:53:53.821 1 INFO cinder.rpc [req-5bca5edb-77ca-40f4-96c7-734905be4459 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 00:53:53.834 1 INFO cinder.rpc [req-5bca5edb-77ca-40f4-96c7-734905be4459 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 00:53:53.847 1 INFO cinder.rpc [req-5bca5edb-77ca-40f4-96c7-734905be4459 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 00:53:53.853 1 INFO cinder.rpc [req-5bca5edb-77ca-40f4-96c7-734905be4459 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 00:53:53.880 1 WARNING oslo_config.cfg [req-5bca5edb-77ca-40f4-96c7-734905be4459 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 00:53:53.882 1 WARNING oslo_config.cfg [req-5bca5edb-77ca-40f4-96c7-734905be4459 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:53:53.883 1 WARNING oslo_config.cfg [req-5bca5edb-77ca-40f4-96c7-734905be4459 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:53:53.883 1 WARNING oslo_config.cfg [req-5bca5edb-77ca-40f4-96c7-734905be4459 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:53:53.889 1 WARNING oslo_config.cfg [req-5bca5edb-77ca-40f4-96c7-734905be4459 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 00:53:53.890 1 WARNING oslo_config.cfg [req-5bca5edb-77ca-40f4-96c7-734905be4459 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 00:53:53.893 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 00:53:53.899 1 INFO cinder.manager [req-d84b5b45-8c57-4fea-9a2c-55172c4e900b - - - - -] Initiating service 5 cleanup
>2018-06-26 00:53:53.904 1 INFO cinder.manager [req-d84b5b45-8c57-4fea-9a2c-55172c4e900b - - - - -] Service 5 cleanup completed.
>2018-06-26 00:55:58.205 1 ERROR oslo.messaging._drivers.impl_rabbit [req-d84b5b45-8c57-4fea-9a2c-55172c4e900b - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:55:58.206 1 ERROR oslo.messaging._drivers.impl_rabbit [req-d84b5b45-8c57-4fea-9a2c-55172c4e900b - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:55:58.207 1 ERROR oslo_service.service [req-d84b5b45-8c57-4fea-9a2c-55172c4e900b - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:55:58.207 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 00:55:58.207 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 00:55:58.207 1 ERROR oslo_service.service     service.start()
>2018-06-26 00:55:58.207 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 00:55:58.207 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 00:55:58.207 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 00:55:58.207 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 00:55:58.207 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 00:55:58.207 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 00:55:58.207 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 00:55:58.207 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 00:55:58.207 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 00:55:58.207 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 00:55:58.207 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 00:55:58.207 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 00:55:58.207 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 00:55:58.207 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 00:55:58.207 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 00:55:58.207 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 00:55:58.207 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 00:55:58.207 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 00:55:58.207 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 00:55:58.207 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 00:55:58.207 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 00:55:58.207 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 00:55:58.207 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:55:58.207 1 ERROR oslo_service.service 
>2018-06-26 00:55:58.211 1 CRITICAL cinder [req-5bca5edb-77ca-40f4-96c7-734905be4459 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 00:55:58.211 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 00:55:58.211 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 00:55:58.211 1 ERROR cinder     sys.exit(main())
>2018-06-26 00:55:58.211 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 00:55:58.211 1 ERROR cinder     service.wait()
>2018-06-26 00:55:58.211 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 00:55:58.211 1 ERROR cinder     _launcher.wait()
>2018-06-26 00:55:58.211 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 00:55:58.211 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 00:55:58.211 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 00:55:58.211 1 ERROR cinder     self.services.wait()
>2018-06-26 00:55:58.211 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 00:55:58.211 1 ERROR cinder     service.wait()
>2018-06-26 00:55:58.211 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 00:55:58.211 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 00:55:58.211 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 00:55:58.211 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 00:55:58.211 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 00:55:58.211 1 ERROR cinder     post_fn = fn()
>2018-06-26 00:55:58.211 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 00:55:58.211 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 00:55:58.211 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 00:55:58.211 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 00:55:58.211 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 00:55:58.211 1 ERROR cinder 
>2018-06-26 00:56:00.902 1 WARNING cinder.scheduler.host_manager [req-3143713e-27bf-42a5-a9e3-714c51579f13 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 00:56:00.912 1 INFO cinder.rpc [req-3143713e-27bf-42a5-a9e3-714c51579f13 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 00:56:00.922 1 INFO cinder.rpc [req-3143713e-27bf-42a5-a9e3-714c51579f13 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 00:56:00.937 1 INFO cinder.rpc [req-3143713e-27bf-42a5-a9e3-714c51579f13 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 00:56:00.944 1 INFO cinder.rpc [req-3143713e-27bf-42a5-a9e3-714c51579f13 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 00:56:00.971 1 WARNING oslo_config.cfg [req-3143713e-27bf-42a5-a9e3-714c51579f13 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 00:56:00.973 1 WARNING oslo_config.cfg [req-3143713e-27bf-42a5-a9e3-714c51579f13 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:56:00.974 1 WARNING oslo_config.cfg [req-3143713e-27bf-42a5-a9e3-714c51579f13 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:56:00.974 1 WARNING oslo_config.cfg [req-3143713e-27bf-42a5-a9e3-714c51579f13 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:56:00.980 1 WARNING oslo_config.cfg [req-3143713e-27bf-42a5-a9e3-714c51579f13 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 00:56:00.981 1 WARNING oslo_config.cfg [req-3143713e-27bf-42a5-a9e3-714c51579f13 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 00:56:00.985 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 00:56:00.993 1 INFO cinder.manager [req-cc94b7d8-ab99-4152-8905-34a825864094 - - - - -] Initiating service 5 cleanup
>2018-06-26 00:56:00.998 1 INFO cinder.manager [req-cc94b7d8-ab99-4152-8905-34a825864094 - - - - -] Service 5 cleanup completed.
>2018-06-26 00:58:05.455 1 ERROR oslo.messaging._drivers.impl_rabbit [req-cc94b7d8-ab99-4152-8905-34a825864094 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:58:05.457 1 ERROR oslo.messaging._drivers.impl_rabbit [req-cc94b7d8-ab99-4152-8905-34a825864094 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:58:05.458 1 ERROR oslo_service.service [req-cc94b7d8-ab99-4152-8905-34a825864094 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:58:05.458 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 00:58:05.458 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 00:58:05.458 1 ERROR oslo_service.service     service.start()
>2018-06-26 00:58:05.458 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 00:58:05.458 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 00:58:05.458 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 00:58:05.458 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 00:58:05.458 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 00:58:05.458 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 00:58:05.458 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 00:58:05.458 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 00:58:05.458 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 00:58:05.458 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 00:58:05.458 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 00:58:05.458 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 00:58:05.458 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 00:58:05.458 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 00:58:05.458 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 00:58:05.458 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 00:58:05.458 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 00:58:05.458 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 00:58:05.458 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 00:58:05.458 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 00:58:05.458 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 00:58:05.458 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 00:58:05.458 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 00:58:05.458 1 ERROR oslo_service.service 
>2018-06-26 00:58:05.460 1 CRITICAL cinder [req-3143713e-27bf-42a5-a9e3-714c51579f13 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 00:58:05.460 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 00:58:05.460 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 00:58:05.460 1 ERROR cinder     sys.exit(main())
>2018-06-26 00:58:05.460 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 00:58:05.460 1 ERROR cinder     service.wait()
>2018-06-26 00:58:05.460 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 00:58:05.460 1 ERROR cinder     _launcher.wait()
>2018-06-26 00:58:05.460 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 00:58:05.460 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 00:58:05.460 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 00:58:05.460 1 ERROR cinder     self.services.wait()
>2018-06-26 00:58:05.460 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 00:58:05.460 1 ERROR cinder     service.wait()
>2018-06-26 00:58:05.460 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 00:58:05.460 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 00:58:05.460 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 00:58:05.460 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 00:58:05.460 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 00:58:05.460 1 ERROR cinder     post_fn = fn()
>2018-06-26 00:58:05.460 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 00:58:05.460 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 00:58:05.460 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 00:58:05.460 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 00:58:05.460 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 00:58:05.460 1 ERROR cinder 
>2018-06-26 00:58:08.096 1 WARNING cinder.scheduler.host_manager [req-b7494dec-c66f-4665-a0b1-ee045ebe4610 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 00:58:08.102 1 INFO cinder.rpc [req-b7494dec-c66f-4665-a0b1-ee045ebe4610 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 00:58:08.107 1 INFO cinder.rpc [req-b7494dec-c66f-4665-a0b1-ee045ebe4610 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 00:58:08.119 1 INFO cinder.rpc [req-b7494dec-c66f-4665-a0b1-ee045ebe4610 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 00:58:08.125 1 INFO cinder.rpc [req-b7494dec-c66f-4665-a0b1-ee045ebe4610 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 00:58:08.147 1 WARNING oslo_config.cfg [req-b7494dec-c66f-4665-a0b1-ee045ebe4610 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 00:58:08.149 1 WARNING oslo_config.cfg [req-b7494dec-c66f-4665-a0b1-ee045ebe4610 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:58:08.150 1 WARNING oslo_config.cfg [req-b7494dec-c66f-4665-a0b1-ee045ebe4610 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:58:08.150 1 WARNING oslo_config.cfg [req-b7494dec-c66f-4665-a0b1-ee045ebe4610 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 00:58:08.155 1 WARNING oslo_config.cfg [req-b7494dec-c66f-4665-a0b1-ee045ebe4610 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 00:58:08.157 1 WARNING oslo_config.cfg [req-b7494dec-c66f-4665-a0b1-ee045ebe4610 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 00:58:08.159 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 00:58:08.166 1 INFO cinder.manager [req-8931ce22-3bb6-41dd-8a68-65128782bd02 - - - - -] Initiating service 5 cleanup
>2018-06-26 00:58:08.172 1 INFO cinder.manager [req-8931ce22-3bb6-41dd-8a68-65128782bd02 - - - - -] Service 5 cleanup completed.
>2018-06-26 01:00:20.577 1 ERROR oslo.messaging._drivers.impl_rabbit [req-8931ce22-3bb6-41dd-8a68-65128782bd02 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:00:20.579 1 ERROR oslo.messaging._drivers.impl_rabbit [req-8931ce22-3bb6-41dd-8a68-65128782bd02 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:00:20.580 1 ERROR oslo_service.service [req-8931ce22-3bb6-41dd-8a68-65128782bd02 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:00:20.580 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 01:00:20.580 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 01:00:20.580 1 ERROR oslo_service.service     service.start()
>2018-06-26 01:00:20.580 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 01:00:20.580 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 01:00:20.580 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 01:00:20.580 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 01:00:20.580 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 01:00:20.580 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 01:00:20.580 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 01:00:20.580 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 01:00:20.580 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 01:00:20.580 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 01:00:20.580 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 01:00:20.580 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 01:00:20.580 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 01:00:20.580 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 01:00:20.580 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 01:00:20.580 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 01:00:20.580 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 01:00:20.580 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 01:00:20.580 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 01:00:20.580 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 01:00:20.580 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 01:00:20.580 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 01:00:20.580 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:00:20.580 1 ERROR oslo_service.service 
>2018-06-26 01:00:20.583 1 CRITICAL cinder [req-b7494dec-c66f-4665-a0b1-ee045ebe4610 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 01:00:20.583 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 01:00:20.583 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 01:00:20.583 1 ERROR cinder     sys.exit(main())
>2018-06-26 01:00:20.583 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 01:00:20.583 1 ERROR cinder     service.wait()
>2018-06-26 01:00:20.583 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 01:00:20.583 1 ERROR cinder     _launcher.wait()
>2018-06-26 01:00:20.583 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 01:00:20.583 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 01:00:20.583 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 01:00:20.583 1 ERROR cinder     self.services.wait()
>2018-06-26 01:00:20.583 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 01:00:20.583 1 ERROR cinder     service.wait()
>2018-06-26 01:00:20.583 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 01:00:20.583 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 01:00:20.583 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 01:00:20.583 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 01:00:20.583 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 01:00:20.583 1 ERROR cinder     post_fn = fn()
>2018-06-26 01:00:20.583 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 01:00:20.583 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 01:00:20.583 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 01:00:20.583 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 01:00:20.583 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 01:00:20.583 1 ERROR cinder 
>2018-06-26 01:00:23.174 1 WARNING cinder.scheduler.host_manager [req-b202736f-873e-4115-ba53-a09177df7631 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 01:00:23.180 1 INFO cinder.rpc [req-b202736f-873e-4115-ba53-a09177df7631 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 01:00:23.186 1 INFO cinder.rpc [req-b202736f-873e-4115-ba53-a09177df7631 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 01:00:23.202 1 INFO cinder.rpc [req-b202736f-873e-4115-ba53-a09177df7631 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 01:00:23.213 1 INFO cinder.rpc [req-b202736f-873e-4115-ba53-a09177df7631 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 01:00:23.241 1 WARNING oslo_config.cfg [req-b202736f-873e-4115-ba53-a09177df7631 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 01:00:23.244 1 WARNING oslo_config.cfg [req-b202736f-873e-4115-ba53-a09177df7631 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:00:23.244 1 WARNING oslo_config.cfg [req-b202736f-873e-4115-ba53-a09177df7631 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:00:23.245 1 WARNING oslo_config.cfg [req-b202736f-873e-4115-ba53-a09177df7631 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:00:23.250 1 WARNING oslo_config.cfg [req-b202736f-873e-4115-ba53-a09177df7631 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 01:00:23.251 1 WARNING oslo_config.cfg [req-b202736f-873e-4115-ba53-a09177df7631 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 01:00:23.254 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 01:00:23.262 1 INFO cinder.manager [req-070a27b6-2672-4d53-98c7-40ab80ea6cff - - - - -] Initiating service 5 cleanup
>2018-06-26 01:00:23.272 1 INFO cinder.manager [req-070a27b6-2672-4d53-98c7-40ab80ea6cff - - - - -] Service 5 cleanup completed.
>2018-06-26 01:02:27.686 1 ERROR oslo.messaging._drivers.impl_rabbit [req-070a27b6-2672-4d53-98c7-40ab80ea6cff - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:02:27.689 1 ERROR oslo.messaging._drivers.impl_rabbit [req-070a27b6-2672-4d53-98c7-40ab80ea6cff - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:02:27.690 1 ERROR oslo_service.service [req-070a27b6-2672-4d53-98c7-40ab80ea6cff - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:02:27.690 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 01:02:27.690 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 01:02:27.690 1 ERROR oslo_service.service     service.start()
>2018-06-26 01:02:27.690 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 01:02:27.690 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 01:02:27.690 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 01:02:27.690 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 01:02:27.690 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 01:02:27.690 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 01:02:27.690 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 01:02:27.690 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 01:02:27.690 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 01:02:27.690 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 01:02:27.690 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 01:02:27.690 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 01:02:27.690 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 01:02:27.690 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 01:02:27.690 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 01:02:27.690 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 01:02:27.690 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 01:02:27.690 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 01:02:27.690 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 01:02:27.690 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 01:02:27.690 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 01:02:27.690 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 01:02:27.690 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:02:27.690 1 ERROR oslo_service.service 
>2018-06-26 01:02:27.695 1 CRITICAL cinder [req-b202736f-873e-4115-ba53-a09177df7631 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 01:02:27.695 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 01:02:27.695 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 01:02:27.695 1 ERROR cinder     sys.exit(main())
>2018-06-26 01:02:27.695 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 01:02:27.695 1 ERROR cinder     service.wait()
>2018-06-26 01:02:27.695 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 01:02:27.695 1 ERROR cinder     _launcher.wait()
>2018-06-26 01:02:27.695 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 01:02:27.695 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 01:02:27.695 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 01:02:27.695 1 ERROR cinder     self.services.wait()
>2018-06-26 01:02:27.695 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 01:02:27.695 1 ERROR cinder     service.wait()
>2018-06-26 01:02:27.695 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 01:02:27.695 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 01:02:27.695 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 01:02:27.695 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 01:02:27.695 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 01:02:27.695 1 ERROR cinder     post_fn = fn()
>2018-06-26 01:02:27.695 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 01:02:27.695 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 01:02:27.695 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 01:02:27.695 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 01:02:27.695 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 01:02:27.695 1 ERROR cinder 
>2018-06-26 01:02:30.331 1 WARNING cinder.scheduler.host_manager [req-850d18c1-eac3-4952-929b-38c42c7909a4 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 01:02:30.338 1 INFO cinder.rpc [req-850d18c1-eac3-4952-929b-38c42c7909a4 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 01:02:30.343 1 INFO cinder.rpc [req-850d18c1-eac3-4952-929b-38c42c7909a4 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 01:02:30.358 1 INFO cinder.rpc [req-850d18c1-eac3-4952-929b-38c42c7909a4 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 01:02:30.366 1 INFO cinder.rpc [req-850d18c1-eac3-4952-929b-38c42c7909a4 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 01:02:30.390 1 WARNING oslo_config.cfg [req-850d18c1-eac3-4952-929b-38c42c7909a4 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 01:02:30.392 1 WARNING oslo_config.cfg [req-850d18c1-eac3-4952-929b-38c42c7909a4 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:02:30.393 1 WARNING oslo_config.cfg [req-850d18c1-eac3-4952-929b-38c42c7909a4 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:02:30.393 1 WARNING oslo_config.cfg [req-850d18c1-eac3-4952-929b-38c42c7909a4 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:02:30.398 1 WARNING oslo_config.cfg [req-850d18c1-eac3-4952-929b-38c42c7909a4 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 01:02:30.399 1 WARNING oslo_config.cfg [req-850d18c1-eac3-4952-929b-38c42c7909a4 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 01:02:30.402 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 01:02:30.409 1 INFO cinder.manager [req-d58c53b7-842f-4108-84af-57cbe0e1db7e - - - - -] Initiating service 5 cleanup
>2018-06-26 01:02:30.413 1 INFO cinder.manager [req-d58c53b7-842f-4108-84af-57cbe0e1db7e - - - - -] Service 5 cleanup completed.
>2018-06-26 01:04:34.749 1 ERROR oslo.messaging._drivers.impl_rabbit [req-d58c53b7-842f-4108-84af-57cbe0e1db7e - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:04:34.751 1 ERROR oslo.messaging._drivers.impl_rabbit [req-d58c53b7-842f-4108-84af-57cbe0e1db7e - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:04:34.751 1 ERROR oslo_service.service [req-d58c53b7-842f-4108-84af-57cbe0e1db7e - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:04:34.751 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 01:04:34.751 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 01:04:34.751 1 ERROR oslo_service.service     service.start()
>2018-06-26 01:04:34.751 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 01:04:34.751 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 01:04:34.751 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 01:04:34.751 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 01:04:34.751 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 01:04:34.751 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 01:04:34.751 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 01:04:34.751 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 01:04:34.751 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 01:04:34.751 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 01:04:34.751 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 01:04:34.751 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 01:04:34.751 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 01:04:34.751 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 01:04:34.751 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 01:04:34.751 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 01:04:34.751 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 01:04:34.751 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 01:04:34.751 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 01:04:34.751 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 01:04:34.751 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 01:04:34.751 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 01:04:34.751 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:04:34.751 1 ERROR oslo_service.service 
>2018-06-26 01:04:34.754 1 CRITICAL cinder [req-850d18c1-eac3-4952-929b-38c42c7909a4 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 01:04:34.754 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 01:04:34.754 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 01:04:34.754 1 ERROR cinder     sys.exit(main())
>2018-06-26 01:04:34.754 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 01:04:34.754 1 ERROR cinder     service.wait()
>2018-06-26 01:04:34.754 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 01:04:34.754 1 ERROR cinder     _launcher.wait()
>2018-06-26 01:04:34.754 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 01:04:34.754 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 01:04:34.754 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 01:04:34.754 1 ERROR cinder     self.services.wait()
>2018-06-26 01:04:34.754 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 01:04:34.754 1 ERROR cinder     service.wait()
>2018-06-26 01:04:34.754 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 01:04:34.754 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 01:04:34.754 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 01:04:34.754 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 01:04:34.754 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 01:04:34.754 1 ERROR cinder     post_fn = fn()
>2018-06-26 01:04:34.754 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 01:04:34.754 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 01:04:34.754 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 01:04:34.754 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 01:04:34.754 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 01:04:34.754 1 ERROR cinder 
>2018-06-26 01:04:37.331 1 WARNING cinder.scheduler.host_manager [req-0dce2be3-b269-47ab-bde0-3db83a3fe825 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 01:04:37.338 1 INFO cinder.rpc [req-0dce2be3-b269-47ab-bde0-3db83a3fe825 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 01:04:37.343 1 INFO cinder.rpc [req-0dce2be3-b269-47ab-bde0-3db83a3fe825 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 01:04:37.354 1 INFO cinder.rpc [req-0dce2be3-b269-47ab-bde0-3db83a3fe825 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 01:04:37.362 1 INFO cinder.rpc [req-0dce2be3-b269-47ab-bde0-3db83a3fe825 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 01:04:37.391 1 WARNING oslo_config.cfg [req-0dce2be3-b269-47ab-bde0-3db83a3fe825 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 01:04:37.393 1 WARNING oslo_config.cfg [req-0dce2be3-b269-47ab-bde0-3db83a3fe825 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:04:37.393 1 WARNING oslo_config.cfg [req-0dce2be3-b269-47ab-bde0-3db83a3fe825 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:04:37.394 1 WARNING oslo_config.cfg [req-0dce2be3-b269-47ab-bde0-3db83a3fe825 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:04:37.399 1 WARNING oslo_config.cfg [req-0dce2be3-b269-47ab-bde0-3db83a3fe825 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 01:04:37.400 1 WARNING oslo_config.cfg [req-0dce2be3-b269-47ab-bde0-3db83a3fe825 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 01:04:37.403 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 01:04:37.408 1 INFO cinder.manager [req-59d8180a-15fb-414a-a47a-50f55c8246d7 - - - - -] Initiating service 5 cleanup
>2018-06-26 01:04:37.414 1 INFO cinder.manager [req-59d8180a-15fb-414a-a47a-50f55c8246d7 - - - - -] Service 5 cleanup completed.
>2018-06-26 01:06:41.826 1 ERROR oslo.messaging._drivers.impl_rabbit [req-59d8180a-15fb-414a-a47a-50f55c8246d7 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:06:41.828 1 ERROR oslo.messaging._drivers.impl_rabbit [req-59d8180a-15fb-414a-a47a-50f55c8246d7 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:06:41.829 1 ERROR oslo_service.service [req-59d8180a-15fb-414a-a47a-50f55c8246d7 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:06:41.829 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 01:06:41.829 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 01:06:41.829 1 ERROR oslo_service.service     service.start()
>2018-06-26 01:06:41.829 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 01:06:41.829 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 01:06:41.829 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 01:06:41.829 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 01:06:41.829 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 01:06:41.829 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 01:06:41.829 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 01:06:41.829 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 01:06:41.829 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 01:06:41.829 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 01:06:41.829 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 01:06:41.829 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 01:06:41.829 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 01:06:41.829 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 01:06:41.829 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 01:06:41.829 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 01:06:41.829 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 01:06:41.829 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 01:06:41.829 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 01:06:41.829 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 01:06:41.829 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 01:06:41.829 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 01:06:41.829 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:06:41.829 1 ERROR oslo_service.service 
>2018-06-26 01:06:41.832 1 CRITICAL cinder [req-0dce2be3-b269-47ab-bde0-3db83a3fe825 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 01:06:41.832 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 01:06:41.832 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 01:06:41.832 1 ERROR cinder     sys.exit(main())
>2018-06-26 01:06:41.832 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 01:06:41.832 1 ERROR cinder     service.wait()
>2018-06-26 01:06:41.832 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 01:06:41.832 1 ERROR cinder     _launcher.wait()
>2018-06-26 01:06:41.832 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 01:06:41.832 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 01:06:41.832 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 01:06:41.832 1 ERROR cinder     self.services.wait()
>2018-06-26 01:06:41.832 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 01:06:41.832 1 ERROR cinder     service.wait()
>2018-06-26 01:06:41.832 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 01:06:41.832 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 01:06:41.832 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 01:06:41.832 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 01:06:41.832 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 01:06:41.832 1 ERROR cinder     post_fn = fn()
>2018-06-26 01:06:41.832 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 01:06:41.832 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 01:06:41.832 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 01:06:41.832 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 01:06:41.832 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 01:06:41.832 1 ERROR cinder 
>2018-06-26 01:06:44.464 1 WARNING cinder.scheduler.host_manager [req-279af342-88b9-4d7a-9dd8-a73ba94021a0 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 01:06:44.473 1 INFO cinder.rpc [req-279af342-88b9-4d7a-9dd8-a73ba94021a0 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 01:06:44.480 1 INFO cinder.rpc [req-279af342-88b9-4d7a-9dd8-a73ba94021a0 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 01:06:44.492 1 INFO cinder.rpc [req-279af342-88b9-4d7a-9dd8-a73ba94021a0 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 01:06:44.497 1 INFO cinder.rpc [req-279af342-88b9-4d7a-9dd8-a73ba94021a0 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 01:06:44.526 1 WARNING oslo_config.cfg [req-279af342-88b9-4d7a-9dd8-a73ba94021a0 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 01:06:44.528 1 WARNING oslo_config.cfg [req-279af342-88b9-4d7a-9dd8-a73ba94021a0 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:06:44.529 1 WARNING oslo_config.cfg [req-279af342-88b9-4d7a-9dd8-a73ba94021a0 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:06:44.529 1 WARNING oslo_config.cfg [req-279af342-88b9-4d7a-9dd8-a73ba94021a0 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:06:44.535 1 WARNING oslo_config.cfg [req-279af342-88b9-4d7a-9dd8-a73ba94021a0 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 01:06:44.536 1 WARNING oslo_config.cfg [req-279af342-88b9-4d7a-9dd8-a73ba94021a0 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 01:06:44.538 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 01:06:44.545 1 INFO cinder.manager [req-1a0045ee-093a-431e-8ae9-8d8a5b86f1f1 - - - - -] Initiating service 5 cleanup
>2018-06-26 01:06:44.552 1 INFO cinder.manager [req-1a0045ee-093a-431e-8ae9-8d8a5b86f1f1 - - - - -] Service 5 cleanup completed.
>2018-06-26 01:08:50.672 1 ERROR oslo.messaging._drivers.impl_rabbit [req-1a0045ee-093a-431e-8ae9-8d8a5b86f1f1 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:08:50.674 1 ERROR oslo.messaging._drivers.impl_rabbit [req-1a0045ee-093a-431e-8ae9-8d8a5b86f1f1 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:08:50.674 1 ERROR oslo_service.service [req-1a0045ee-093a-431e-8ae9-8d8a5b86f1f1 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:08:50.674 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 01:08:50.674 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 01:08:50.674 1 ERROR oslo_service.service     service.start()
>2018-06-26 01:08:50.674 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 01:08:50.674 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 01:08:50.674 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 01:08:50.674 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 01:08:50.674 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 01:08:50.674 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 01:08:50.674 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 01:08:50.674 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 01:08:50.674 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 01:08:50.674 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 01:08:50.674 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 01:08:50.674 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 01:08:50.674 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 01:08:50.674 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 01:08:50.674 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 01:08:50.674 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 01:08:50.674 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 01:08:50.674 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 01:08:50.674 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 01:08:50.674 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 01:08:50.674 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 01:08:50.674 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 01:08:50.674 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:08:50.674 1 ERROR oslo_service.service 
>2018-06-26 01:08:50.677 1 CRITICAL cinder [req-279af342-88b9-4d7a-9dd8-a73ba94021a0 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 01:08:50.677 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 01:08:50.677 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 01:08:50.677 1 ERROR cinder     sys.exit(main())
>2018-06-26 01:08:50.677 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 01:08:50.677 1 ERROR cinder     service.wait()
>2018-06-26 01:08:50.677 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 01:08:50.677 1 ERROR cinder     _launcher.wait()
>2018-06-26 01:08:50.677 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 01:08:50.677 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 01:08:50.677 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 01:08:50.677 1 ERROR cinder     self.services.wait()
>2018-06-26 01:08:50.677 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 01:08:50.677 1 ERROR cinder     service.wait()
>2018-06-26 01:08:50.677 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 01:08:50.677 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 01:08:50.677 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 01:08:50.677 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 01:08:50.677 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 01:08:50.677 1 ERROR cinder     post_fn = fn()
>2018-06-26 01:08:50.677 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 01:08:50.677 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 01:08:50.677 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 01:08:50.677 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 01:08:50.677 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 01:08:50.677 1 ERROR cinder 
>2018-06-26 01:08:53.256 1 WARNING cinder.scheduler.host_manager [req-24e955d0-968f-433e-8160-5d907b33a7d6 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 01:08:53.262 1 INFO cinder.rpc [req-24e955d0-968f-433e-8160-5d907b33a7d6 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 01:08:53.268 1 INFO cinder.rpc [req-24e955d0-968f-433e-8160-5d907b33a7d6 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 01:08:53.282 1 INFO cinder.rpc [req-24e955d0-968f-433e-8160-5d907b33a7d6 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 01:08:53.289 1 INFO cinder.rpc [req-24e955d0-968f-433e-8160-5d907b33a7d6 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 01:08:53.309 1 WARNING oslo_config.cfg [req-24e955d0-968f-433e-8160-5d907b33a7d6 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 01:08:53.311 1 WARNING oslo_config.cfg [req-24e955d0-968f-433e-8160-5d907b33a7d6 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:08:53.312 1 WARNING oslo_config.cfg [req-24e955d0-968f-433e-8160-5d907b33a7d6 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:08:53.312 1 WARNING oslo_config.cfg [req-24e955d0-968f-433e-8160-5d907b33a7d6 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:08:53.317 1 WARNING oslo_config.cfg [req-24e955d0-968f-433e-8160-5d907b33a7d6 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 01:08:53.318 1 WARNING oslo_config.cfg [req-24e955d0-968f-433e-8160-5d907b33a7d6 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 01:08:53.321 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 01:08:53.326 1 INFO cinder.manager [req-d15252d2-406c-4d6c-b2e0-0c10f70d1a91 - - - - -] Initiating service 5 cleanup
>2018-06-26 01:08:53.333 1 INFO cinder.manager [req-d15252d2-406c-4d6c-b2e0-0c10f70d1a91 - - - - -] Service 5 cleanup completed.
>2018-06-26 01:10:59.413 1 ERROR oslo.messaging._drivers.impl_rabbit [req-d15252d2-406c-4d6c-b2e0-0c10f70d1a91 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:10:59.416 1 ERROR oslo.messaging._drivers.impl_rabbit [req-d15252d2-406c-4d6c-b2e0-0c10f70d1a91 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:10:59.416 1 ERROR oslo_service.service [req-d15252d2-406c-4d6c-b2e0-0c10f70d1a91 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:10:59.416 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 01:10:59.416 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 01:10:59.416 1 ERROR oslo_service.service     service.start()
>2018-06-26 01:10:59.416 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 01:10:59.416 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 01:10:59.416 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 01:10:59.416 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 01:10:59.416 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 01:10:59.416 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 01:10:59.416 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 01:10:59.416 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 01:10:59.416 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 01:10:59.416 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 01:10:59.416 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 01:10:59.416 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 01:10:59.416 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 01:10:59.416 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 01:10:59.416 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 01:10:59.416 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 01:10:59.416 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 01:10:59.416 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 01:10:59.416 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 01:10:59.416 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 01:10:59.416 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 01:10:59.416 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 01:10:59.416 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:10:59.416 1 ERROR oslo_service.service 
>2018-06-26 01:10:59.419 1 CRITICAL cinder [req-24e955d0-968f-433e-8160-5d907b33a7d6 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 01:10:59.419 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 01:10:59.419 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 01:10:59.419 1 ERROR cinder     sys.exit(main())
>2018-06-26 01:10:59.419 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 01:10:59.419 1 ERROR cinder     service.wait()
>2018-06-26 01:10:59.419 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 01:10:59.419 1 ERROR cinder     _launcher.wait()
>2018-06-26 01:10:59.419 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 01:10:59.419 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 01:10:59.419 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 01:10:59.419 1 ERROR cinder     self.services.wait()
>2018-06-26 01:10:59.419 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 01:10:59.419 1 ERROR cinder     service.wait()
>2018-06-26 01:10:59.419 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 01:10:59.419 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 01:10:59.419 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 01:10:59.419 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 01:10:59.419 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 01:10:59.419 1 ERROR cinder     post_fn = fn()
>2018-06-26 01:10:59.419 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 01:10:59.419 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 01:10:59.419 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 01:10:59.419 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 01:10:59.419 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 01:10:59.419 1 ERROR cinder 
>2018-06-26 01:11:02.020 1 WARNING cinder.scheduler.host_manager [req-5d8fbc7c-aaf8-40b6-92f9-8b2640bdec49 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 01:11:02.026 1 INFO cinder.rpc [req-5d8fbc7c-aaf8-40b6-92f9-8b2640bdec49 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 01:11:02.031 1 INFO cinder.rpc [req-5d8fbc7c-aaf8-40b6-92f9-8b2640bdec49 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 01:11:02.043 1 INFO cinder.rpc [req-5d8fbc7c-aaf8-40b6-92f9-8b2640bdec49 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 01:11:02.052 1 INFO cinder.rpc [req-5d8fbc7c-aaf8-40b6-92f9-8b2640bdec49 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 01:11:02.082 1 WARNING oslo_config.cfg [req-5d8fbc7c-aaf8-40b6-92f9-8b2640bdec49 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 01:11:02.086 1 WARNING oslo_config.cfg [req-5d8fbc7c-aaf8-40b6-92f9-8b2640bdec49 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:11:02.086 1 WARNING oslo_config.cfg [req-5d8fbc7c-aaf8-40b6-92f9-8b2640bdec49 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:11:02.087 1 WARNING oslo_config.cfg [req-5d8fbc7c-aaf8-40b6-92f9-8b2640bdec49 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:11:02.094 1 WARNING oslo_config.cfg [req-5d8fbc7c-aaf8-40b6-92f9-8b2640bdec49 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 01:11:02.096 1 WARNING oslo_config.cfg [req-5d8fbc7c-aaf8-40b6-92f9-8b2640bdec49 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 01:11:02.099 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 01:11:02.106 1 INFO cinder.manager [req-1efe8e71-f6af-4e59-ba33-a74c2ce7ba76 - - - - -] Initiating service 5 cleanup
>2018-06-26 01:11:02.111 1 INFO cinder.manager [req-1efe8e71-f6af-4e59-ba33-a74c2ce7ba76 - - - - -] Service 5 cleanup completed.
>2018-06-26 01:13:06.463 1 ERROR oslo.messaging._drivers.impl_rabbit [req-1efe8e71-f6af-4e59-ba33-a74c2ce7ba76 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:13:06.465 1 ERROR oslo.messaging._drivers.impl_rabbit [req-1efe8e71-f6af-4e59-ba33-a74c2ce7ba76 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:13:06.466 1 ERROR oslo_service.service [req-1efe8e71-f6af-4e59-ba33-a74c2ce7ba76 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:13:06.466 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 01:13:06.466 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 01:13:06.466 1 ERROR oslo_service.service     service.start()
>2018-06-26 01:13:06.466 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 01:13:06.466 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 01:13:06.466 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 01:13:06.466 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 01:13:06.466 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 01:13:06.466 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 01:13:06.466 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 01:13:06.466 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 01:13:06.466 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 01:13:06.466 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 01:13:06.466 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 01:13:06.466 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 01:13:06.466 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 01:13:06.466 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 01:13:06.466 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 01:13:06.466 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 01:13:06.466 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 01:13:06.466 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 01:13:06.466 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 01:13:06.466 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 01:13:06.466 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 01:13:06.466 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 01:13:06.466 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:13:06.466 1 ERROR oslo_service.service 
>2018-06-26 01:13:06.468 1 CRITICAL cinder [req-5d8fbc7c-aaf8-40b6-92f9-8b2640bdec49 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 01:13:06.468 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 01:13:06.468 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 01:13:06.468 1 ERROR cinder     sys.exit(main())
>2018-06-26 01:13:06.468 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 01:13:06.468 1 ERROR cinder     service.wait()
>2018-06-26 01:13:06.468 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 01:13:06.468 1 ERROR cinder     _launcher.wait()
>2018-06-26 01:13:06.468 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 01:13:06.468 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 01:13:06.468 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 01:13:06.468 1 ERROR cinder     self.services.wait()
>2018-06-26 01:13:06.468 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 01:13:06.468 1 ERROR cinder     service.wait()
>2018-06-26 01:13:06.468 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 01:13:06.468 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 01:13:06.468 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 01:13:06.468 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 01:13:06.468 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 01:13:06.468 1 ERROR cinder     post_fn = fn()
>2018-06-26 01:13:06.468 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 01:13:06.468 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 01:13:06.468 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 01:13:06.468 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 01:13:06.468 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 01:13:06.468 1 ERROR cinder 
>2018-06-26 01:13:09.167 1 WARNING cinder.scheduler.host_manager [req-a94cd13e-1f6b-4c37-9262-28e82b160121 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 01:13:09.173 1 INFO cinder.rpc [req-a94cd13e-1f6b-4c37-9262-28e82b160121 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 01:13:09.185 1 INFO cinder.rpc [req-a94cd13e-1f6b-4c37-9262-28e82b160121 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 01:13:09.204 1 INFO cinder.rpc [req-a94cd13e-1f6b-4c37-9262-28e82b160121 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 01:13:09.212 1 INFO cinder.rpc [req-a94cd13e-1f6b-4c37-9262-28e82b160121 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 01:13:09.251 1 WARNING oslo_config.cfg [req-a94cd13e-1f6b-4c37-9262-28e82b160121 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 01:13:09.253 1 WARNING oslo_config.cfg [req-a94cd13e-1f6b-4c37-9262-28e82b160121 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:13:09.254 1 WARNING oslo_config.cfg [req-a94cd13e-1f6b-4c37-9262-28e82b160121 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:13:09.254 1 WARNING oslo_config.cfg [req-a94cd13e-1f6b-4c37-9262-28e82b160121 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:13:09.259 1 WARNING oslo_config.cfg [req-a94cd13e-1f6b-4c37-9262-28e82b160121 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 01:13:09.261 1 WARNING oslo_config.cfg [req-a94cd13e-1f6b-4c37-9262-28e82b160121 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 01:13:09.263 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 01:13:09.274 1 INFO cinder.manager [req-c0b276dc-0859-49ef-9570-7b4ffb3fd1ee - - - - -] Initiating service 5 cleanup
>2018-06-26 01:13:09.280 1 INFO cinder.manager [req-c0b276dc-0859-49ef-9570-7b4ffb3fd1ee - - - - -] Service 5 cleanup completed.
>2018-06-26 01:15:22.127 1 ERROR oslo.messaging._drivers.impl_rabbit [req-c0b276dc-0859-49ef-9570-7b4ffb3fd1ee - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:15:22.129 1 ERROR oslo.messaging._drivers.impl_rabbit [req-c0b276dc-0859-49ef-9570-7b4ffb3fd1ee - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:15:22.130 1 ERROR oslo_service.service [req-c0b276dc-0859-49ef-9570-7b4ffb3fd1ee - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:15:22.130 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 01:15:22.130 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 01:15:22.130 1 ERROR oslo_service.service     service.start()
>2018-06-26 01:15:22.130 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 01:15:22.130 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 01:15:22.130 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 01:15:22.130 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 01:15:22.130 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 01:15:22.130 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 01:15:22.130 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 01:15:22.130 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 01:15:22.130 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 01:15:22.130 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 01:15:22.130 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 01:15:22.130 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 01:15:22.130 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 01:15:22.130 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 01:15:22.130 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 01:15:22.130 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 01:15:22.130 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 01:15:22.130 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 01:15:22.130 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 01:15:22.130 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 01:15:22.130 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 01:15:22.130 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 01:15:22.130 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:15:22.130 1 ERROR oslo_service.service 
>2018-06-26 01:15:22.132 1 CRITICAL cinder [req-a94cd13e-1f6b-4c37-9262-28e82b160121 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 01:15:22.132 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 01:15:22.132 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 01:15:22.132 1 ERROR cinder     sys.exit(main())
>2018-06-26 01:15:22.132 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 01:15:22.132 1 ERROR cinder     service.wait()
>2018-06-26 01:15:22.132 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 01:15:22.132 1 ERROR cinder     _launcher.wait()
>2018-06-26 01:15:22.132 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 01:15:22.132 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 01:15:22.132 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 01:15:22.132 1 ERROR cinder     self.services.wait()
>2018-06-26 01:15:22.132 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 01:15:22.132 1 ERROR cinder     service.wait()
>2018-06-26 01:15:22.132 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 01:15:22.132 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 01:15:22.132 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 01:15:22.132 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 01:15:22.132 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 01:15:22.132 1 ERROR cinder     post_fn = fn()
>2018-06-26 01:15:22.132 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 01:15:22.132 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 01:15:22.132 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 01:15:22.132 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 01:15:22.132 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 01:15:22.132 1 ERROR cinder 
>2018-06-26 01:15:24.839 1 WARNING cinder.scheduler.host_manager [req-ae6a6ba9-2f7a-4856-b644-ab810751fb8b - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 01:15:24.844 1 INFO cinder.rpc [req-ae6a6ba9-2f7a-4856-b644-ab810751fb8b - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 01:15:24.852 1 INFO cinder.rpc [req-ae6a6ba9-2f7a-4856-b644-ab810751fb8b - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 01:15:24.863 1 INFO cinder.rpc [req-ae6a6ba9-2f7a-4856-b644-ab810751fb8b - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 01:15:24.869 1 INFO cinder.rpc [req-ae6a6ba9-2f7a-4856-b644-ab810751fb8b - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 01:15:24.893 1 WARNING oslo_config.cfg [req-ae6a6ba9-2f7a-4856-b644-ab810751fb8b - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 01:15:24.895 1 WARNING oslo_config.cfg [req-ae6a6ba9-2f7a-4856-b644-ab810751fb8b - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:15:24.896 1 WARNING oslo_config.cfg [req-ae6a6ba9-2f7a-4856-b644-ab810751fb8b - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:15:24.896 1 WARNING oslo_config.cfg [req-ae6a6ba9-2f7a-4856-b644-ab810751fb8b - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:15:24.901 1 WARNING oslo_config.cfg [req-ae6a6ba9-2f7a-4856-b644-ab810751fb8b - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 01:15:24.903 1 WARNING oslo_config.cfg [req-ae6a6ba9-2f7a-4856-b644-ab810751fb8b - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 01:15:24.905 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 01:15:24.911 1 INFO cinder.manager [req-00834de7-6170-43f6-a558-feaad766b229 - - - - -] Initiating service 5 cleanup
>2018-06-26 01:15:24.915 1 INFO cinder.manager [req-00834de7-6170-43f6-a558-feaad766b229 - - - - -] Service 5 cleanup completed.
>2018-06-26 01:17:37.121 1 ERROR oslo.messaging._drivers.impl_rabbit [req-00834de7-6170-43f6-a558-feaad766b229 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:17:37.123 1 ERROR oslo.messaging._drivers.impl_rabbit [req-00834de7-6170-43f6-a558-feaad766b229 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:17:37.124 1 ERROR oslo_service.service [req-00834de7-6170-43f6-a558-feaad766b229 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:17:37.124 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 01:17:37.124 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 01:17:37.124 1 ERROR oslo_service.service     service.start()
>2018-06-26 01:17:37.124 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 01:17:37.124 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 01:17:37.124 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 01:17:37.124 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 01:17:37.124 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 01:17:37.124 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 01:17:37.124 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 01:17:37.124 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 01:17:37.124 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 01:17:37.124 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 01:17:37.124 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 01:17:37.124 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 01:17:37.124 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 01:17:37.124 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 01:17:37.124 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 01:17:37.124 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 01:17:37.124 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 01:17:37.124 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 01:17:37.124 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 01:17:37.124 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 01:17:37.124 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 01:17:37.124 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 01:17:37.124 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:17:37.124 1 ERROR oslo_service.service 
>2018-06-26 01:17:37.126 1 CRITICAL cinder [req-ae6a6ba9-2f7a-4856-b644-ab810751fb8b - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 01:17:37.126 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 01:17:37.126 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 01:17:37.126 1 ERROR cinder     sys.exit(main())
>2018-06-26 01:17:37.126 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 01:17:37.126 1 ERROR cinder     service.wait()
>2018-06-26 01:17:37.126 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 01:17:37.126 1 ERROR cinder     _launcher.wait()
>2018-06-26 01:17:37.126 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 01:17:37.126 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 01:17:37.126 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 01:17:37.126 1 ERROR cinder     self.services.wait()
>2018-06-26 01:17:37.126 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 01:17:37.126 1 ERROR cinder     service.wait()
>2018-06-26 01:17:37.126 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 01:17:37.126 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 01:17:37.126 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 01:17:37.126 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 01:17:37.126 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 01:17:37.126 1 ERROR cinder     post_fn = fn()
>2018-06-26 01:17:37.126 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 01:17:37.126 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 01:17:37.126 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 01:17:37.126 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 01:17:37.126 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 01:17:37.126 1 ERROR cinder 
>2018-06-26 01:17:39.648 1 WARNING cinder.scheduler.host_manager [req-382b6aa2-1499-4518-8a9c-74e4d71d29e6 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 01:17:39.656 1 INFO cinder.rpc [req-382b6aa2-1499-4518-8a9c-74e4d71d29e6 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 01:17:39.663 1 INFO cinder.rpc [req-382b6aa2-1499-4518-8a9c-74e4d71d29e6 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 01:17:39.678 1 INFO cinder.rpc [req-382b6aa2-1499-4518-8a9c-74e4d71d29e6 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 01:17:39.689 1 INFO cinder.rpc [req-382b6aa2-1499-4518-8a9c-74e4d71d29e6 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 01:17:39.727 1 WARNING oslo_config.cfg [req-382b6aa2-1499-4518-8a9c-74e4d71d29e6 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 01:17:39.729 1 WARNING oslo_config.cfg [req-382b6aa2-1499-4518-8a9c-74e4d71d29e6 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:17:39.729 1 WARNING oslo_config.cfg [req-382b6aa2-1499-4518-8a9c-74e4d71d29e6 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:17:39.730 1 WARNING oslo_config.cfg [req-382b6aa2-1499-4518-8a9c-74e4d71d29e6 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:17:39.735 1 WARNING oslo_config.cfg [req-382b6aa2-1499-4518-8a9c-74e4d71d29e6 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 01:17:39.736 1 WARNING oslo_config.cfg [req-382b6aa2-1499-4518-8a9c-74e4d71d29e6 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 01:17:39.739 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 01:17:39.745 1 INFO cinder.manager [req-3bc2b60d-9cf1-42d8-aeec-e89a068d3986 - - - - -] Initiating service 5 cleanup
>2018-06-26 01:17:39.750 1 INFO cinder.manager [req-3bc2b60d-9cf1-42d8-aeec-e89a068d3986 - - - - -] Service 5 cleanup completed.
>2018-06-26 01:19:51.318 1 ERROR oslo.messaging._drivers.impl_rabbit [req-3bc2b60d-9cf1-42d8-aeec-e89a068d3986 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:19:51.320 1 ERROR oslo.messaging._drivers.impl_rabbit [req-3bc2b60d-9cf1-42d8-aeec-e89a068d3986 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:19:51.321 1 ERROR oslo_service.service [req-3bc2b60d-9cf1-42d8-aeec-e89a068d3986 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:19:51.321 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 01:19:51.321 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 01:19:51.321 1 ERROR oslo_service.service     service.start()
>2018-06-26 01:19:51.321 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 01:19:51.321 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 01:19:51.321 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 01:19:51.321 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 01:19:51.321 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 01:19:51.321 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 01:19:51.321 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 01:19:51.321 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 01:19:51.321 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 01:19:51.321 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 01:19:51.321 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 01:19:51.321 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 01:19:51.321 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 01:19:51.321 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 01:19:51.321 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 01:19:51.321 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 01:19:51.321 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 01:19:51.321 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 01:19:51.321 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 01:19:51.321 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 01:19:51.321 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 01:19:51.321 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 01:19:51.321 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:19:51.321 1 ERROR oslo_service.service 
>2018-06-26 01:19:51.324 1 CRITICAL cinder [req-382b6aa2-1499-4518-8a9c-74e4d71d29e6 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 01:19:51.324 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 01:19:51.324 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 01:19:51.324 1 ERROR cinder     sys.exit(main())
>2018-06-26 01:19:51.324 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 01:19:51.324 1 ERROR cinder     service.wait()
>2018-06-26 01:19:51.324 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 01:19:51.324 1 ERROR cinder     _launcher.wait()
>2018-06-26 01:19:51.324 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 01:19:51.324 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 01:19:51.324 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 01:19:51.324 1 ERROR cinder     self.services.wait()
>2018-06-26 01:19:51.324 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 01:19:51.324 1 ERROR cinder     service.wait()
>2018-06-26 01:19:51.324 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 01:19:51.324 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 01:19:51.324 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 01:19:51.324 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 01:19:51.324 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 01:19:51.324 1 ERROR cinder     post_fn = fn()
>2018-06-26 01:19:51.324 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 01:19:51.324 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 01:19:51.324 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 01:19:51.324 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 01:19:51.324 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 01:19:51.324 1 ERROR cinder 
>2018-06-26 01:19:54.262 1 WARNING cinder.scheduler.host_manager [req-168069d9-d1aa-4c58-a16d-8a74cd80b919 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 01:19:54.268 1 INFO cinder.rpc [req-168069d9-d1aa-4c58-a16d-8a74cd80b919 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 01:19:54.273 1 INFO cinder.rpc [req-168069d9-d1aa-4c58-a16d-8a74cd80b919 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 01:19:54.283 1 INFO cinder.rpc [req-168069d9-d1aa-4c58-a16d-8a74cd80b919 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 01:19:54.288 1 INFO cinder.rpc [req-168069d9-d1aa-4c58-a16d-8a74cd80b919 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 01:19:54.313 1 WARNING oslo_config.cfg [req-168069d9-d1aa-4c58-a16d-8a74cd80b919 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 01:19:54.315 1 WARNING oslo_config.cfg [req-168069d9-d1aa-4c58-a16d-8a74cd80b919 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:19:54.316 1 WARNING oslo_config.cfg [req-168069d9-d1aa-4c58-a16d-8a74cd80b919 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:19:54.316 1 WARNING oslo_config.cfg [req-168069d9-d1aa-4c58-a16d-8a74cd80b919 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:19:54.321 1 WARNING oslo_config.cfg [req-168069d9-d1aa-4c58-a16d-8a74cd80b919 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 01:19:54.322 1 WARNING oslo_config.cfg [req-168069d9-d1aa-4c58-a16d-8a74cd80b919 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 01:19:54.325 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 01:19:54.333 1 INFO cinder.manager [req-a3ccb1fd-d73b-4a32-ab8b-7d22393b0135 - - - - -] Initiating service 5 cleanup
>2018-06-26 01:19:54.338 1 INFO cinder.manager [req-a3ccb1fd-d73b-4a32-ab8b-7d22393b0135 - - - - -] Service 5 cleanup completed.
>2018-06-26 01:21:58.709 1 ERROR oslo.messaging._drivers.impl_rabbit [req-a3ccb1fd-d73b-4a32-ab8b-7d22393b0135 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:21:58.711 1 ERROR oslo.messaging._drivers.impl_rabbit [req-a3ccb1fd-d73b-4a32-ab8b-7d22393b0135 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:21:58.712 1 ERROR oslo_service.service [req-a3ccb1fd-d73b-4a32-ab8b-7d22393b0135 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:21:58.712 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 01:21:58.712 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 01:21:58.712 1 ERROR oslo_service.service     service.start()
>2018-06-26 01:21:58.712 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 01:21:58.712 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 01:21:58.712 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 01:21:58.712 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 01:21:58.712 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 01:21:58.712 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 01:21:58.712 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 01:21:58.712 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 01:21:58.712 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 01:21:58.712 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 01:21:58.712 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 01:21:58.712 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 01:21:58.712 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 01:21:58.712 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 01:21:58.712 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 01:21:58.712 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 01:21:58.712 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 01:21:58.712 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 01:21:58.712 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 01:21:58.712 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 01:21:58.712 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 01:21:58.712 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 01:21:58.712 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:21:58.712 1 ERROR oslo_service.service 
>2018-06-26 01:21:58.715 1 CRITICAL cinder [req-168069d9-d1aa-4c58-a16d-8a74cd80b919 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 01:21:58.715 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 01:21:58.715 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 01:21:58.715 1 ERROR cinder     sys.exit(main())
>2018-06-26 01:21:58.715 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 01:21:58.715 1 ERROR cinder     service.wait()
>2018-06-26 01:21:58.715 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 01:21:58.715 1 ERROR cinder     _launcher.wait()
>2018-06-26 01:21:58.715 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 01:21:58.715 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 01:21:58.715 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 01:21:58.715 1 ERROR cinder     self.services.wait()
>2018-06-26 01:21:58.715 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 01:21:58.715 1 ERROR cinder     service.wait()
>2018-06-26 01:21:58.715 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 01:21:58.715 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 01:21:58.715 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 01:21:58.715 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 01:21:58.715 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 01:21:58.715 1 ERROR cinder     post_fn = fn()
>2018-06-26 01:21:58.715 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 01:21:58.715 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 01:21:58.715 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 01:21:58.715 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 01:21:58.715 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 01:21:58.715 1 ERROR cinder 
>2018-06-26 01:22:01.476 1 WARNING cinder.scheduler.host_manager [req-a862f6f9-d9ee-4040-8339-83eed15c5a09 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 01:22:01.483 1 INFO cinder.rpc [req-a862f6f9-d9ee-4040-8339-83eed15c5a09 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 01:22:01.488 1 INFO cinder.rpc [req-a862f6f9-d9ee-4040-8339-83eed15c5a09 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 01:22:01.499 1 INFO cinder.rpc [req-a862f6f9-d9ee-4040-8339-83eed15c5a09 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 01:22:01.505 1 INFO cinder.rpc [req-a862f6f9-d9ee-4040-8339-83eed15c5a09 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 01:22:01.529 1 WARNING oslo_config.cfg [req-a862f6f9-d9ee-4040-8339-83eed15c5a09 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 01:22:01.531 1 WARNING oslo_config.cfg [req-a862f6f9-d9ee-4040-8339-83eed15c5a09 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:22:01.532 1 WARNING oslo_config.cfg [req-a862f6f9-d9ee-4040-8339-83eed15c5a09 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:22:01.532 1 WARNING oslo_config.cfg [req-a862f6f9-d9ee-4040-8339-83eed15c5a09 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:22:01.537 1 WARNING oslo_config.cfg [req-a862f6f9-d9ee-4040-8339-83eed15c5a09 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 01:22:01.539 1 WARNING oslo_config.cfg [req-a862f6f9-d9ee-4040-8339-83eed15c5a09 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 01:22:01.541 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 01:22:01.548 1 INFO cinder.manager [req-0c39627d-47f3-491b-a63b-8c73e2dd2b89 - - - - -] Initiating service 5 cleanup
>2018-06-26 01:22:01.552 1 INFO cinder.manager [req-0c39627d-47f3-491b-a63b-8c73e2dd2b89 - - - - -] Service 5 cleanup completed.
>2018-06-26 01:24:12.758 1 ERROR oslo.messaging._drivers.impl_rabbit [req-0c39627d-47f3-491b-a63b-8c73e2dd2b89 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:24:12.760 1 ERROR oslo.messaging._drivers.impl_rabbit [req-0c39627d-47f3-491b-a63b-8c73e2dd2b89 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:24:12.760 1 ERROR oslo_service.service [req-0c39627d-47f3-491b-a63b-8c73e2dd2b89 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:24:12.760 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 01:24:12.760 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 01:24:12.760 1 ERROR oslo_service.service     service.start()
>2018-06-26 01:24:12.760 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 01:24:12.760 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 01:24:12.760 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 01:24:12.760 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 01:24:12.760 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 01:24:12.760 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 01:24:12.760 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 01:24:12.760 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 01:24:12.760 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 01:24:12.760 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 01:24:12.760 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 01:24:12.760 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 01:24:12.760 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 01:24:12.760 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 01:24:12.760 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 01:24:12.760 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 01:24:12.760 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 01:24:12.760 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 01:24:12.760 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 01:24:12.760 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 01:24:12.760 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 01:24:12.760 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 01:24:12.760 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:24:12.760 1 ERROR oslo_service.service 
>2018-06-26 01:24:12.763 1 CRITICAL cinder [req-a862f6f9-d9ee-4040-8339-83eed15c5a09 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 01:24:12.763 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 01:24:12.763 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 01:24:12.763 1 ERROR cinder     sys.exit(main())
>2018-06-26 01:24:12.763 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 01:24:12.763 1 ERROR cinder     service.wait()
>2018-06-26 01:24:12.763 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 01:24:12.763 1 ERROR cinder     _launcher.wait()
>2018-06-26 01:24:12.763 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 01:24:12.763 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 01:24:12.763 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 01:24:12.763 1 ERROR cinder     self.services.wait()
>2018-06-26 01:24:12.763 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 01:24:12.763 1 ERROR cinder     service.wait()
>2018-06-26 01:24:12.763 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 01:24:12.763 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 01:24:12.763 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 01:24:12.763 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 01:24:12.763 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 01:24:12.763 1 ERROR cinder     post_fn = fn()
>2018-06-26 01:24:12.763 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 01:24:12.763 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 01:24:12.763 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 01:24:12.763 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 01:24:12.763 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 01:24:12.763 1 ERROR cinder 
>2018-06-26 01:24:15.388 1 WARNING cinder.scheduler.host_manager [req-84275416-9cc2-4352-bd60-645f040c0d0c - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 01:24:15.394 1 INFO cinder.rpc [req-84275416-9cc2-4352-bd60-645f040c0d0c - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 01:24:15.400 1 INFO cinder.rpc [req-84275416-9cc2-4352-bd60-645f040c0d0c - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 01:24:15.412 1 INFO cinder.rpc [req-84275416-9cc2-4352-bd60-645f040c0d0c - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 01:24:15.419 1 INFO cinder.rpc [req-84275416-9cc2-4352-bd60-645f040c0d0c - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 01:24:15.445 1 WARNING oslo_config.cfg [req-84275416-9cc2-4352-bd60-645f040c0d0c - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 01:24:15.448 1 WARNING oslo_config.cfg [req-84275416-9cc2-4352-bd60-645f040c0d0c - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:24:15.448 1 WARNING oslo_config.cfg [req-84275416-9cc2-4352-bd60-645f040c0d0c - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:24:15.449 1 WARNING oslo_config.cfg [req-84275416-9cc2-4352-bd60-645f040c0d0c - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:24:15.454 1 WARNING oslo_config.cfg [req-84275416-9cc2-4352-bd60-645f040c0d0c - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 01:24:15.455 1 WARNING oslo_config.cfg [req-84275416-9cc2-4352-bd60-645f040c0d0c - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 01:24:15.458 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 01:24:15.463 1 INFO cinder.manager [req-d84ff7b0-cb68-4b20-9366-d5c5c45cf5c9 - - - - -] Initiating service 5 cleanup
>2018-06-26 01:24:15.468 1 INFO cinder.manager [req-d84ff7b0-cb68-4b20-9366-d5c5c45cf5c9 - - - - -] Service 5 cleanup completed.
>2018-06-26 01:26:27.262 1 ERROR oslo.messaging._drivers.impl_rabbit [req-d84ff7b0-cb68-4b20-9366-d5c5c45cf5c9 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:26:27.264 1 ERROR oslo.messaging._drivers.impl_rabbit [req-d84ff7b0-cb68-4b20-9366-d5c5c45cf5c9 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:26:27.264 1 ERROR oslo_service.service [req-d84ff7b0-cb68-4b20-9366-d5c5c45cf5c9 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:26:27.264 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 01:26:27.264 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 01:26:27.264 1 ERROR oslo_service.service     service.start()
>2018-06-26 01:26:27.264 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 01:26:27.264 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 01:26:27.264 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 01:26:27.264 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 01:26:27.264 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 01:26:27.264 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 01:26:27.264 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 01:26:27.264 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 01:26:27.264 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 01:26:27.264 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 01:26:27.264 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 01:26:27.264 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 01:26:27.264 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 01:26:27.264 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 01:26:27.264 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 01:26:27.264 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 01:26:27.264 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 01:26:27.264 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 01:26:27.264 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 01:26:27.264 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 01:26:27.264 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 01:26:27.264 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 01:26:27.264 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:26:27.264 1 ERROR oslo_service.service 
>2018-06-26 01:26:27.267 1 CRITICAL cinder [req-84275416-9cc2-4352-bd60-645f040c0d0c - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 01:26:27.267 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 01:26:27.267 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 01:26:27.267 1 ERROR cinder     sys.exit(main())
>2018-06-26 01:26:27.267 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 01:26:27.267 1 ERROR cinder     service.wait()
>2018-06-26 01:26:27.267 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 01:26:27.267 1 ERROR cinder     _launcher.wait()
>2018-06-26 01:26:27.267 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 01:26:27.267 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 01:26:27.267 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 01:26:27.267 1 ERROR cinder     self.services.wait()
>2018-06-26 01:26:27.267 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 01:26:27.267 1 ERROR cinder     service.wait()
>2018-06-26 01:26:27.267 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 01:26:27.267 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 01:26:27.267 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 01:26:27.267 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 01:26:27.267 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 01:26:27.267 1 ERROR cinder     post_fn = fn()
>2018-06-26 01:26:27.267 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 01:26:27.267 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 01:26:27.267 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 01:26:27.267 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 01:26:27.267 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 01:26:27.267 1 ERROR cinder 
>2018-06-26 01:26:29.911 1 WARNING cinder.scheduler.host_manager [req-dcf3ebae-f634-4ae4-b011-9848743c7cf4 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 01:26:29.918 1 INFO cinder.rpc [req-dcf3ebae-f634-4ae4-b011-9848743c7cf4 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 01:26:29.924 1 INFO cinder.rpc [req-dcf3ebae-f634-4ae4-b011-9848743c7cf4 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 01:26:29.937 1 INFO cinder.rpc [req-dcf3ebae-f634-4ae4-b011-9848743c7cf4 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 01:26:29.943 1 INFO cinder.rpc [req-dcf3ebae-f634-4ae4-b011-9848743c7cf4 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 01:26:29.968 1 WARNING oslo_config.cfg [req-dcf3ebae-f634-4ae4-b011-9848743c7cf4 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 01:26:29.970 1 WARNING oslo_config.cfg [req-dcf3ebae-f634-4ae4-b011-9848743c7cf4 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:26:29.971 1 WARNING oslo_config.cfg [req-dcf3ebae-f634-4ae4-b011-9848743c7cf4 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:26:29.972 1 WARNING oslo_config.cfg [req-dcf3ebae-f634-4ae4-b011-9848743c7cf4 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:26:29.977 1 WARNING oslo_config.cfg [req-dcf3ebae-f634-4ae4-b011-9848743c7cf4 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 01:26:29.978 1 WARNING oslo_config.cfg [req-dcf3ebae-f634-4ae4-b011-9848743c7cf4 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 01:26:29.981 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 01:26:29.988 1 INFO cinder.manager [req-7052688a-fdb2-4340-816b-4189289a538a - - - - -] Initiating service 5 cleanup
>2018-06-26 01:26:29.995 1 INFO cinder.manager [req-7052688a-fdb2-4340-816b-4189289a538a - - - - -] Service 5 cleanup completed.
>2018-06-26 01:28:36.190 1 ERROR oslo.messaging._drivers.impl_rabbit [req-7052688a-fdb2-4340-816b-4189289a538a - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:28:36.191 1 ERROR oslo.messaging._drivers.impl_rabbit [req-7052688a-fdb2-4340-816b-4189289a538a - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:28:36.192 1 ERROR oslo_service.service [req-7052688a-fdb2-4340-816b-4189289a538a - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:28:36.192 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 01:28:36.192 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 01:28:36.192 1 ERROR oslo_service.service     service.start()
>2018-06-26 01:28:36.192 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 01:28:36.192 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 01:28:36.192 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 01:28:36.192 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 01:28:36.192 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 01:28:36.192 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 01:28:36.192 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 01:28:36.192 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 01:28:36.192 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 01:28:36.192 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 01:28:36.192 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 01:28:36.192 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 01:28:36.192 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 01:28:36.192 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 01:28:36.192 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 01:28:36.192 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 01:28:36.192 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 01:28:36.192 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 01:28:36.192 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 01:28:36.192 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 01:28:36.192 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 01:28:36.192 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 01:28:36.192 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:28:36.192 1 ERROR oslo_service.service 
>2018-06-26 01:28:36.195 1 CRITICAL cinder [req-dcf3ebae-f634-4ae4-b011-9848743c7cf4 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 01:28:36.195 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 01:28:36.195 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 01:28:36.195 1 ERROR cinder     sys.exit(main())
>2018-06-26 01:28:36.195 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 01:28:36.195 1 ERROR cinder     service.wait()
>2018-06-26 01:28:36.195 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 01:28:36.195 1 ERROR cinder     _launcher.wait()
>2018-06-26 01:28:36.195 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 01:28:36.195 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 01:28:36.195 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 01:28:36.195 1 ERROR cinder     self.services.wait()
>2018-06-26 01:28:36.195 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 01:28:36.195 1 ERROR cinder     service.wait()
>2018-06-26 01:28:36.195 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 01:28:36.195 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 01:28:36.195 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 01:28:36.195 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 01:28:36.195 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 01:28:36.195 1 ERROR cinder     post_fn = fn()
>2018-06-26 01:28:36.195 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 01:28:36.195 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 01:28:36.195 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 01:28:36.195 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 01:28:36.195 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 01:28:36.195 1 ERROR cinder 
>2018-06-26 01:28:38.861 1 WARNING cinder.scheduler.host_manager [req-fefcea78-54fd-44c9-967f-1e2315d73284 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 01:28:38.867 1 INFO cinder.rpc [req-fefcea78-54fd-44c9-967f-1e2315d73284 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 01:28:38.874 1 INFO cinder.rpc [req-fefcea78-54fd-44c9-967f-1e2315d73284 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 01:28:38.889 1 INFO cinder.rpc [req-fefcea78-54fd-44c9-967f-1e2315d73284 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 01:28:38.896 1 INFO cinder.rpc [req-fefcea78-54fd-44c9-967f-1e2315d73284 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 01:28:38.931 1 WARNING oslo_config.cfg [req-fefcea78-54fd-44c9-967f-1e2315d73284 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 01:28:38.933 1 WARNING oslo_config.cfg [req-fefcea78-54fd-44c9-967f-1e2315d73284 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:28:38.934 1 WARNING oslo_config.cfg [req-fefcea78-54fd-44c9-967f-1e2315d73284 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:28:38.934 1 WARNING oslo_config.cfg [req-fefcea78-54fd-44c9-967f-1e2315d73284 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:28:38.939 1 WARNING oslo_config.cfg [req-fefcea78-54fd-44c9-967f-1e2315d73284 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 01:28:38.941 1 WARNING oslo_config.cfg [req-fefcea78-54fd-44c9-967f-1e2315d73284 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 01:28:38.943 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 01:28:38.952 1 INFO cinder.manager [req-f46b10bb-0989-4ad3-af67-bfcf2fe804b6 - - - - -] Initiating service 5 cleanup
>2018-06-26 01:28:38.960 1 INFO cinder.manager [req-f46b10bb-0989-4ad3-af67-bfcf2fe804b6 - - - - -] Service 5 cleanup completed.
>2018-06-26 01:30:43.228 1 ERROR oslo.messaging._drivers.impl_rabbit [req-f46b10bb-0989-4ad3-af67-bfcf2fe804b6 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:30:43.230 1 ERROR oslo.messaging._drivers.impl_rabbit [req-f46b10bb-0989-4ad3-af67-bfcf2fe804b6 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:30:43.230 1 ERROR oslo_service.service [req-f46b10bb-0989-4ad3-af67-bfcf2fe804b6 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:30:43.230 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 01:30:43.230 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 01:30:43.230 1 ERROR oslo_service.service     service.start()
>2018-06-26 01:30:43.230 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 01:30:43.230 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 01:30:43.230 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 01:30:43.230 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 01:30:43.230 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 01:30:43.230 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 01:30:43.230 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 01:30:43.230 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 01:30:43.230 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 01:30:43.230 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 01:30:43.230 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 01:30:43.230 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 01:30:43.230 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 01:30:43.230 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 01:30:43.230 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 01:30:43.230 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 01:30:43.230 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 01:30:43.230 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 01:30:43.230 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 01:30:43.230 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 01:30:43.230 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 01:30:43.230 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 01:30:43.230 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:30:43.230 1 ERROR oslo_service.service 
>2018-06-26 01:30:43.233 1 CRITICAL cinder [req-fefcea78-54fd-44c9-967f-1e2315d73284 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 01:30:43.233 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 01:30:43.233 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 01:30:43.233 1 ERROR cinder     sys.exit(main())
>2018-06-26 01:30:43.233 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 01:30:43.233 1 ERROR cinder     service.wait()
>2018-06-26 01:30:43.233 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 01:30:43.233 1 ERROR cinder     _launcher.wait()
>2018-06-26 01:30:43.233 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 01:30:43.233 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 01:30:43.233 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 01:30:43.233 1 ERROR cinder     self.services.wait()
>2018-06-26 01:30:43.233 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 01:30:43.233 1 ERROR cinder     service.wait()
>2018-06-26 01:30:43.233 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 01:30:43.233 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 01:30:43.233 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 01:30:43.233 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 01:30:43.233 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 01:30:43.233 1 ERROR cinder     post_fn = fn()
>2018-06-26 01:30:43.233 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 01:30:43.233 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 01:30:43.233 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 01:30:43.233 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 01:30:43.233 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 01:30:43.233 1 ERROR cinder 
>2018-06-26 01:30:46.003 1 WARNING cinder.scheduler.host_manager [req-a4c63fd5-1a0f-40c8-825f-846f6b2233f0 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 01:30:46.010 1 INFO cinder.rpc [req-a4c63fd5-1a0f-40c8-825f-846f6b2233f0 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 01:30:46.018 1 INFO cinder.rpc [req-a4c63fd5-1a0f-40c8-825f-846f6b2233f0 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 01:30:46.029 1 INFO cinder.rpc [req-a4c63fd5-1a0f-40c8-825f-846f6b2233f0 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 01:30:46.036 1 INFO cinder.rpc [req-a4c63fd5-1a0f-40c8-825f-846f6b2233f0 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 01:30:46.064 1 WARNING oslo_config.cfg [req-a4c63fd5-1a0f-40c8-825f-846f6b2233f0 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 01:30:46.066 1 WARNING oslo_config.cfg [req-a4c63fd5-1a0f-40c8-825f-846f6b2233f0 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:30:46.067 1 WARNING oslo_config.cfg [req-a4c63fd5-1a0f-40c8-825f-846f6b2233f0 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:30:46.068 1 WARNING oslo_config.cfg [req-a4c63fd5-1a0f-40c8-825f-846f6b2233f0 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:30:46.073 1 WARNING oslo_config.cfg [req-a4c63fd5-1a0f-40c8-825f-846f6b2233f0 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 01:30:46.074 1 WARNING oslo_config.cfg [req-a4c63fd5-1a0f-40c8-825f-846f6b2233f0 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 01:30:46.077 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 01:30:46.086 1 INFO cinder.manager [req-544d5045-1065-4395-a89a-1e07c4461a3a - - - - -] Initiating service 5 cleanup
>2018-06-26 01:30:46.092 1 INFO cinder.manager [req-544d5045-1065-4395-a89a-1e07c4461a3a - - - - -] Service 5 cleanup completed.
>2018-06-26 01:32:52.665 1 ERROR oslo.messaging._drivers.impl_rabbit [req-544d5045-1065-4395-a89a-1e07c4461a3a - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:32:52.667 1 ERROR oslo.messaging._drivers.impl_rabbit [req-544d5045-1065-4395-a89a-1e07c4461a3a - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:32:52.667 1 ERROR oslo_service.service [req-544d5045-1065-4395-a89a-1e07c4461a3a - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:32:52.667 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 01:32:52.667 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 01:32:52.667 1 ERROR oslo_service.service     service.start()
>2018-06-26 01:32:52.667 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 01:32:52.667 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 01:32:52.667 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 01:32:52.667 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 01:32:52.667 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 01:32:52.667 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 01:32:52.667 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 01:32:52.667 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 01:32:52.667 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 01:32:52.667 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 01:32:52.667 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 01:32:52.667 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 01:32:52.667 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 01:32:52.667 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 01:32:52.667 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 01:32:52.667 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 01:32:52.667 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 01:32:52.667 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 01:32:52.667 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 01:32:52.667 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 01:32:52.667 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 01:32:52.667 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 01:32:52.667 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:32:52.667 1 ERROR oslo_service.service 
>2018-06-26 01:32:52.669 1 CRITICAL cinder [req-a4c63fd5-1a0f-40c8-825f-846f6b2233f0 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 01:32:52.669 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 01:32:52.669 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 01:32:52.669 1 ERROR cinder     sys.exit(main())
>2018-06-26 01:32:52.669 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 01:32:52.669 1 ERROR cinder     service.wait()
>2018-06-26 01:32:52.669 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 01:32:52.669 1 ERROR cinder     _launcher.wait()
>2018-06-26 01:32:52.669 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 01:32:52.669 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 01:32:52.669 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 01:32:52.669 1 ERROR cinder     self.services.wait()
>2018-06-26 01:32:52.669 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 01:32:52.669 1 ERROR cinder     service.wait()
>2018-06-26 01:32:52.669 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 01:32:52.669 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 01:32:52.669 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 01:32:52.669 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 01:32:52.669 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 01:32:52.669 1 ERROR cinder     post_fn = fn()
>2018-06-26 01:32:52.669 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 01:32:52.669 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 01:32:52.669 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 01:32:52.669 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 01:32:52.669 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 01:32:52.669 1 ERROR cinder 
>2018-06-26 01:32:55.369 1 WARNING cinder.scheduler.host_manager [req-f9531b21-dccd-4f4a-bd0c-e75a2bc27221 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 01:32:55.375 1 INFO cinder.rpc [req-f9531b21-dccd-4f4a-bd0c-e75a2bc27221 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 01:32:55.382 1 INFO cinder.rpc [req-f9531b21-dccd-4f4a-bd0c-e75a2bc27221 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 01:32:55.396 1 INFO cinder.rpc [req-f9531b21-dccd-4f4a-bd0c-e75a2bc27221 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 01:32:55.404 1 INFO cinder.rpc [req-f9531b21-dccd-4f4a-bd0c-e75a2bc27221 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 01:32:55.435 1 WARNING oslo_config.cfg [req-f9531b21-dccd-4f4a-bd0c-e75a2bc27221 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 01:32:55.437 1 WARNING oslo_config.cfg [req-f9531b21-dccd-4f4a-bd0c-e75a2bc27221 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:32:55.438 1 WARNING oslo_config.cfg [req-f9531b21-dccd-4f4a-bd0c-e75a2bc27221 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:32:55.439 1 WARNING oslo_config.cfg [req-f9531b21-dccd-4f4a-bd0c-e75a2bc27221 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:32:55.444 1 WARNING oslo_config.cfg [req-f9531b21-dccd-4f4a-bd0c-e75a2bc27221 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 01:32:55.445 1 WARNING oslo_config.cfg [req-f9531b21-dccd-4f4a-bd0c-e75a2bc27221 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 01:32:55.448 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 01:32:55.455 1 INFO cinder.manager [req-59e5f169-db77-47e8-93ae-7565d76bbe53 - - - - -] Initiating service 5 cleanup
>2018-06-26 01:32:55.460 1 INFO cinder.manager [req-59e5f169-db77-47e8-93ae-7565d76bbe53 - - - - -] Service 5 cleanup completed.
>2018-06-26 01:35:01.929 1 ERROR oslo.messaging._drivers.impl_rabbit [req-59e5f169-db77-47e8-93ae-7565d76bbe53 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:35:01.931 1 ERROR oslo.messaging._drivers.impl_rabbit [req-59e5f169-db77-47e8-93ae-7565d76bbe53 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:35:01.931 1 ERROR oslo_service.service [req-59e5f169-db77-47e8-93ae-7565d76bbe53 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:35:01.931 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 01:35:01.931 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 01:35:01.931 1 ERROR oslo_service.service     service.start()
>2018-06-26 01:35:01.931 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 01:35:01.931 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 01:35:01.931 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 01:35:01.931 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 01:35:01.931 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 01:35:01.931 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 01:35:01.931 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 01:35:01.931 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 01:35:01.931 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 01:35:01.931 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 01:35:01.931 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 01:35:01.931 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 01:35:01.931 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 01:35:01.931 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 01:35:01.931 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 01:35:01.931 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 01:35:01.931 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 01:35:01.931 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 01:35:01.931 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 01:35:01.931 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 01:35:01.931 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 01:35:01.931 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 01:35:01.931 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:35:01.931 1 ERROR oslo_service.service 
>2018-06-26 01:35:01.934 1 CRITICAL cinder [req-f9531b21-dccd-4f4a-bd0c-e75a2bc27221 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 01:35:01.934 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 01:35:01.934 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 01:35:01.934 1 ERROR cinder     sys.exit(main())
>2018-06-26 01:35:01.934 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 01:35:01.934 1 ERROR cinder     service.wait()
>2018-06-26 01:35:01.934 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 01:35:01.934 1 ERROR cinder     _launcher.wait()
>2018-06-26 01:35:01.934 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 01:35:01.934 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 01:35:01.934 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 01:35:01.934 1 ERROR cinder     self.services.wait()
>2018-06-26 01:35:01.934 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 01:35:01.934 1 ERROR cinder     service.wait()
>2018-06-26 01:35:01.934 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 01:35:01.934 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 01:35:01.934 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 01:35:01.934 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 01:35:01.934 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 01:35:01.934 1 ERROR cinder     post_fn = fn()
>2018-06-26 01:35:01.934 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 01:35:01.934 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 01:35:01.934 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 01:35:01.934 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 01:35:01.934 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 01:35:01.934 1 ERROR cinder 
>2018-06-26 01:35:04.450 1 WARNING cinder.scheduler.host_manager [req-c5bf4f38-899e-4da2-aa08-b971fc6dc18d - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 01:35:04.456 1 INFO cinder.rpc [req-c5bf4f38-899e-4da2-aa08-b971fc6dc18d - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 01:35:04.462 1 INFO cinder.rpc [req-c5bf4f38-899e-4da2-aa08-b971fc6dc18d - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 01:35:04.475 1 INFO cinder.rpc [req-c5bf4f38-899e-4da2-aa08-b971fc6dc18d - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 01:35:04.481 1 INFO cinder.rpc [req-c5bf4f38-899e-4da2-aa08-b971fc6dc18d - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 01:35:04.505 1 WARNING oslo_config.cfg [req-c5bf4f38-899e-4da2-aa08-b971fc6dc18d - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 01:35:04.508 1 WARNING oslo_config.cfg [req-c5bf4f38-899e-4da2-aa08-b971fc6dc18d - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:35:04.508 1 WARNING oslo_config.cfg [req-c5bf4f38-899e-4da2-aa08-b971fc6dc18d - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:35:04.509 1 WARNING oslo_config.cfg [req-c5bf4f38-899e-4da2-aa08-b971fc6dc18d - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:35:04.514 1 WARNING oslo_config.cfg [req-c5bf4f38-899e-4da2-aa08-b971fc6dc18d - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 01:35:04.515 1 WARNING oslo_config.cfg [req-c5bf4f38-899e-4da2-aa08-b971fc6dc18d - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 01:35:04.517 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 01:35:04.523 1 INFO cinder.manager [req-776b136c-6165-43ce-9cad-7538194ded30 - - - - -] Initiating service 5 cleanup
>2018-06-26 01:35:04.528 1 INFO cinder.manager [req-776b136c-6165-43ce-9cad-7538194ded30 - - - - -] Service 5 cleanup completed.
>2018-06-26 01:37:15.866 1 ERROR oslo.messaging._drivers.impl_rabbit [req-776b136c-6165-43ce-9cad-7538194ded30 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:37:15.868 1 ERROR oslo.messaging._drivers.impl_rabbit [req-776b136c-6165-43ce-9cad-7538194ded30 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:37:15.869 1 ERROR oslo_service.service [req-776b136c-6165-43ce-9cad-7538194ded30 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:37:15.869 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 01:37:15.869 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 01:37:15.869 1 ERROR oslo_service.service     service.start()
>2018-06-26 01:37:15.869 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 01:37:15.869 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 01:37:15.869 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 01:37:15.869 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 01:37:15.869 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 01:37:15.869 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 01:37:15.869 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 01:37:15.869 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 01:37:15.869 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 01:37:15.869 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 01:37:15.869 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 01:37:15.869 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 01:37:15.869 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 01:37:15.869 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 01:37:15.869 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 01:37:15.869 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 01:37:15.869 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 01:37:15.869 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 01:37:15.869 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 01:37:15.869 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 01:37:15.869 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 01:37:15.869 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 01:37:15.869 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:37:15.869 1 ERROR oslo_service.service 
>2018-06-26 01:37:15.872 1 CRITICAL cinder [req-c5bf4f38-899e-4da2-aa08-b971fc6dc18d - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 01:37:15.872 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 01:37:15.872 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 01:37:15.872 1 ERROR cinder     sys.exit(main())
>2018-06-26 01:37:15.872 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 01:37:15.872 1 ERROR cinder     service.wait()
>2018-06-26 01:37:15.872 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 01:37:15.872 1 ERROR cinder     _launcher.wait()
>2018-06-26 01:37:15.872 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 01:37:15.872 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 01:37:15.872 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 01:37:15.872 1 ERROR cinder     self.services.wait()
>2018-06-26 01:37:15.872 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 01:37:15.872 1 ERROR cinder     service.wait()
>2018-06-26 01:37:15.872 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 01:37:15.872 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 01:37:15.872 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 01:37:15.872 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 01:37:15.872 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 01:37:15.872 1 ERROR cinder     post_fn = fn()
>2018-06-26 01:37:15.872 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 01:37:15.872 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 01:37:15.872 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 01:37:15.872 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 01:37:15.872 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 01:37:15.872 1 ERROR cinder 
>2018-06-26 01:37:18.571 1 WARNING cinder.scheduler.host_manager [req-bd0356d3-fc21-4846-bfcb-a4500e86083e - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 01:37:18.578 1 INFO cinder.rpc [req-bd0356d3-fc21-4846-bfcb-a4500e86083e - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 01:37:18.587 1 INFO cinder.rpc [req-bd0356d3-fc21-4846-bfcb-a4500e86083e - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 01:37:18.603 1 INFO cinder.rpc [req-bd0356d3-fc21-4846-bfcb-a4500e86083e - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 01:37:18.610 1 INFO cinder.rpc [req-bd0356d3-fc21-4846-bfcb-a4500e86083e - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 01:37:18.638 1 WARNING oslo_config.cfg [req-bd0356d3-fc21-4846-bfcb-a4500e86083e - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 01:37:18.640 1 WARNING oslo_config.cfg [req-bd0356d3-fc21-4846-bfcb-a4500e86083e - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:37:18.641 1 WARNING oslo_config.cfg [req-bd0356d3-fc21-4846-bfcb-a4500e86083e - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:37:18.641 1 WARNING oslo_config.cfg [req-bd0356d3-fc21-4846-bfcb-a4500e86083e - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:37:18.647 1 WARNING oslo_config.cfg [req-bd0356d3-fc21-4846-bfcb-a4500e86083e - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 01:37:18.648 1 WARNING oslo_config.cfg [req-bd0356d3-fc21-4846-bfcb-a4500e86083e - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 01:37:18.651 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 01:37:18.660 1 INFO cinder.manager [req-16ba733b-8819-40da-be19-1abf42d30a5e - - - - -] Initiating service 5 cleanup
>2018-06-26 01:37:18.667 1 INFO cinder.manager [req-16ba733b-8819-40da-be19-1abf42d30a5e - - - - -] Service 5 cleanup completed.
>2018-06-26 01:39:24.651 1 ERROR oslo.messaging._drivers.impl_rabbit [req-16ba733b-8819-40da-be19-1abf42d30a5e - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:39:24.653 1 ERROR oslo.messaging._drivers.impl_rabbit [req-16ba733b-8819-40da-be19-1abf42d30a5e - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:39:24.654 1 ERROR oslo_service.service [req-16ba733b-8819-40da-be19-1abf42d30a5e - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:39:24.654 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 01:39:24.654 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 01:39:24.654 1 ERROR oslo_service.service     service.start()
>2018-06-26 01:39:24.654 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 01:39:24.654 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 01:39:24.654 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 01:39:24.654 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 01:39:24.654 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 01:39:24.654 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 01:39:24.654 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 01:39:24.654 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 01:39:24.654 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 01:39:24.654 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 01:39:24.654 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 01:39:24.654 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 01:39:24.654 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 01:39:24.654 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 01:39:24.654 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 01:39:24.654 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 01:39:24.654 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 01:39:24.654 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 01:39:24.654 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 01:39:24.654 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 01:39:24.654 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 01:39:24.654 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 01:39:24.654 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:39:24.654 1 ERROR oslo_service.service 
>2018-06-26 01:39:24.657 1 CRITICAL cinder [req-bd0356d3-fc21-4846-bfcb-a4500e86083e - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 01:39:24.657 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 01:39:24.657 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 01:39:24.657 1 ERROR cinder     sys.exit(main())
>2018-06-26 01:39:24.657 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 01:39:24.657 1 ERROR cinder     service.wait()
>2018-06-26 01:39:24.657 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 01:39:24.657 1 ERROR cinder     _launcher.wait()
>2018-06-26 01:39:24.657 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 01:39:24.657 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 01:39:24.657 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 01:39:24.657 1 ERROR cinder     self.services.wait()
>2018-06-26 01:39:24.657 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 01:39:24.657 1 ERROR cinder     service.wait()
>2018-06-26 01:39:24.657 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 01:39:24.657 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 01:39:24.657 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 01:39:24.657 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 01:39:24.657 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 01:39:24.657 1 ERROR cinder     post_fn = fn()
>2018-06-26 01:39:24.657 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 01:39:24.657 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 01:39:24.657 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 01:39:24.657 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 01:39:24.657 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 01:39:24.657 1 ERROR cinder 
>2018-06-26 01:39:27.535 1 WARNING cinder.scheduler.host_manager [req-a46ed94c-95fc-472c-8bae-aeb7161b1c34 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 01:39:27.541 1 INFO cinder.rpc [req-a46ed94c-95fc-472c-8bae-aeb7161b1c34 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 01:39:27.549 1 INFO cinder.rpc [req-a46ed94c-95fc-472c-8bae-aeb7161b1c34 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 01:39:27.565 1 INFO cinder.rpc [req-a46ed94c-95fc-472c-8bae-aeb7161b1c34 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 01:39:27.571 1 INFO cinder.rpc [req-a46ed94c-95fc-472c-8bae-aeb7161b1c34 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 01:39:27.598 1 WARNING oslo_config.cfg [req-a46ed94c-95fc-472c-8bae-aeb7161b1c34 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 01:39:27.601 1 WARNING oslo_config.cfg [req-a46ed94c-95fc-472c-8bae-aeb7161b1c34 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:39:27.601 1 WARNING oslo_config.cfg [req-a46ed94c-95fc-472c-8bae-aeb7161b1c34 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:39:27.602 1 WARNING oslo_config.cfg [req-a46ed94c-95fc-472c-8bae-aeb7161b1c34 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:39:27.608 1 WARNING oslo_config.cfg [req-a46ed94c-95fc-472c-8bae-aeb7161b1c34 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 01:39:27.609 1 WARNING oslo_config.cfg [req-a46ed94c-95fc-472c-8bae-aeb7161b1c34 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 01:39:27.612 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 01:39:27.618 1 INFO cinder.manager [req-c8e7460f-d8ff-420b-82a0-778cd14b5105 - - - - -] Initiating service 5 cleanup
>2018-06-26 01:39:27.622 1 INFO cinder.manager [req-c8e7460f-d8ff-420b-82a0-778cd14b5105 - - - - -] Service 5 cleanup completed.
>2018-06-26 01:41:39.202 1 ERROR oslo.messaging._drivers.impl_rabbit [req-c8e7460f-d8ff-420b-82a0-778cd14b5105 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:41:39.204 1 ERROR oslo.messaging._drivers.impl_rabbit [req-c8e7460f-d8ff-420b-82a0-778cd14b5105 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:41:39.204 1 ERROR oslo_service.service [req-c8e7460f-d8ff-420b-82a0-778cd14b5105 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:41:39.204 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 01:41:39.204 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 01:41:39.204 1 ERROR oslo_service.service     service.start()
>2018-06-26 01:41:39.204 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 01:41:39.204 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 01:41:39.204 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 01:41:39.204 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 01:41:39.204 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 01:41:39.204 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 01:41:39.204 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 01:41:39.204 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 01:41:39.204 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 01:41:39.204 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 01:41:39.204 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 01:41:39.204 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 01:41:39.204 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 01:41:39.204 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 01:41:39.204 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 01:41:39.204 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 01:41:39.204 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 01:41:39.204 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 01:41:39.204 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 01:41:39.204 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 01:41:39.204 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 01:41:39.204 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 01:41:39.204 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:41:39.204 1 ERROR oslo_service.service 
>2018-06-26 01:41:39.207 1 CRITICAL cinder [req-a46ed94c-95fc-472c-8bae-aeb7161b1c34 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 01:41:39.207 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 01:41:39.207 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 01:41:39.207 1 ERROR cinder     sys.exit(main())
>2018-06-26 01:41:39.207 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 01:41:39.207 1 ERROR cinder     service.wait()
>2018-06-26 01:41:39.207 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 01:41:39.207 1 ERROR cinder     _launcher.wait()
>2018-06-26 01:41:39.207 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 01:41:39.207 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 01:41:39.207 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 01:41:39.207 1 ERROR cinder     self.services.wait()
>2018-06-26 01:41:39.207 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 01:41:39.207 1 ERROR cinder     service.wait()
>2018-06-26 01:41:39.207 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 01:41:39.207 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 01:41:39.207 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 01:41:39.207 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 01:41:39.207 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 01:41:39.207 1 ERROR cinder     post_fn = fn()
>2018-06-26 01:41:39.207 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 01:41:39.207 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 01:41:39.207 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 01:41:39.207 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 01:41:39.207 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 01:41:39.207 1 ERROR cinder 
>2018-06-26 01:41:41.743 1 WARNING cinder.scheduler.host_manager [req-3e94dcf3-b74b-4e4e-bcb7-1eaa4ca3697a - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 01:41:41.748 1 INFO cinder.rpc [req-3e94dcf3-b74b-4e4e-bcb7-1eaa4ca3697a - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 01:41:41.753 1 INFO cinder.rpc [req-3e94dcf3-b74b-4e4e-bcb7-1eaa4ca3697a - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 01:41:41.767 1 INFO cinder.rpc [req-3e94dcf3-b74b-4e4e-bcb7-1eaa4ca3697a - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 01:41:41.774 1 INFO cinder.rpc [req-3e94dcf3-b74b-4e4e-bcb7-1eaa4ca3697a - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 01:41:41.796 1 WARNING oslo_config.cfg [req-3e94dcf3-b74b-4e4e-bcb7-1eaa4ca3697a - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 01:41:41.798 1 WARNING oslo_config.cfg [req-3e94dcf3-b74b-4e4e-bcb7-1eaa4ca3697a - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:41:41.798 1 WARNING oslo_config.cfg [req-3e94dcf3-b74b-4e4e-bcb7-1eaa4ca3697a - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:41:41.799 1 WARNING oslo_config.cfg [req-3e94dcf3-b74b-4e4e-bcb7-1eaa4ca3697a - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:41:41.803 1 WARNING oslo_config.cfg [req-3e94dcf3-b74b-4e4e-bcb7-1eaa4ca3697a - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 01:41:41.805 1 WARNING oslo_config.cfg [req-3e94dcf3-b74b-4e4e-bcb7-1eaa4ca3697a - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 01:41:41.807 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 01:41:41.813 1 INFO cinder.manager [req-ca862c85-2911-46dc-adf4-1a46888412de - - - - -] Initiating service 5 cleanup
>2018-06-26 01:41:41.817 1 INFO cinder.manager [req-ca862c85-2911-46dc-adf4-1a46888412de - - - - -] Service 5 cleanup completed.
>2018-06-26 01:43:53.751 1 ERROR oslo.messaging._drivers.impl_rabbit [req-ca862c85-2911-46dc-adf4-1a46888412de - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:43:53.753 1 ERROR oslo.messaging._drivers.impl_rabbit [req-ca862c85-2911-46dc-adf4-1a46888412de - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:43:53.753 1 ERROR oslo_service.service [req-ca862c85-2911-46dc-adf4-1a46888412de - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:43:53.753 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 01:43:53.753 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 01:43:53.753 1 ERROR oslo_service.service     service.start()
>2018-06-26 01:43:53.753 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 01:43:53.753 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 01:43:53.753 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 01:43:53.753 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 01:43:53.753 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 01:43:53.753 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 01:43:53.753 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 01:43:53.753 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 01:43:53.753 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 01:43:53.753 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 01:43:53.753 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 01:43:53.753 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 01:43:53.753 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 01:43:53.753 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 01:43:53.753 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 01:43:53.753 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 01:43:53.753 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 01:43:53.753 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 01:43:53.753 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 01:43:53.753 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 01:43:53.753 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 01:43:53.753 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 01:43:53.753 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:43:53.753 1 ERROR oslo_service.service 
>2018-06-26 01:43:53.756 1 CRITICAL cinder [req-3e94dcf3-b74b-4e4e-bcb7-1eaa4ca3697a - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 01:43:53.756 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 01:43:53.756 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 01:43:53.756 1 ERROR cinder     sys.exit(main())
>2018-06-26 01:43:53.756 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 01:43:53.756 1 ERROR cinder     service.wait()
>2018-06-26 01:43:53.756 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 01:43:53.756 1 ERROR cinder     _launcher.wait()
>2018-06-26 01:43:53.756 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 01:43:53.756 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 01:43:53.756 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 01:43:53.756 1 ERROR cinder     self.services.wait()
>2018-06-26 01:43:53.756 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 01:43:53.756 1 ERROR cinder     service.wait()
>2018-06-26 01:43:53.756 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 01:43:53.756 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 01:43:53.756 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 01:43:53.756 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 01:43:53.756 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 01:43:53.756 1 ERROR cinder     post_fn = fn()
>2018-06-26 01:43:53.756 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 01:43:53.756 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 01:43:53.756 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 01:43:53.756 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 01:43:53.756 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 01:43:53.756 1 ERROR cinder 
>2018-06-26 01:43:56.450 1 WARNING cinder.scheduler.host_manager [req-7eba32f7-95f3-4868-9a6b-0fbf190512f2 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 01:43:56.456 1 INFO cinder.rpc [req-7eba32f7-95f3-4868-9a6b-0fbf190512f2 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 01:43:56.461 1 INFO cinder.rpc [req-7eba32f7-95f3-4868-9a6b-0fbf190512f2 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 01:43:56.473 1 INFO cinder.rpc [req-7eba32f7-95f3-4868-9a6b-0fbf190512f2 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 01:43:56.479 1 INFO cinder.rpc [req-7eba32f7-95f3-4868-9a6b-0fbf190512f2 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 01:43:56.503 1 WARNING oslo_config.cfg [req-7eba32f7-95f3-4868-9a6b-0fbf190512f2 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 01:43:56.505 1 WARNING oslo_config.cfg [req-7eba32f7-95f3-4868-9a6b-0fbf190512f2 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:43:56.506 1 WARNING oslo_config.cfg [req-7eba32f7-95f3-4868-9a6b-0fbf190512f2 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:43:56.507 1 WARNING oslo_config.cfg [req-7eba32f7-95f3-4868-9a6b-0fbf190512f2 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:43:56.511 1 WARNING oslo_config.cfg [req-7eba32f7-95f3-4868-9a6b-0fbf190512f2 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 01:43:56.513 1 WARNING oslo_config.cfg [req-7eba32f7-95f3-4868-9a6b-0fbf190512f2 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 01:43:56.516 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 01:43:56.522 1 INFO cinder.manager [req-4fc20178-f130-4bdc-ad7c-397428aae997 - - - - -] Initiating service 5 cleanup
>2018-06-26 01:43:56.526 1 INFO cinder.manager [req-4fc20178-f130-4bdc-ad7c-397428aae997 - - - - -] Service 5 cleanup completed.
>2018-06-26 01:46:08.921 1 ERROR oslo.messaging._drivers.impl_rabbit [req-4fc20178-f130-4bdc-ad7c-397428aae997 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:46:08.923 1 ERROR oslo.messaging._drivers.impl_rabbit [req-4fc20178-f130-4bdc-ad7c-397428aae997 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:46:08.923 1 ERROR oslo_service.service [req-4fc20178-f130-4bdc-ad7c-397428aae997 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:46:08.923 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 01:46:08.923 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 01:46:08.923 1 ERROR oslo_service.service     service.start()
>2018-06-26 01:46:08.923 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 01:46:08.923 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 01:46:08.923 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 01:46:08.923 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 01:46:08.923 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 01:46:08.923 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 01:46:08.923 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 01:46:08.923 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 01:46:08.923 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 01:46:08.923 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 01:46:08.923 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 01:46:08.923 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 01:46:08.923 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 01:46:08.923 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 01:46:08.923 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 01:46:08.923 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 01:46:08.923 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 01:46:08.923 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 01:46:08.923 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 01:46:08.923 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 01:46:08.923 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 01:46:08.923 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 01:46:08.923 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:46:08.923 1 ERROR oslo_service.service 
>2018-06-26 01:46:08.925 1 CRITICAL cinder [req-7eba32f7-95f3-4868-9a6b-0fbf190512f2 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 01:46:08.925 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 01:46:08.925 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 01:46:08.925 1 ERROR cinder     sys.exit(main())
>2018-06-26 01:46:08.925 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 01:46:08.925 1 ERROR cinder     service.wait()
>2018-06-26 01:46:08.925 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 01:46:08.925 1 ERROR cinder     _launcher.wait()
>2018-06-26 01:46:08.925 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 01:46:08.925 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 01:46:08.925 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 01:46:08.925 1 ERROR cinder     self.services.wait()
>2018-06-26 01:46:08.925 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 01:46:08.925 1 ERROR cinder     service.wait()
>2018-06-26 01:46:08.925 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 01:46:08.925 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 01:46:08.925 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 01:46:08.925 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 01:46:08.925 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 01:46:08.925 1 ERROR cinder     post_fn = fn()
>2018-06-26 01:46:08.925 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 01:46:08.925 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 01:46:08.925 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 01:46:08.925 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 01:46:08.925 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 01:46:08.925 1 ERROR cinder 
>2018-06-26 01:46:11.507 1 WARNING cinder.scheduler.host_manager [req-59e95d48-3ca4-454e-9a13-ad361c39133a - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 01:46:11.515 1 INFO cinder.rpc [req-59e95d48-3ca4-454e-9a13-ad361c39133a - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 01:46:11.520 1 INFO cinder.rpc [req-59e95d48-3ca4-454e-9a13-ad361c39133a - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 01:46:11.533 1 INFO cinder.rpc [req-59e95d48-3ca4-454e-9a13-ad361c39133a - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 01:46:11.538 1 INFO cinder.rpc [req-59e95d48-3ca4-454e-9a13-ad361c39133a - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 01:46:11.560 1 WARNING oslo_config.cfg [req-59e95d48-3ca4-454e-9a13-ad361c39133a - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 01:46:11.562 1 WARNING oslo_config.cfg [req-59e95d48-3ca4-454e-9a13-ad361c39133a - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:46:11.563 1 WARNING oslo_config.cfg [req-59e95d48-3ca4-454e-9a13-ad361c39133a - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:46:11.564 1 WARNING oslo_config.cfg [req-59e95d48-3ca4-454e-9a13-ad361c39133a - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:46:11.569 1 WARNING oslo_config.cfg [req-59e95d48-3ca4-454e-9a13-ad361c39133a - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 01:46:11.570 1 WARNING oslo_config.cfg [req-59e95d48-3ca4-454e-9a13-ad361c39133a - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 01:46:11.572 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 01:46:11.579 1 INFO cinder.manager [req-c8c0ab83-4cb1-48f8-b754-470ab65f821a - - - - -] Initiating service 5 cleanup
>2018-06-26 01:46:11.584 1 INFO cinder.manager [req-c8c0ab83-4cb1-48f8-b754-470ab65f821a - - - - -] Service 5 cleanup completed.
>2018-06-26 01:48:23.751 1 ERROR oslo.messaging._drivers.impl_rabbit [req-c8c0ab83-4cb1-48f8-b754-470ab65f821a - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:48:23.753 1 ERROR oslo.messaging._drivers.impl_rabbit [req-c8c0ab83-4cb1-48f8-b754-470ab65f821a - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:48:23.754 1 ERROR oslo_service.service [req-c8c0ab83-4cb1-48f8-b754-470ab65f821a - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:48:23.754 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 01:48:23.754 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 01:48:23.754 1 ERROR oslo_service.service     service.start()
>2018-06-26 01:48:23.754 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 01:48:23.754 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 01:48:23.754 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 01:48:23.754 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 01:48:23.754 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 01:48:23.754 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 01:48:23.754 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 01:48:23.754 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 01:48:23.754 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 01:48:23.754 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 01:48:23.754 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 01:48:23.754 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 01:48:23.754 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 01:48:23.754 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 01:48:23.754 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 01:48:23.754 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 01:48:23.754 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 01:48:23.754 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 01:48:23.754 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 01:48:23.754 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 01:48:23.754 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 01:48:23.754 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 01:48:23.754 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:48:23.754 1 ERROR oslo_service.service 
>2018-06-26 01:48:23.757 1 CRITICAL cinder [req-59e95d48-3ca4-454e-9a13-ad361c39133a - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 01:48:23.757 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 01:48:23.757 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 01:48:23.757 1 ERROR cinder     sys.exit(main())
>2018-06-26 01:48:23.757 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 01:48:23.757 1 ERROR cinder     service.wait()
>2018-06-26 01:48:23.757 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 01:48:23.757 1 ERROR cinder     _launcher.wait()
>2018-06-26 01:48:23.757 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 01:48:23.757 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 01:48:23.757 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 01:48:23.757 1 ERROR cinder     self.services.wait()
>2018-06-26 01:48:23.757 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 01:48:23.757 1 ERROR cinder     service.wait()
>2018-06-26 01:48:23.757 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 01:48:23.757 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 01:48:23.757 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 01:48:23.757 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 01:48:23.757 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 01:48:23.757 1 ERROR cinder     post_fn = fn()
>2018-06-26 01:48:23.757 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 01:48:23.757 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 01:48:23.757 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 01:48:23.757 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 01:48:23.757 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 01:48:23.757 1 ERROR cinder 
>2018-06-26 01:48:26.370 1 WARNING cinder.scheduler.host_manager [req-32cd214b-a1c0-472e-9a48-df286fed6bd2 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 01:48:26.377 1 INFO cinder.rpc [req-32cd214b-a1c0-472e-9a48-df286fed6bd2 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 01:48:26.382 1 INFO cinder.rpc [req-32cd214b-a1c0-472e-9a48-df286fed6bd2 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 01:48:26.398 1 INFO cinder.rpc [req-32cd214b-a1c0-472e-9a48-df286fed6bd2 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 01:48:26.404 1 INFO cinder.rpc [req-32cd214b-a1c0-472e-9a48-df286fed6bd2 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 01:48:26.429 1 WARNING oslo_config.cfg [req-32cd214b-a1c0-472e-9a48-df286fed6bd2 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 01:48:26.431 1 WARNING oslo_config.cfg [req-32cd214b-a1c0-472e-9a48-df286fed6bd2 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:48:26.431 1 WARNING oslo_config.cfg [req-32cd214b-a1c0-472e-9a48-df286fed6bd2 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:48:26.432 1 WARNING oslo_config.cfg [req-32cd214b-a1c0-472e-9a48-df286fed6bd2 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:48:26.437 1 WARNING oslo_config.cfg [req-32cd214b-a1c0-472e-9a48-df286fed6bd2 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 01:48:26.438 1 WARNING oslo_config.cfg [req-32cd214b-a1c0-472e-9a48-df286fed6bd2 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 01:48:26.441 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 01:48:26.448 1 INFO cinder.manager [req-a85b0790-753d-46e7-9272-c127120f764f - - - - -] Initiating service 5 cleanup
>2018-06-26 01:48:26.452 1 INFO cinder.manager [req-a85b0790-753d-46e7-9272-c127120f764f - - - - -] Service 5 cleanup completed.
>2018-06-26 01:50:30.807 1 ERROR oslo.messaging._drivers.impl_rabbit [req-a85b0790-753d-46e7-9272-c127120f764f - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:50:30.809 1 ERROR oslo.messaging._drivers.impl_rabbit [req-a85b0790-753d-46e7-9272-c127120f764f - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:50:30.809 1 ERROR oslo_service.service [req-a85b0790-753d-46e7-9272-c127120f764f - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:50:30.809 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 01:50:30.809 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 01:50:30.809 1 ERROR oslo_service.service     service.start()
>2018-06-26 01:50:30.809 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 01:50:30.809 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 01:50:30.809 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 01:50:30.809 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 01:50:30.809 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 01:50:30.809 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 01:50:30.809 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 01:50:30.809 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 01:50:30.809 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 01:50:30.809 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 01:50:30.809 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 01:50:30.809 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 01:50:30.809 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 01:50:30.809 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 01:50:30.809 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 01:50:30.809 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 01:50:30.809 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 01:50:30.809 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 01:50:30.809 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 01:50:30.809 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 01:50:30.809 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 01:50:30.809 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 01:50:30.809 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:50:30.809 1 ERROR oslo_service.service 
>2018-06-26 01:50:30.813 1 CRITICAL cinder [req-32cd214b-a1c0-472e-9a48-df286fed6bd2 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 01:50:30.813 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 01:50:30.813 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 01:50:30.813 1 ERROR cinder     sys.exit(main())
>2018-06-26 01:50:30.813 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 01:50:30.813 1 ERROR cinder     service.wait()
>2018-06-26 01:50:30.813 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 01:50:30.813 1 ERROR cinder     _launcher.wait()
>2018-06-26 01:50:30.813 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 01:50:30.813 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 01:50:30.813 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 01:50:30.813 1 ERROR cinder     self.services.wait()
>2018-06-26 01:50:30.813 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 01:50:30.813 1 ERROR cinder     service.wait()
>2018-06-26 01:50:30.813 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 01:50:30.813 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 01:50:30.813 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 01:50:30.813 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 01:50:30.813 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 01:50:30.813 1 ERROR cinder     post_fn = fn()
>2018-06-26 01:50:30.813 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 01:50:30.813 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 01:50:30.813 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 01:50:30.813 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 01:50:30.813 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 01:50:30.813 1 ERROR cinder 
>2018-06-26 01:50:33.870 1 WARNING cinder.scheduler.host_manager [req-dd848737-b707-49c3-90fb-dc97c69410f6 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 01:50:33.876 1 INFO cinder.rpc [req-dd848737-b707-49c3-90fb-dc97c69410f6 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 01:50:33.882 1 INFO cinder.rpc [req-dd848737-b707-49c3-90fb-dc97c69410f6 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 01:50:33.894 1 INFO cinder.rpc [req-dd848737-b707-49c3-90fb-dc97c69410f6 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 01:50:33.902 1 INFO cinder.rpc [req-dd848737-b707-49c3-90fb-dc97c69410f6 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 01:50:33.934 1 WARNING oslo_config.cfg [req-dd848737-b707-49c3-90fb-dc97c69410f6 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 01:50:33.936 1 WARNING oslo_config.cfg [req-dd848737-b707-49c3-90fb-dc97c69410f6 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:50:33.937 1 WARNING oslo_config.cfg [req-dd848737-b707-49c3-90fb-dc97c69410f6 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:50:33.937 1 WARNING oslo_config.cfg [req-dd848737-b707-49c3-90fb-dc97c69410f6 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:50:33.942 1 WARNING oslo_config.cfg [req-dd848737-b707-49c3-90fb-dc97c69410f6 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 01:50:33.943 1 WARNING oslo_config.cfg [req-dd848737-b707-49c3-90fb-dc97c69410f6 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 01:50:33.946 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 01:50:33.952 1 INFO cinder.manager [req-4694f0ce-1805-48cf-a604-9954095a86c3 - - - - -] Initiating service 5 cleanup
>2018-06-26 01:50:33.957 1 INFO cinder.manager [req-4694f0ce-1805-48cf-a604-9954095a86c3 - - - - -] Service 5 cleanup completed.
>2018-06-26 01:52:45.676 1 ERROR oslo.messaging._drivers.impl_rabbit [req-4694f0ce-1805-48cf-a604-9954095a86c3 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:52:45.678 1 ERROR oslo.messaging._drivers.impl_rabbit [req-4694f0ce-1805-48cf-a604-9954095a86c3 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:52:45.678 1 ERROR oslo_service.service [req-4694f0ce-1805-48cf-a604-9954095a86c3 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:52:45.678 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 01:52:45.678 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 01:52:45.678 1 ERROR oslo_service.service     service.start()
>2018-06-26 01:52:45.678 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 01:52:45.678 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 01:52:45.678 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 01:52:45.678 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 01:52:45.678 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 01:52:45.678 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 01:52:45.678 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 01:52:45.678 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 01:52:45.678 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 01:52:45.678 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 01:52:45.678 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 01:52:45.678 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 01:52:45.678 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 01:52:45.678 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 01:52:45.678 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 01:52:45.678 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 01:52:45.678 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 01:52:45.678 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 01:52:45.678 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 01:52:45.678 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 01:52:45.678 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 01:52:45.678 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 01:52:45.678 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:52:45.678 1 ERROR oslo_service.service 
>2018-06-26 01:52:45.681 1 CRITICAL cinder [req-dd848737-b707-49c3-90fb-dc97c69410f6 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 01:52:45.681 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 01:52:45.681 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 01:52:45.681 1 ERROR cinder     sys.exit(main())
>2018-06-26 01:52:45.681 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 01:52:45.681 1 ERROR cinder     service.wait()
>2018-06-26 01:52:45.681 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 01:52:45.681 1 ERROR cinder     _launcher.wait()
>2018-06-26 01:52:45.681 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 01:52:45.681 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 01:52:45.681 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 01:52:45.681 1 ERROR cinder     self.services.wait()
>2018-06-26 01:52:45.681 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 01:52:45.681 1 ERROR cinder     service.wait()
>2018-06-26 01:52:45.681 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 01:52:45.681 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 01:52:45.681 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 01:52:45.681 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 01:52:45.681 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 01:52:45.681 1 ERROR cinder     post_fn = fn()
>2018-06-26 01:52:45.681 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 01:52:45.681 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 01:52:45.681 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 01:52:45.681 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 01:52:45.681 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 01:52:45.681 1 ERROR cinder 
>2018-06-26 01:52:48.287 1 WARNING cinder.scheduler.host_manager [req-ccd56800-7db5-413b-9bf7-5c57fb11b0f2 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 01:52:48.295 1 INFO cinder.rpc [req-ccd56800-7db5-413b-9bf7-5c57fb11b0f2 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 01:52:48.303 1 INFO cinder.rpc [req-ccd56800-7db5-413b-9bf7-5c57fb11b0f2 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 01:52:48.319 1 INFO cinder.rpc [req-ccd56800-7db5-413b-9bf7-5c57fb11b0f2 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 01:52:48.328 1 INFO cinder.rpc [req-ccd56800-7db5-413b-9bf7-5c57fb11b0f2 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 01:52:48.356 1 WARNING oslo_config.cfg [req-ccd56800-7db5-413b-9bf7-5c57fb11b0f2 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 01:52:48.359 1 WARNING oslo_config.cfg [req-ccd56800-7db5-413b-9bf7-5c57fb11b0f2 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:52:48.359 1 WARNING oslo_config.cfg [req-ccd56800-7db5-413b-9bf7-5c57fb11b0f2 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:52:48.360 1 WARNING oslo_config.cfg [req-ccd56800-7db5-413b-9bf7-5c57fb11b0f2 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:52:48.365 1 WARNING oslo_config.cfg [req-ccd56800-7db5-413b-9bf7-5c57fb11b0f2 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 01:52:48.366 1 WARNING oslo_config.cfg [req-ccd56800-7db5-413b-9bf7-5c57fb11b0f2 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 01:52:48.368 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 01:52:48.375 1 INFO cinder.manager [req-db3a410f-ddfd-4b74-b9df-c705e5d214c8 - - - - -] Initiating service 5 cleanup
>2018-06-26 01:52:48.381 1 INFO cinder.manager [req-db3a410f-ddfd-4b74-b9df-c705e5d214c8 - - - - -] Service 5 cleanup completed.
>2018-06-26 01:54:52.753 1 ERROR oslo.messaging._drivers.impl_rabbit [req-db3a410f-ddfd-4b74-b9df-c705e5d214c8 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:54:52.755 1 ERROR oslo.messaging._drivers.impl_rabbit [req-db3a410f-ddfd-4b74-b9df-c705e5d214c8 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:54:52.756 1 ERROR oslo_service.service [req-db3a410f-ddfd-4b74-b9df-c705e5d214c8 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:54:52.756 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 01:54:52.756 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 01:54:52.756 1 ERROR oslo_service.service     service.start()
>2018-06-26 01:54:52.756 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 01:54:52.756 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 01:54:52.756 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 01:54:52.756 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 01:54:52.756 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 01:54:52.756 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 01:54:52.756 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 01:54:52.756 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 01:54:52.756 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 01:54:52.756 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 01:54:52.756 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 01:54:52.756 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 01:54:52.756 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 01:54:52.756 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 01:54:52.756 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 01:54:52.756 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 01:54:52.756 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 01:54:52.756 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 01:54:52.756 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 01:54:52.756 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 01:54:52.756 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 01:54:52.756 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 01:54:52.756 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:54:52.756 1 ERROR oslo_service.service 
>2018-06-26 01:54:52.759 1 CRITICAL cinder [req-ccd56800-7db5-413b-9bf7-5c57fb11b0f2 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 01:54:52.759 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 01:54:52.759 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 01:54:52.759 1 ERROR cinder     sys.exit(main())
>2018-06-26 01:54:52.759 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 01:54:52.759 1 ERROR cinder     service.wait()
>2018-06-26 01:54:52.759 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 01:54:52.759 1 ERROR cinder     _launcher.wait()
>2018-06-26 01:54:52.759 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 01:54:52.759 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 01:54:52.759 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 01:54:52.759 1 ERROR cinder     self.services.wait()
>2018-06-26 01:54:52.759 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 01:54:52.759 1 ERROR cinder     service.wait()
>2018-06-26 01:54:52.759 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 01:54:52.759 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 01:54:52.759 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 01:54:52.759 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 01:54:52.759 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 01:54:52.759 1 ERROR cinder     post_fn = fn()
>2018-06-26 01:54:52.759 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 01:54:52.759 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 01:54:52.759 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 01:54:52.759 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 01:54:52.759 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 01:54:52.759 1 ERROR cinder 
>2018-06-26 01:54:55.335 1 WARNING cinder.scheduler.host_manager [req-5138675a-863c-41d7-ab62-b1dcd2cdc92c - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 01:54:55.341 1 INFO cinder.rpc [req-5138675a-863c-41d7-ab62-b1dcd2cdc92c - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 01:54:55.347 1 INFO cinder.rpc [req-5138675a-863c-41d7-ab62-b1dcd2cdc92c - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 01:54:55.359 1 INFO cinder.rpc [req-5138675a-863c-41d7-ab62-b1dcd2cdc92c - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 01:54:55.365 1 INFO cinder.rpc [req-5138675a-863c-41d7-ab62-b1dcd2cdc92c - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 01:54:55.392 1 WARNING oslo_config.cfg [req-5138675a-863c-41d7-ab62-b1dcd2cdc92c - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 01:54:55.394 1 WARNING oslo_config.cfg [req-5138675a-863c-41d7-ab62-b1dcd2cdc92c - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:54:55.394 1 WARNING oslo_config.cfg [req-5138675a-863c-41d7-ab62-b1dcd2cdc92c - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:54:55.395 1 WARNING oslo_config.cfg [req-5138675a-863c-41d7-ab62-b1dcd2cdc92c - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:54:55.399 1 WARNING oslo_config.cfg [req-5138675a-863c-41d7-ab62-b1dcd2cdc92c - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 01:54:55.401 1 WARNING oslo_config.cfg [req-5138675a-863c-41d7-ab62-b1dcd2cdc92c - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 01:54:55.403 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 01:54:55.408 1 INFO cinder.manager [req-f3c325ce-949c-469a-bcdf-71c2ad731932 - - - - -] Initiating service 5 cleanup
>2018-06-26 01:54:55.415 1 INFO cinder.manager [req-f3c325ce-949c-469a-bcdf-71c2ad731932 - - - - -] Service 5 cleanup completed.
>2018-06-26 01:57:07.333 1 ERROR oslo.messaging._drivers.impl_rabbit [req-f3c325ce-949c-469a-bcdf-71c2ad731932 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:57:07.335 1 ERROR oslo.messaging._drivers.impl_rabbit [req-f3c325ce-949c-469a-bcdf-71c2ad731932 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:57:07.336 1 ERROR oslo_service.service [req-f3c325ce-949c-469a-bcdf-71c2ad731932 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:57:07.336 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 01:57:07.336 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 01:57:07.336 1 ERROR oslo_service.service     service.start()
>2018-06-26 01:57:07.336 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 01:57:07.336 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 01:57:07.336 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 01:57:07.336 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 01:57:07.336 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 01:57:07.336 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 01:57:07.336 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 01:57:07.336 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 01:57:07.336 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 01:57:07.336 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 01:57:07.336 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 01:57:07.336 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 01:57:07.336 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 01:57:07.336 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 01:57:07.336 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 01:57:07.336 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 01:57:07.336 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 01:57:07.336 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 01:57:07.336 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 01:57:07.336 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 01:57:07.336 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 01:57:07.336 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 01:57:07.336 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:57:07.336 1 ERROR oslo_service.service 
>2018-06-26 01:57:07.339 1 CRITICAL cinder [req-5138675a-863c-41d7-ab62-b1dcd2cdc92c - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 01:57:07.339 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 01:57:07.339 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 01:57:07.339 1 ERROR cinder     sys.exit(main())
>2018-06-26 01:57:07.339 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 01:57:07.339 1 ERROR cinder     service.wait()
>2018-06-26 01:57:07.339 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 01:57:07.339 1 ERROR cinder     _launcher.wait()
>2018-06-26 01:57:07.339 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 01:57:07.339 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 01:57:07.339 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 01:57:07.339 1 ERROR cinder     self.services.wait()
>2018-06-26 01:57:07.339 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 01:57:07.339 1 ERROR cinder     service.wait()
>2018-06-26 01:57:07.339 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 01:57:07.339 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 01:57:07.339 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 01:57:07.339 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 01:57:07.339 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 01:57:07.339 1 ERROR cinder     post_fn = fn()
>2018-06-26 01:57:07.339 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 01:57:07.339 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 01:57:07.339 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 01:57:07.339 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 01:57:07.339 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 01:57:07.339 1 ERROR cinder 
>2018-06-26 01:57:09.999 1 WARNING cinder.scheduler.host_manager [req-44c1823f-699f-401c-b2ef-e945fd706c99 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 01:57:10.006 1 INFO cinder.rpc [req-44c1823f-699f-401c-b2ef-e945fd706c99 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 01:57:10.018 1 INFO cinder.rpc [req-44c1823f-699f-401c-b2ef-e945fd706c99 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 01:57:10.037 1 INFO cinder.rpc [req-44c1823f-699f-401c-b2ef-e945fd706c99 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 01:57:10.045 1 INFO cinder.rpc [req-44c1823f-699f-401c-b2ef-e945fd706c99 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 01:57:10.076 1 WARNING oslo_config.cfg [req-44c1823f-699f-401c-b2ef-e945fd706c99 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 01:57:10.078 1 WARNING oslo_config.cfg [req-44c1823f-699f-401c-b2ef-e945fd706c99 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:57:10.079 1 WARNING oslo_config.cfg [req-44c1823f-699f-401c-b2ef-e945fd706c99 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:57:10.080 1 WARNING oslo_config.cfg [req-44c1823f-699f-401c-b2ef-e945fd706c99 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:57:10.087 1 WARNING oslo_config.cfg [req-44c1823f-699f-401c-b2ef-e945fd706c99 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 01:57:10.088 1 WARNING oslo_config.cfg [req-44c1823f-699f-401c-b2ef-e945fd706c99 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 01:57:10.091 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 01:57:10.098 1 INFO cinder.manager [req-f0ad4633-4344-4676-b4d6-aaa122439374 - - - - -] Initiating service 5 cleanup
>2018-06-26 01:57:10.103 1 INFO cinder.manager [req-f0ad4633-4344-4676-b4d6-aaa122439374 - - - - -] Service 5 cleanup completed.
>2018-06-26 01:59:22.502 1 ERROR oslo.messaging._drivers.impl_rabbit [req-f0ad4633-4344-4676-b4d6-aaa122439374 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:59:22.505 1 ERROR oslo.messaging._drivers.impl_rabbit [req-f0ad4633-4344-4676-b4d6-aaa122439374 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:59:22.505 1 ERROR oslo_service.service [req-f0ad4633-4344-4676-b4d6-aaa122439374 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:59:22.505 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 01:59:22.505 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 01:59:22.505 1 ERROR oslo_service.service     service.start()
>2018-06-26 01:59:22.505 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 01:59:22.505 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 01:59:22.505 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 01:59:22.505 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 01:59:22.505 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 01:59:22.505 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 01:59:22.505 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 01:59:22.505 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 01:59:22.505 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 01:59:22.505 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 01:59:22.505 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 01:59:22.505 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 01:59:22.505 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 01:59:22.505 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 01:59:22.505 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 01:59:22.505 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 01:59:22.505 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 01:59:22.505 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 01:59:22.505 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 01:59:22.505 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 01:59:22.505 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 01:59:22.505 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 01:59:22.505 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 01:59:22.505 1 ERROR oslo_service.service 
>2018-06-26 01:59:22.508 1 CRITICAL cinder [req-44c1823f-699f-401c-b2ef-e945fd706c99 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 01:59:22.508 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 01:59:22.508 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 01:59:22.508 1 ERROR cinder     sys.exit(main())
>2018-06-26 01:59:22.508 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 01:59:22.508 1 ERROR cinder     service.wait()
>2018-06-26 01:59:22.508 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 01:59:22.508 1 ERROR cinder     _launcher.wait()
>2018-06-26 01:59:22.508 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 01:59:22.508 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 01:59:22.508 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 01:59:22.508 1 ERROR cinder     self.services.wait()
>2018-06-26 01:59:22.508 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 01:59:22.508 1 ERROR cinder     service.wait()
>2018-06-26 01:59:22.508 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 01:59:22.508 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 01:59:22.508 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 01:59:22.508 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 01:59:22.508 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 01:59:22.508 1 ERROR cinder     post_fn = fn()
>2018-06-26 01:59:22.508 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 01:59:22.508 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 01:59:22.508 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 01:59:22.508 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 01:59:22.508 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 01:59:22.508 1 ERROR cinder 
>2018-06-26 01:59:25.188 1 WARNING cinder.scheduler.host_manager [req-1269e8c1-0e14-4642-a10e-5f8aef3f0e6a - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 01:59:25.202 1 INFO cinder.rpc [req-1269e8c1-0e14-4642-a10e-5f8aef3f0e6a - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 01:59:25.209 1 INFO cinder.rpc [req-1269e8c1-0e14-4642-a10e-5f8aef3f0e6a - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 01:59:25.223 1 INFO cinder.rpc [req-1269e8c1-0e14-4642-a10e-5f8aef3f0e6a - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 01:59:25.232 1 INFO cinder.rpc [req-1269e8c1-0e14-4642-a10e-5f8aef3f0e6a - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 01:59:25.264 1 WARNING oslo_config.cfg [req-1269e8c1-0e14-4642-a10e-5f8aef3f0e6a - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 01:59:25.267 1 WARNING oslo_config.cfg [req-1269e8c1-0e14-4642-a10e-5f8aef3f0e6a - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:59:25.267 1 WARNING oslo_config.cfg [req-1269e8c1-0e14-4642-a10e-5f8aef3f0e6a - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:59:25.268 1 WARNING oslo_config.cfg [req-1269e8c1-0e14-4642-a10e-5f8aef3f0e6a - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 01:59:25.273 1 WARNING oslo_config.cfg [req-1269e8c1-0e14-4642-a10e-5f8aef3f0e6a - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 01:59:25.274 1 WARNING oslo_config.cfg [req-1269e8c1-0e14-4642-a10e-5f8aef3f0e6a - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 01:59:25.276 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 01:59:25.283 1 INFO cinder.manager [req-d1a012b4-226f-432c-b69f-7f4f02741173 - - - - -] Initiating service 5 cleanup
>2018-06-26 01:59:25.289 1 INFO cinder.manager [req-d1a012b4-226f-432c-b69f-7f4f02741173 - - - - -] Service 5 cleanup completed.
>2018-06-26 02:01:29.735 1 ERROR oslo.messaging._drivers.impl_rabbit [req-d1a012b4-226f-432c-b69f-7f4f02741173 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:01:29.737 1 ERROR oslo.messaging._drivers.impl_rabbit [req-d1a012b4-226f-432c-b69f-7f4f02741173 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:01:29.738 1 ERROR oslo_service.service [req-d1a012b4-226f-432c-b69f-7f4f02741173 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:01:29.738 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 02:01:29.738 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 02:01:29.738 1 ERROR oslo_service.service     service.start()
>2018-06-26 02:01:29.738 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 02:01:29.738 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 02:01:29.738 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 02:01:29.738 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 02:01:29.738 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 02:01:29.738 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 02:01:29.738 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 02:01:29.738 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 02:01:29.738 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 02:01:29.738 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 02:01:29.738 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 02:01:29.738 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 02:01:29.738 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 02:01:29.738 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 02:01:29.738 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 02:01:29.738 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 02:01:29.738 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 02:01:29.738 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 02:01:29.738 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 02:01:29.738 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 02:01:29.738 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 02:01:29.738 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 02:01:29.738 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:01:29.738 1 ERROR oslo_service.service 
>2018-06-26 02:01:29.741 1 CRITICAL cinder [req-1269e8c1-0e14-4642-a10e-5f8aef3f0e6a - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 02:01:29.741 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 02:01:29.741 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 02:01:29.741 1 ERROR cinder     sys.exit(main())
>2018-06-26 02:01:29.741 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 02:01:29.741 1 ERROR cinder     service.wait()
>2018-06-26 02:01:29.741 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 02:01:29.741 1 ERROR cinder     _launcher.wait()
>2018-06-26 02:01:29.741 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 02:01:29.741 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 02:01:29.741 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 02:01:29.741 1 ERROR cinder     self.services.wait()
>2018-06-26 02:01:29.741 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 02:01:29.741 1 ERROR cinder     service.wait()
>2018-06-26 02:01:29.741 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 02:01:29.741 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 02:01:29.741 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 02:01:29.741 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 02:01:29.741 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 02:01:29.741 1 ERROR cinder     post_fn = fn()
>2018-06-26 02:01:29.741 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 02:01:29.741 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 02:01:29.741 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 02:01:29.741 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 02:01:29.741 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 02:01:29.741 1 ERROR cinder 
>2018-06-26 02:01:32.553 1 WARNING cinder.scheduler.host_manager [req-1f1cf91d-33f8-44ad-b7d7-f160222042f6 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 02:01:32.560 1 INFO cinder.rpc [req-1f1cf91d-33f8-44ad-b7d7-f160222042f6 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 02:01:32.572 1 INFO cinder.rpc [req-1f1cf91d-33f8-44ad-b7d7-f160222042f6 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 02:01:32.592 1 INFO cinder.rpc [req-1f1cf91d-33f8-44ad-b7d7-f160222042f6 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 02:01:32.604 1 INFO cinder.rpc [req-1f1cf91d-33f8-44ad-b7d7-f160222042f6 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 02:01:32.643 1 WARNING oslo_config.cfg [req-1f1cf91d-33f8-44ad-b7d7-f160222042f6 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 02:01:32.645 1 WARNING oslo_config.cfg [req-1f1cf91d-33f8-44ad-b7d7-f160222042f6 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:01:32.646 1 WARNING oslo_config.cfg [req-1f1cf91d-33f8-44ad-b7d7-f160222042f6 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:01:32.646 1 WARNING oslo_config.cfg [req-1f1cf91d-33f8-44ad-b7d7-f160222042f6 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:01:32.652 1 WARNING oslo_config.cfg [req-1f1cf91d-33f8-44ad-b7d7-f160222042f6 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 02:01:32.653 1 WARNING oslo_config.cfg [req-1f1cf91d-33f8-44ad-b7d7-f160222042f6 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 02:01:32.656 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 02:01:32.663 1 INFO cinder.manager [req-370203c6-7afd-4bf4-b708-2b86ac1e5bff - - - - -] Initiating service 5 cleanup
>2018-06-26 02:01:32.672 1 INFO cinder.manager [req-370203c6-7afd-4bf4-b708-2b86ac1e5bff - - - - -] Service 5 cleanup completed.
>2018-06-26 02:03:37.079 1 ERROR oslo.messaging._drivers.impl_rabbit [req-370203c6-7afd-4bf4-b708-2b86ac1e5bff - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:03:37.081 1 ERROR oslo.messaging._drivers.impl_rabbit [req-370203c6-7afd-4bf4-b708-2b86ac1e5bff - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:03:37.081 1 ERROR oslo_service.service [req-370203c6-7afd-4bf4-b708-2b86ac1e5bff - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:03:37.081 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 02:03:37.081 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 02:03:37.081 1 ERROR oslo_service.service     service.start()
>2018-06-26 02:03:37.081 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 02:03:37.081 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 02:03:37.081 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 02:03:37.081 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 02:03:37.081 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 02:03:37.081 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 02:03:37.081 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 02:03:37.081 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 02:03:37.081 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 02:03:37.081 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 02:03:37.081 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 02:03:37.081 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 02:03:37.081 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 02:03:37.081 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 02:03:37.081 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 02:03:37.081 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 02:03:37.081 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 02:03:37.081 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 02:03:37.081 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 02:03:37.081 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 02:03:37.081 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 02:03:37.081 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 02:03:37.081 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:03:37.081 1 ERROR oslo_service.service 
>2018-06-26 02:03:37.084 1 CRITICAL cinder [req-1f1cf91d-33f8-44ad-b7d7-f160222042f6 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 02:03:37.084 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 02:03:37.084 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 02:03:37.084 1 ERROR cinder     sys.exit(main())
>2018-06-26 02:03:37.084 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 02:03:37.084 1 ERROR cinder     service.wait()
>2018-06-26 02:03:37.084 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 02:03:37.084 1 ERROR cinder     _launcher.wait()
>2018-06-26 02:03:37.084 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 02:03:37.084 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 02:03:37.084 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 02:03:37.084 1 ERROR cinder     self.services.wait()
>2018-06-26 02:03:37.084 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 02:03:37.084 1 ERROR cinder     service.wait()
>2018-06-26 02:03:37.084 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 02:03:37.084 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 02:03:37.084 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 02:03:37.084 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 02:03:37.084 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 02:03:37.084 1 ERROR cinder     post_fn = fn()
>2018-06-26 02:03:37.084 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 02:03:37.084 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 02:03:37.084 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 02:03:37.084 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 02:03:37.084 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 02:03:37.084 1 ERROR cinder 
>2018-06-26 02:03:39.629 1 WARNING cinder.scheduler.host_manager [req-7282134c-b81a-4d39-afe6-9ee619af777e - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 02:03:39.634 1 INFO cinder.rpc [req-7282134c-b81a-4d39-afe6-9ee619af777e - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 02:03:39.640 1 INFO cinder.rpc [req-7282134c-b81a-4d39-afe6-9ee619af777e - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 02:03:39.652 1 INFO cinder.rpc [req-7282134c-b81a-4d39-afe6-9ee619af777e - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 02:03:39.658 1 INFO cinder.rpc [req-7282134c-b81a-4d39-afe6-9ee619af777e - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 02:03:39.680 1 WARNING oslo_config.cfg [req-7282134c-b81a-4d39-afe6-9ee619af777e - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 02:03:39.682 1 WARNING oslo_config.cfg [req-7282134c-b81a-4d39-afe6-9ee619af777e - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:03:39.683 1 WARNING oslo_config.cfg [req-7282134c-b81a-4d39-afe6-9ee619af777e - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:03:39.683 1 WARNING oslo_config.cfg [req-7282134c-b81a-4d39-afe6-9ee619af777e - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:03:39.689 1 WARNING oslo_config.cfg [req-7282134c-b81a-4d39-afe6-9ee619af777e - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 02:03:39.690 1 WARNING oslo_config.cfg [req-7282134c-b81a-4d39-afe6-9ee619af777e - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 02:03:39.693 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 02:03:39.699 1 INFO cinder.manager [req-e1c4ed7b-02f5-4825-890f-0c7691d030cc - - - - -] Initiating service 5 cleanup
>2018-06-26 02:03:39.704 1 INFO cinder.manager [req-e1c4ed7b-02f5-4825-890f-0c7691d030cc - - - - -] Service 5 cleanup completed.
>2018-06-26 02:05:46.079 1 ERROR oslo.messaging._drivers.impl_rabbit [req-e1c4ed7b-02f5-4825-890f-0c7691d030cc - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:05:46.081 1 ERROR oslo.messaging._drivers.impl_rabbit [req-e1c4ed7b-02f5-4825-890f-0c7691d030cc - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:05:46.081 1 ERROR oslo_service.service [req-e1c4ed7b-02f5-4825-890f-0c7691d030cc - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:05:46.081 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 02:05:46.081 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 02:05:46.081 1 ERROR oslo_service.service     service.start()
>2018-06-26 02:05:46.081 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 02:05:46.081 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 02:05:46.081 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 02:05:46.081 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 02:05:46.081 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 02:05:46.081 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 02:05:46.081 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 02:05:46.081 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 02:05:46.081 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 02:05:46.081 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 02:05:46.081 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 02:05:46.081 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 02:05:46.081 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 02:05:46.081 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 02:05:46.081 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 02:05:46.081 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 02:05:46.081 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 02:05:46.081 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 02:05:46.081 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 02:05:46.081 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 02:05:46.081 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 02:05:46.081 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 02:05:46.081 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:05:46.081 1 ERROR oslo_service.service 
>2018-06-26 02:05:46.083 1 CRITICAL cinder [req-7282134c-b81a-4d39-afe6-9ee619af777e - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 02:05:46.083 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 02:05:46.083 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 02:05:46.083 1 ERROR cinder     sys.exit(main())
>2018-06-26 02:05:46.083 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 02:05:46.083 1 ERROR cinder     service.wait()
>2018-06-26 02:05:46.083 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 02:05:46.083 1 ERROR cinder     _launcher.wait()
>2018-06-26 02:05:46.083 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 02:05:46.083 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 02:05:46.083 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 02:05:46.083 1 ERROR cinder     self.services.wait()
>2018-06-26 02:05:46.083 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 02:05:46.083 1 ERROR cinder     service.wait()
>2018-06-26 02:05:46.083 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 02:05:46.083 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 02:05:46.083 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 02:05:46.083 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 02:05:46.083 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 02:05:46.083 1 ERROR cinder     post_fn = fn()
>2018-06-26 02:05:46.083 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 02:05:46.083 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 02:05:46.083 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 02:05:46.083 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 02:05:46.083 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 02:05:46.083 1 ERROR cinder 
>2018-06-26 02:05:48.779 1 WARNING cinder.scheduler.host_manager [req-64222f9e-07cf-4251-b7b6-5f7da62bf20a - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 02:05:48.785 1 INFO cinder.rpc [req-64222f9e-07cf-4251-b7b6-5f7da62bf20a - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 02:05:48.791 1 INFO cinder.rpc [req-64222f9e-07cf-4251-b7b6-5f7da62bf20a - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 02:05:48.801 1 INFO cinder.rpc [req-64222f9e-07cf-4251-b7b6-5f7da62bf20a - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 02:05:48.807 1 INFO cinder.rpc [req-64222f9e-07cf-4251-b7b6-5f7da62bf20a - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 02:05:48.836 1 WARNING oslo_config.cfg [req-64222f9e-07cf-4251-b7b6-5f7da62bf20a - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 02:05:48.838 1 WARNING oslo_config.cfg [req-64222f9e-07cf-4251-b7b6-5f7da62bf20a - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:05:48.839 1 WARNING oslo_config.cfg [req-64222f9e-07cf-4251-b7b6-5f7da62bf20a - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:05:48.839 1 WARNING oslo_config.cfg [req-64222f9e-07cf-4251-b7b6-5f7da62bf20a - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:05:48.844 1 WARNING oslo_config.cfg [req-64222f9e-07cf-4251-b7b6-5f7da62bf20a - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 02:05:48.846 1 WARNING oslo_config.cfg [req-64222f9e-07cf-4251-b7b6-5f7da62bf20a - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 02:05:48.848 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 02:05:48.854 1 INFO cinder.manager [req-a2141d12-705f-447a-9908-ca30cd5db707 - - - - -] Initiating service 5 cleanup
>2018-06-26 02:05:48.858 1 INFO cinder.manager [req-a2141d12-705f-447a-9908-ca30cd5db707 - - - - -] Service 5 cleanup completed.
>2018-06-26 02:07:53.255 1 ERROR oslo.messaging._drivers.impl_rabbit [req-a2141d12-705f-447a-9908-ca30cd5db707 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:07:53.257 1 ERROR oslo.messaging._drivers.impl_rabbit [req-a2141d12-705f-447a-9908-ca30cd5db707 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:07:53.258 1 ERROR oslo_service.service [req-a2141d12-705f-447a-9908-ca30cd5db707 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:07:53.258 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 02:07:53.258 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 02:07:53.258 1 ERROR oslo_service.service     service.start()
>2018-06-26 02:07:53.258 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 02:07:53.258 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 02:07:53.258 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 02:07:53.258 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 02:07:53.258 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 02:07:53.258 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 02:07:53.258 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 02:07:53.258 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 02:07:53.258 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 02:07:53.258 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 02:07:53.258 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 02:07:53.258 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 02:07:53.258 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 02:07:53.258 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 02:07:53.258 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 02:07:53.258 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 02:07:53.258 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 02:07:53.258 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 02:07:53.258 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 02:07:53.258 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 02:07:53.258 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 02:07:53.258 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 02:07:53.258 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:07:53.258 1 ERROR oslo_service.service 
>2018-06-26 02:07:53.261 1 CRITICAL cinder [req-64222f9e-07cf-4251-b7b6-5f7da62bf20a - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 02:07:53.261 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 02:07:53.261 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 02:07:53.261 1 ERROR cinder     sys.exit(main())
>2018-06-26 02:07:53.261 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 02:07:53.261 1 ERROR cinder     service.wait()
>2018-06-26 02:07:53.261 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 02:07:53.261 1 ERROR cinder     _launcher.wait()
>2018-06-26 02:07:53.261 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 02:07:53.261 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 02:07:53.261 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 02:07:53.261 1 ERROR cinder     self.services.wait()
>2018-06-26 02:07:53.261 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 02:07:53.261 1 ERROR cinder     service.wait()
>2018-06-26 02:07:53.261 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 02:07:53.261 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 02:07:53.261 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 02:07:53.261 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 02:07:53.261 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 02:07:53.261 1 ERROR cinder     post_fn = fn()
>2018-06-26 02:07:53.261 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 02:07:53.261 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 02:07:53.261 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 02:07:53.261 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 02:07:53.261 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 02:07:53.261 1 ERROR cinder 
>2018-06-26 02:07:56.089 1 WARNING cinder.scheduler.host_manager [req-949c58df-8140-476c-a060-1939f3e7bc08 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 02:07:56.095 1 INFO cinder.rpc [req-949c58df-8140-476c-a060-1939f3e7bc08 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 02:07:56.100 1 INFO cinder.rpc [req-949c58df-8140-476c-a060-1939f3e7bc08 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 02:07:56.114 1 INFO cinder.rpc [req-949c58df-8140-476c-a060-1939f3e7bc08 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 02:07:56.120 1 INFO cinder.rpc [req-949c58df-8140-476c-a060-1939f3e7bc08 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 02:07:56.150 1 WARNING oslo_config.cfg [req-949c58df-8140-476c-a060-1939f3e7bc08 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 02:07:56.152 1 WARNING oslo_config.cfg [req-949c58df-8140-476c-a060-1939f3e7bc08 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:07:56.153 1 WARNING oslo_config.cfg [req-949c58df-8140-476c-a060-1939f3e7bc08 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:07:56.153 1 WARNING oslo_config.cfg [req-949c58df-8140-476c-a060-1939f3e7bc08 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:07:56.158 1 WARNING oslo_config.cfg [req-949c58df-8140-476c-a060-1939f3e7bc08 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 02:07:56.160 1 WARNING oslo_config.cfg [req-949c58df-8140-476c-a060-1939f3e7bc08 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 02:07:56.162 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 02:07:56.170 1 INFO cinder.manager [req-609fa56f-8ae6-4b07-a8a8-65323f9ba534 - - - - -] Initiating service 5 cleanup
>2018-06-26 02:07:56.179 1 INFO cinder.manager [req-609fa56f-8ae6-4b07-a8a8-65323f9ba534 - - - - -] Service 5 cleanup completed.
>2018-06-26 02:10:00.549 1 ERROR oslo.messaging._drivers.impl_rabbit [req-609fa56f-8ae6-4b07-a8a8-65323f9ba534 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:10:00.551 1 ERROR oslo.messaging._drivers.impl_rabbit [req-609fa56f-8ae6-4b07-a8a8-65323f9ba534 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:10:00.551 1 ERROR oslo_service.service [req-609fa56f-8ae6-4b07-a8a8-65323f9ba534 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:10:00.551 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 02:10:00.551 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 02:10:00.551 1 ERROR oslo_service.service     service.start()
>2018-06-26 02:10:00.551 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 02:10:00.551 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 02:10:00.551 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 02:10:00.551 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 02:10:00.551 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 02:10:00.551 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 02:10:00.551 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 02:10:00.551 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 02:10:00.551 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 02:10:00.551 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 02:10:00.551 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 02:10:00.551 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 02:10:00.551 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 02:10:00.551 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 02:10:00.551 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 02:10:00.551 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 02:10:00.551 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 02:10:00.551 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 02:10:00.551 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 02:10:00.551 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 02:10:00.551 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 02:10:00.551 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 02:10:00.551 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:10:00.551 1 ERROR oslo_service.service 
>2018-06-26 02:10:00.554 1 CRITICAL cinder [req-949c58df-8140-476c-a060-1939f3e7bc08 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 02:10:00.554 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 02:10:00.554 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 02:10:00.554 1 ERROR cinder     sys.exit(main())
>2018-06-26 02:10:00.554 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 02:10:00.554 1 ERROR cinder     service.wait()
>2018-06-26 02:10:00.554 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 02:10:00.554 1 ERROR cinder     _launcher.wait()
>2018-06-26 02:10:00.554 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 02:10:00.554 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 02:10:00.554 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 02:10:00.554 1 ERROR cinder     self.services.wait()
>2018-06-26 02:10:00.554 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 02:10:00.554 1 ERROR cinder     service.wait()
>2018-06-26 02:10:00.554 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 02:10:00.554 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 02:10:00.554 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 02:10:00.554 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 02:10:00.554 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 02:10:00.554 1 ERROR cinder     post_fn = fn()
>2018-06-26 02:10:00.554 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 02:10:00.554 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 02:10:00.554 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 02:10:00.554 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 02:10:00.554 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 02:10:00.554 1 ERROR cinder 
>2018-06-26 02:10:03.378 1 WARNING cinder.scheduler.host_manager [req-75efee0d-8958-40c6-9371-095a87450ffa - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 02:10:03.385 1 INFO cinder.rpc [req-75efee0d-8958-40c6-9371-095a87450ffa - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 02:10:03.396 1 INFO cinder.rpc [req-75efee0d-8958-40c6-9371-095a87450ffa - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 02:10:03.413 1 INFO cinder.rpc [req-75efee0d-8958-40c6-9371-095a87450ffa - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 02:10:03.420 1 INFO cinder.rpc [req-75efee0d-8958-40c6-9371-095a87450ffa - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 02:10:03.447 1 WARNING oslo_config.cfg [req-75efee0d-8958-40c6-9371-095a87450ffa - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 02:10:03.452 1 WARNING oslo_config.cfg [req-75efee0d-8958-40c6-9371-095a87450ffa - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:10:03.453 1 WARNING oslo_config.cfg [req-75efee0d-8958-40c6-9371-095a87450ffa - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:10:03.453 1 WARNING oslo_config.cfg [req-75efee0d-8958-40c6-9371-095a87450ffa - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:10:03.458 1 WARNING oslo_config.cfg [req-75efee0d-8958-40c6-9371-095a87450ffa - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 02:10:03.460 1 WARNING oslo_config.cfg [req-75efee0d-8958-40c6-9371-095a87450ffa - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 02:10:03.463 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 02:10:03.471 1 INFO cinder.manager [req-ef84fbbc-7995-4a3e-bc6d-33b9274a9c08 - - - - -] Initiating service 5 cleanup
>2018-06-26 02:10:03.480 1 INFO cinder.manager [req-ef84fbbc-7995-4a3e-bc6d-33b9274a9c08 - - - - -] Service 5 cleanup completed.
>2018-06-26 02:12:07.921 1 ERROR oslo.messaging._drivers.impl_rabbit [req-ef84fbbc-7995-4a3e-bc6d-33b9274a9c08 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:12:07.923 1 ERROR oslo.messaging._drivers.impl_rabbit [req-ef84fbbc-7995-4a3e-bc6d-33b9274a9c08 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:12:07.924 1 ERROR oslo_service.service [req-ef84fbbc-7995-4a3e-bc6d-33b9274a9c08 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:12:07.924 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 02:12:07.924 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 02:12:07.924 1 ERROR oslo_service.service     service.start()
>2018-06-26 02:12:07.924 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 02:12:07.924 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 02:12:07.924 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 02:12:07.924 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 02:12:07.924 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 02:12:07.924 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 02:12:07.924 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 02:12:07.924 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 02:12:07.924 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 02:12:07.924 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 02:12:07.924 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 02:12:07.924 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 02:12:07.924 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 02:12:07.924 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 02:12:07.924 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 02:12:07.924 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 02:12:07.924 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 02:12:07.924 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 02:12:07.924 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 02:12:07.924 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 02:12:07.924 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 02:12:07.924 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 02:12:07.924 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:12:07.924 1 ERROR oslo_service.service 
>2018-06-26 02:12:07.927 1 CRITICAL cinder [req-75efee0d-8958-40c6-9371-095a87450ffa - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 02:12:07.927 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 02:12:07.927 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 02:12:07.927 1 ERROR cinder     sys.exit(main())
>2018-06-26 02:12:07.927 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 02:12:07.927 1 ERROR cinder     service.wait()
>2018-06-26 02:12:07.927 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 02:12:07.927 1 ERROR cinder     _launcher.wait()
>2018-06-26 02:12:07.927 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 02:12:07.927 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 02:12:07.927 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 02:12:07.927 1 ERROR cinder     self.services.wait()
>2018-06-26 02:12:07.927 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 02:12:07.927 1 ERROR cinder     service.wait()
>2018-06-26 02:12:07.927 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 02:12:07.927 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 02:12:07.927 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 02:12:07.927 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 02:12:07.927 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 02:12:07.927 1 ERROR cinder     post_fn = fn()
>2018-06-26 02:12:07.927 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 02:12:07.927 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 02:12:07.927 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 02:12:07.927 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 02:12:07.927 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 02:12:07.927 1 ERROR cinder 
>2018-06-26 02:12:10.646 1 WARNING cinder.scheduler.host_manager [req-f491142b-41dd-4418-9e1c-7b51bce8dfee - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 02:12:10.652 1 INFO cinder.rpc [req-f491142b-41dd-4418-9e1c-7b51bce8dfee - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 02:12:10.657 1 INFO cinder.rpc [req-f491142b-41dd-4418-9e1c-7b51bce8dfee - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 02:12:10.670 1 INFO cinder.rpc [req-f491142b-41dd-4418-9e1c-7b51bce8dfee - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 02:12:10.675 1 INFO cinder.rpc [req-f491142b-41dd-4418-9e1c-7b51bce8dfee - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 02:12:10.699 1 WARNING oslo_config.cfg [req-f491142b-41dd-4418-9e1c-7b51bce8dfee - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 02:12:10.701 1 WARNING oslo_config.cfg [req-f491142b-41dd-4418-9e1c-7b51bce8dfee - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:12:10.702 1 WARNING oslo_config.cfg [req-f491142b-41dd-4418-9e1c-7b51bce8dfee - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:12:10.702 1 WARNING oslo_config.cfg [req-f491142b-41dd-4418-9e1c-7b51bce8dfee - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:12:10.708 1 WARNING oslo_config.cfg [req-f491142b-41dd-4418-9e1c-7b51bce8dfee - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 02:12:10.709 1 WARNING oslo_config.cfg [req-f491142b-41dd-4418-9e1c-7b51bce8dfee - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 02:12:10.712 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 02:12:10.718 1 INFO cinder.manager [req-033afcbb-cc9e-4198-baf5-d7f2522043d7 - - - - -] Initiating service 5 cleanup
>2018-06-26 02:12:10.722 1 INFO cinder.manager [req-033afcbb-cc9e-4198-baf5-d7f2522043d7 - - - - -] Service 5 cleanup completed.
>2018-06-26 02:14:23.538 1 ERROR oslo.messaging._drivers.impl_rabbit [req-033afcbb-cc9e-4198-baf5-d7f2522043d7 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:14:23.541 1 ERROR oslo.messaging._drivers.impl_rabbit [req-033afcbb-cc9e-4198-baf5-d7f2522043d7 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:14:23.541 1 ERROR oslo_service.service [req-033afcbb-cc9e-4198-baf5-d7f2522043d7 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:14:23.541 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 02:14:23.541 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 02:14:23.541 1 ERROR oslo_service.service     service.start()
>2018-06-26 02:14:23.541 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 02:14:23.541 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 02:14:23.541 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 02:14:23.541 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 02:14:23.541 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 02:14:23.541 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 02:14:23.541 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 02:14:23.541 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 02:14:23.541 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 02:14:23.541 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 02:14:23.541 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 02:14:23.541 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 02:14:23.541 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 02:14:23.541 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 02:14:23.541 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 02:14:23.541 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 02:14:23.541 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 02:14:23.541 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 02:14:23.541 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 02:14:23.541 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 02:14:23.541 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 02:14:23.541 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 02:14:23.541 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:14:23.541 1 ERROR oslo_service.service 
>2018-06-26 02:14:23.544 1 CRITICAL cinder [req-f491142b-41dd-4418-9e1c-7b51bce8dfee - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 02:14:23.544 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 02:14:23.544 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 02:14:23.544 1 ERROR cinder     sys.exit(main())
>2018-06-26 02:14:23.544 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 02:14:23.544 1 ERROR cinder     service.wait()
>2018-06-26 02:14:23.544 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 02:14:23.544 1 ERROR cinder     _launcher.wait()
>2018-06-26 02:14:23.544 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 02:14:23.544 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 02:14:23.544 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 02:14:23.544 1 ERROR cinder     self.services.wait()
>2018-06-26 02:14:23.544 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 02:14:23.544 1 ERROR cinder     service.wait()
>2018-06-26 02:14:23.544 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 02:14:23.544 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 02:14:23.544 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 02:14:23.544 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 02:14:23.544 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 02:14:23.544 1 ERROR cinder     post_fn = fn()
>2018-06-26 02:14:23.544 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 02:14:23.544 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 02:14:23.544 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 02:14:23.544 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 02:14:23.544 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 02:14:23.544 1 ERROR cinder 
>2018-06-26 02:14:26.238 1 WARNING cinder.scheduler.host_manager [req-5a0d4104-30c3-4844-ae37-fecabd360de0 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 02:14:26.246 1 INFO cinder.rpc [req-5a0d4104-30c3-4844-ae37-fecabd360de0 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 02:14:26.251 1 INFO cinder.rpc [req-5a0d4104-30c3-4844-ae37-fecabd360de0 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 02:14:26.264 1 INFO cinder.rpc [req-5a0d4104-30c3-4844-ae37-fecabd360de0 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 02:14:26.271 1 INFO cinder.rpc [req-5a0d4104-30c3-4844-ae37-fecabd360de0 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 02:14:26.297 1 WARNING oslo_config.cfg [req-5a0d4104-30c3-4844-ae37-fecabd360de0 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 02:14:26.299 1 WARNING oslo_config.cfg [req-5a0d4104-30c3-4844-ae37-fecabd360de0 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:14:26.300 1 WARNING oslo_config.cfg [req-5a0d4104-30c3-4844-ae37-fecabd360de0 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:14:26.300 1 WARNING oslo_config.cfg [req-5a0d4104-30c3-4844-ae37-fecabd360de0 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:14:26.306 1 WARNING oslo_config.cfg [req-5a0d4104-30c3-4844-ae37-fecabd360de0 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 02:14:26.307 1 WARNING oslo_config.cfg [req-5a0d4104-30c3-4844-ae37-fecabd360de0 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 02:14:26.310 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 02:14:26.317 1 INFO cinder.manager [req-d39cf166-ecfe-473c-bfee-718b2c4e1fe1 - - - - -] Initiating service 5 cleanup
>2018-06-26 02:14:26.321 1 INFO cinder.manager [req-d39cf166-ecfe-473c-bfee-718b2c4e1fe1 - - - - -] Service 5 cleanup completed.
>2018-06-26 02:16:39.320 1 ERROR oslo.messaging._drivers.impl_rabbit [req-d39cf166-ecfe-473c-bfee-718b2c4e1fe1 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:16:39.322 1 ERROR oslo.messaging._drivers.impl_rabbit [req-d39cf166-ecfe-473c-bfee-718b2c4e1fe1 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:16:39.322 1 ERROR oslo_service.service [req-d39cf166-ecfe-473c-bfee-718b2c4e1fe1 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:16:39.322 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 02:16:39.322 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 02:16:39.322 1 ERROR oslo_service.service     service.start()
>2018-06-26 02:16:39.322 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 02:16:39.322 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 02:16:39.322 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 02:16:39.322 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 02:16:39.322 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 02:16:39.322 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 02:16:39.322 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 02:16:39.322 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 02:16:39.322 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 02:16:39.322 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 02:16:39.322 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 02:16:39.322 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 02:16:39.322 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 02:16:39.322 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 02:16:39.322 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 02:16:39.322 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 02:16:39.322 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 02:16:39.322 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 02:16:39.322 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 02:16:39.322 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 02:16:39.322 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 02:16:39.322 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 02:16:39.322 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:16:39.322 1 ERROR oslo_service.service 
>2018-06-26 02:16:39.325 1 CRITICAL cinder [req-5a0d4104-30c3-4844-ae37-fecabd360de0 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 02:16:39.325 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 02:16:39.325 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 02:16:39.325 1 ERROR cinder     sys.exit(main())
>2018-06-26 02:16:39.325 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 02:16:39.325 1 ERROR cinder     service.wait()
>2018-06-26 02:16:39.325 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 02:16:39.325 1 ERROR cinder     _launcher.wait()
>2018-06-26 02:16:39.325 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 02:16:39.325 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 02:16:39.325 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 02:16:39.325 1 ERROR cinder     self.services.wait()
>2018-06-26 02:16:39.325 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 02:16:39.325 1 ERROR cinder     service.wait()
>2018-06-26 02:16:39.325 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 02:16:39.325 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 02:16:39.325 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 02:16:39.325 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 02:16:39.325 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 02:16:39.325 1 ERROR cinder     post_fn = fn()
>2018-06-26 02:16:39.325 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 02:16:39.325 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 02:16:39.325 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 02:16:39.325 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 02:16:39.325 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 02:16:39.325 1 ERROR cinder 
>2018-06-26 02:16:41.988 1 WARNING cinder.scheduler.host_manager [req-f0d62160-79ae-4ba1-a1a4-c138dd14cfbe - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 02:16:41.993 1 INFO cinder.rpc [req-f0d62160-79ae-4ba1-a1a4-c138dd14cfbe - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 02:16:42.000 1 INFO cinder.rpc [req-f0d62160-79ae-4ba1-a1a4-c138dd14cfbe - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 02:16:42.012 1 INFO cinder.rpc [req-f0d62160-79ae-4ba1-a1a4-c138dd14cfbe - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 02:16:42.018 1 INFO cinder.rpc [req-f0d62160-79ae-4ba1-a1a4-c138dd14cfbe - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 02:16:42.041 1 WARNING oslo_config.cfg [req-f0d62160-79ae-4ba1-a1a4-c138dd14cfbe - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 02:16:42.043 1 WARNING oslo_config.cfg [req-f0d62160-79ae-4ba1-a1a4-c138dd14cfbe - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:16:42.043 1 WARNING oslo_config.cfg [req-f0d62160-79ae-4ba1-a1a4-c138dd14cfbe - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:16:42.044 1 WARNING oslo_config.cfg [req-f0d62160-79ae-4ba1-a1a4-c138dd14cfbe - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:16:42.049 1 WARNING oslo_config.cfg [req-f0d62160-79ae-4ba1-a1a4-c138dd14cfbe - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 02:16:42.050 1 WARNING oslo_config.cfg [req-f0d62160-79ae-4ba1-a1a4-c138dd14cfbe - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 02:16:42.053 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 02:16:42.058 1 INFO cinder.manager [req-ca4d6446-d700-4e1b-b84c-a616d9c895c6 - - - - -] Initiating service 5 cleanup
>2018-06-26 02:16:42.062 1 INFO cinder.manager [req-ca4d6446-d700-4e1b-b84c-a616d9c895c6 - - - - -] Service 5 cleanup completed.
>2018-06-26 02:18:47.835 1 ERROR oslo.messaging._drivers.impl_rabbit [req-ca4d6446-d700-4e1b-b84c-a616d9c895c6 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:18:47.837 1 ERROR oslo.messaging._drivers.impl_rabbit [req-ca4d6446-d700-4e1b-b84c-a616d9c895c6 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:18:47.837 1 ERROR oslo_service.service [req-ca4d6446-d700-4e1b-b84c-a616d9c895c6 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:18:47.837 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 02:18:47.837 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 02:18:47.837 1 ERROR oslo_service.service     service.start()
>2018-06-26 02:18:47.837 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 02:18:47.837 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 02:18:47.837 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 02:18:47.837 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 02:18:47.837 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 02:18:47.837 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 02:18:47.837 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 02:18:47.837 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 02:18:47.837 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 02:18:47.837 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 02:18:47.837 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 02:18:47.837 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 02:18:47.837 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 02:18:47.837 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 02:18:47.837 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 02:18:47.837 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 02:18:47.837 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 02:18:47.837 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 02:18:47.837 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 02:18:47.837 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 02:18:47.837 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 02:18:47.837 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 02:18:47.837 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:18:47.837 1 ERROR oslo_service.service 
>2018-06-26 02:18:47.840 1 CRITICAL cinder [req-f0d62160-79ae-4ba1-a1a4-c138dd14cfbe - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 02:18:47.840 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 02:18:47.840 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 02:18:47.840 1 ERROR cinder     sys.exit(main())
>2018-06-26 02:18:47.840 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 02:18:47.840 1 ERROR cinder     service.wait()
>2018-06-26 02:18:47.840 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 02:18:47.840 1 ERROR cinder     _launcher.wait()
>2018-06-26 02:18:47.840 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 02:18:47.840 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 02:18:47.840 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 02:18:47.840 1 ERROR cinder     self.services.wait()
>2018-06-26 02:18:47.840 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 02:18:47.840 1 ERROR cinder     service.wait()
>2018-06-26 02:18:47.840 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 02:18:47.840 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 02:18:47.840 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 02:18:47.840 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 02:18:47.840 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 02:18:47.840 1 ERROR cinder     post_fn = fn()
>2018-06-26 02:18:47.840 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 02:18:47.840 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 02:18:47.840 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 02:18:47.840 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 02:18:47.840 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 02:18:47.840 1 ERROR cinder 
>2018-06-26 02:18:50.592 1 WARNING cinder.scheduler.host_manager [req-18006c72-4911-4c77-b8a9-03f1d9317429 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 02:18:50.599 1 INFO cinder.rpc [req-18006c72-4911-4c77-b8a9-03f1d9317429 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 02:18:50.604 1 INFO cinder.rpc [req-18006c72-4911-4c77-b8a9-03f1d9317429 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 02:18:50.618 1 INFO cinder.rpc [req-18006c72-4911-4c77-b8a9-03f1d9317429 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 02:18:50.624 1 INFO cinder.rpc [req-18006c72-4911-4c77-b8a9-03f1d9317429 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 02:18:50.648 1 WARNING oslo_config.cfg [req-18006c72-4911-4c77-b8a9-03f1d9317429 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 02:18:50.650 1 WARNING oslo_config.cfg [req-18006c72-4911-4c77-b8a9-03f1d9317429 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:18:50.651 1 WARNING oslo_config.cfg [req-18006c72-4911-4c77-b8a9-03f1d9317429 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:18:50.651 1 WARNING oslo_config.cfg [req-18006c72-4911-4c77-b8a9-03f1d9317429 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:18:50.657 1 WARNING oslo_config.cfg [req-18006c72-4911-4c77-b8a9-03f1d9317429 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 02:18:50.659 1 WARNING oslo_config.cfg [req-18006c72-4911-4c77-b8a9-03f1d9317429 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 02:18:50.661 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 02:18:50.668 1 INFO cinder.manager [req-ce828ee1-ed61-4e56-8d3f-1a293583e6dd - - - - -] Initiating service 5 cleanup
>2018-06-26 02:18:50.673 1 INFO cinder.manager [req-ce828ee1-ed61-4e56-8d3f-1a293583e6dd - - - - -] Service 5 cleanup completed.
>2018-06-26 02:20:56.837 1 ERROR oslo.messaging._drivers.impl_rabbit [req-ce828ee1-ed61-4e56-8d3f-1a293583e6dd - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:20:56.839 1 ERROR oslo.messaging._drivers.impl_rabbit [req-ce828ee1-ed61-4e56-8d3f-1a293583e6dd - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:20:56.839 1 ERROR oslo_service.service [req-ce828ee1-ed61-4e56-8d3f-1a293583e6dd - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:20:56.839 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 02:20:56.839 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 02:20:56.839 1 ERROR oslo_service.service     service.start()
>2018-06-26 02:20:56.839 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 02:20:56.839 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 02:20:56.839 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 02:20:56.839 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 02:20:56.839 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 02:20:56.839 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 02:20:56.839 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 02:20:56.839 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 02:20:56.839 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 02:20:56.839 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 02:20:56.839 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 02:20:56.839 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 02:20:56.839 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 02:20:56.839 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 02:20:56.839 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 02:20:56.839 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 02:20:56.839 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 02:20:56.839 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 02:20:56.839 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 02:20:56.839 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 02:20:56.839 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 02:20:56.839 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 02:20:56.839 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:20:56.839 1 ERROR oslo_service.service 
>2018-06-26 02:20:56.842 1 CRITICAL cinder [req-18006c72-4911-4c77-b8a9-03f1d9317429 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 02:20:56.842 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 02:20:56.842 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 02:20:56.842 1 ERROR cinder     sys.exit(main())
>2018-06-26 02:20:56.842 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 02:20:56.842 1 ERROR cinder     service.wait()
>2018-06-26 02:20:56.842 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 02:20:56.842 1 ERROR cinder     _launcher.wait()
>2018-06-26 02:20:56.842 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 02:20:56.842 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 02:20:56.842 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 02:20:56.842 1 ERROR cinder     self.services.wait()
>2018-06-26 02:20:56.842 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 02:20:56.842 1 ERROR cinder     service.wait()
>2018-06-26 02:20:56.842 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 02:20:56.842 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 02:20:56.842 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 02:20:56.842 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 02:20:56.842 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 02:20:56.842 1 ERROR cinder     post_fn = fn()
>2018-06-26 02:20:56.842 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 02:20:56.842 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 02:20:56.842 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 02:20:56.842 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 02:20:56.842 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 02:20:56.842 1 ERROR cinder 
>2018-06-26 02:20:59.634 1 WARNING cinder.scheduler.host_manager [req-fe7528ed-79f9-4a80-bccf-13e2514bb930 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 02:20:59.643 1 INFO cinder.rpc [req-fe7528ed-79f9-4a80-bccf-13e2514bb930 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 02:20:59.651 1 INFO cinder.rpc [req-fe7528ed-79f9-4a80-bccf-13e2514bb930 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 02:20:59.664 1 INFO cinder.rpc [req-fe7528ed-79f9-4a80-bccf-13e2514bb930 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 02:20:59.671 1 INFO cinder.rpc [req-fe7528ed-79f9-4a80-bccf-13e2514bb930 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 02:20:59.700 1 WARNING oslo_config.cfg [req-fe7528ed-79f9-4a80-bccf-13e2514bb930 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 02:20:59.702 1 WARNING oslo_config.cfg [req-fe7528ed-79f9-4a80-bccf-13e2514bb930 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:20:59.702 1 WARNING oslo_config.cfg [req-fe7528ed-79f9-4a80-bccf-13e2514bb930 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:20:59.703 1 WARNING oslo_config.cfg [req-fe7528ed-79f9-4a80-bccf-13e2514bb930 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:20:59.708 1 WARNING oslo_config.cfg [req-fe7528ed-79f9-4a80-bccf-13e2514bb930 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 02:20:59.709 1 WARNING oslo_config.cfg [req-fe7528ed-79f9-4a80-bccf-13e2514bb930 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 02:20:59.712 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 02:20:59.720 1 INFO cinder.manager [req-120c4237-6670-4724-b069-3458a0c20a89 - - - - -] Initiating service 5 cleanup
>2018-06-26 02:20:59.724 1 INFO cinder.manager [req-120c4237-6670-4724-b069-3458a0c20a89 - - - - -] Service 5 cleanup completed.
>2018-06-26 02:23:05.635 1 ERROR oslo.messaging._drivers.impl_rabbit [req-120c4237-6670-4724-b069-3458a0c20a89 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:23:05.638 1 ERROR oslo.messaging._drivers.impl_rabbit [req-120c4237-6670-4724-b069-3458a0c20a89 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:23:05.638 1 ERROR oslo_service.service [req-120c4237-6670-4724-b069-3458a0c20a89 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:23:05.638 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 02:23:05.638 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 02:23:05.638 1 ERROR oslo_service.service     service.start()
>2018-06-26 02:23:05.638 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 02:23:05.638 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 02:23:05.638 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 02:23:05.638 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 02:23:05.638 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 02:23:05.638 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 02:23:05.638 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 02:23:05.638 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 02:23:05.638 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 02:23:05.638 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 02:23:05.638 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 02:23:05.638 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 02:23:05.638 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 02:23:05.638 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 02:23:05.638 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 02:23:05.638 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 02:23:05.638 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 02:23:05.638 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 02:23:05.638 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 02:23:05.638 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 02:23:05.638 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 02:23:05.638 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 02:23:05.638 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:23:05.638 1 ERROR oslo_service.service 
>2018-06-26 02:23:05.641 1 CRITICAL cinder [req-fe7528ed-79f9-4a80-bccf-13e2514bb930 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 02:23:05.641 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 02:23:05.641 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 02:23:05.641 1 ERROR cinder     sys.exit(main())
>2018-06-26 02:23:05.641 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 02:23:05.641 1 ERROR cinder     service.wait()
>2018-06-26 02:23:05.641 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 02:23:05.641 1 ERROR cinder     _launcher.wait()
>2018-06-26 02:23:05.641 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 02:23:05.641 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 02:23:05.641 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 02:23:05.641 1 ERROR cinder     self.services.wait()
>2018-06-26 02:23:05.641 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 02:23:05.641 1 ERROR cinder     service.wait()
>2018-06-26 02:23:05.641 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 02:23:05.641 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 02:23:05.641 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 02:23:05.641 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 02:23:05.641 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 02:23:05.641 1 ERROR cinder     post_fn = fn()
>2018-06-26 02:23:05.641 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 02:23:05.641 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 02:23:05.641 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 02:23:05.641 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 02:23:05.641 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 02:23:05.641 1 ERROR cinder 
>2018-06-26 02:23:08.212 1 WARNING cinder.scheduler.host_manager [req-3cea440d-2601-4f29-8575-aaf0d52d37b8 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 02:23:08.219 1 INFO cinder.rpc [req-3cea440d-2601-4f29-8575-aaf0d52d37b8 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 02:23:08.226 1 INFO cinder.rpc [req-3cea440d-2601-4f29-8575-aaf0d52d37b8 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 02:23:08.241 1 INFO cinder.rpc [req-3cea440d-2601-4f29-8575-aaf0d52d37b8 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 02:23:08.248 1 INFO cinder.rpc [req-3cea440d-2601-4f29-8575-aaf0d52d37b8 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 02:23:08.275 1 WARNING oslo_config.cfg [req-3cea440d-2601-4f29-8575-aaf0d52d37b8 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 02:23:08.277 1 WARNING oslo_config.cfg [req-3cea440d-2601-4f29-8575-aaf0d52d37b8 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:23:08.278 1 WARNING oslo_config.cfg [req-3cea440d-2601-4f29-8575-aaf0d52d37b8 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:23:08.278 1 WARNING oslo_config.cfg [req-3cea440d-2601-4f29-8575-aaf0d52d37b8 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:23:08.283 1 WARNING oslo_config.cfg [req-3cea440d-2601-4f29-8575-aaf0d52d37b8 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 02:23:08.285 1 WARNING oslo_config.cfg [req-3cea440d-2601-4f29-8575-aaf0d52d37b8 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 02:23:08.287 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 02:23:08.294 1 INFO cinder.manager [req-2ca5a991-2a7b-45f3-b9a9-3b93a2b8c20f - - - - -] Initiating service 5 cleanup
>2018-06-26 02:23:08.303 1 INFO cinder.manager [req-2ca5a991-2a7b-45f3-b9a9-3b93a2b8c20f - - - - -] Service 5 cleanup completed.
>2018-06-26 02:25:12.581 1 ERROR oslo.messaging._drivers.impl_rabbit [req-2ca5a991-2a7b-45f3-b9a9-3b93a2b8c20f - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:25:12.583 1 ERROR oslo.messaging._drivers.impl_rabbit [req-2ca5a991-2a7b-45f3-b9a9-3b93a2b8c20f - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:25:12.583 1 ERROR oslo_service.service [req-2ca5a991-2a7b-45f3-b9a9-3b93a2b8c20f - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:25:12.583 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 02:25:12.583 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 02:25:12.583 1 ERROR oslo_service.service     service.start()
>2018-06-26 02:25:12.583 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 02:25:12.583 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 02:25:12.583 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 02:25:12.583 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 02:25:12.583 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 02:25:12.583 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 02:25:12.583 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 02:25:12.583 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 02:25:12.583 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 02:25:12.583 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 02:25:12.583 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 02:25:12.583 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 02:25:12.583 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 02:25:12.583 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 02:25:12.583 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 02:25:12.583 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 02:25:12.583 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 02:25:12.583 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 02:25:12.583 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 02:25:12.583 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 02:25:12.583 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 02:25:12.583 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 02:25:12.583 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:25:12.583 1 ERROR oslo_service.service 
>2018-06-26 02:25:12.586 1 CRITICAL cinder [req-3cea440d-2601-4f29-8575-aaf0d52d37b8 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 02:25:12.586 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 02:25:12.586 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 02:25:12.586 1 ERROR cinder     sys.exit(main())
>2018-06-26 02:25:12.586 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 02:25:12.586 1 ERROR cinder     service.wait()
>2018-06-26 02:25:12.586 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 02:25:12.586 1 ERROR cinder     _launcher.wait()
>2018-06-26 02:25:12.586 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 02:25:12.586 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 02:25:12.586 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 02:25:12.586 1 ERROR cinder     self.services.wait()
>2018-06-26 02:25:12.586 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 02:25:12.586 1 ERROR cinder     service.wait()
>2018-06-26 02:25:12.586 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 02:25:12.586 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 02:25:12.586 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 02:25:12.586 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 02:25:12.586 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 02:25:12.586 1 ERROR cinder     post_fn = fn()
>2018-06-26 02:25:12.586 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 02:25:12.586 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 02:25:12.586 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 02:25:12.586 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 02:25:12.586 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 02:25:12.586 1 ERROR cinder 
>2018-06-26 02:25:15.155 1 WARNING cinder.scheduler.host_manager [req-d26936fd-e7b9-4ce1-b74a-5daec4d8fec8 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 02:25:15.161 1 INFO cinder.rpc [req-d26936fd-e7b9-4ce1-b74a-5daec4d8fec8 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 02:25:15.166 1 INFO cinder.rpc [req-d26936fd-e7b9-4ce1-b74a-5daec4d8fec8 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 02:25:15.178 1 INFO cinder.rpc [req-d26936fd-e7b9-4ce1-b74a-5daec4d8fec8 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 02:25:15.183 1 INFO cinder.rpc [req-d26936fd-e7b9-4ce1-b74a-5daec4d8fec8 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 02:25:15.205 1 WARNING oslo_config.cfg [req-d26936fd-e7b9-4ce1-b74a-5daec4d8fec8 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 02:25:15.207 1 WARNING oslo_config.cfg [req-d26936fd-e7b9-4ce1-b74a-5daec4d8fec8 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:25:15.208 1 WARNING oslo_config.cfg [req-d26936fd-e7b9-4ce1-b74a-5daec4d8fec8 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:25:15.208 1 WARNING oslo_config.cfg [req-d26936fd-e7b9-4ce1-b74a-5daec4d8fec8 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:25:15.213 1 WARNING oslo_config.cfg [req-d26936fd-e7b9-4ce1-b74a-5daec4d8fec8 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 02:25:15.215 1 WARNING oslo_config.cfg [req-d26936fd-e7b9-4ce1-b74a-5daec4d8fec8 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 02:25:15.218 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 02:25:15.225 1 INFO cinder.manager [req-cde2beb9-53b3-4e27-a8a8-20ae09fc6e40 - - - - -] Initiating service 5 cleanup
>2018-06-26 02:25:15.232 1 INFO cinder.manager [req-cde2beb9-53b3-4e27-a8a8-20ae09fc6e40 - - - - -] Service 5 cleanup completed.
>2018-06-26 02:27:19.765 1 ERROR oslo.messaging._drivers.impl_rabbit [req-cde2beb9-53b3-4e27-a8a8-20ae09fc6e40 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:27:19.767 1 ERROR oslo.messaging._drivers.impl_rabbit [req-cde2beb9-53b3-4e27-a8a8-20ae09fc6e40 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:27:19.768 1 ERROR oslo_service.service [req-cde2beb9-53b3-4e27-a8a8-20ae09fc6e40 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:27:19.768 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 02:27:19.768 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 02:27:19.768 1 ERROR oslo_service.service     service.start()
>2018-06-26 02:27:19.768 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 02:27:19.768 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 02:27:19.768 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 02:27:19.768 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 02:27:19.768 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 02:27:19.768 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 02:27:19.768 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 02:27:19.768 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 02:27:19.768 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 02:27:19.768 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 02:27:19.768 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 02:27:19.768 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 02:27:19.768 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 02:27:19.768 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 02:27:19.768 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 02:27:19.768 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 02:27:19.768 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 02:27:19.768 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 02:27:19.768 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 02:27:19.768 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 02:27:19.768 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 02:27:19.768 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 02:27:19.768 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:27:19.768 1 ERROR oslo_service.service 
>2018-06-26 02:27:19.770 1 CRITICAL cinder [req-d26936fd-e7b9-4ce1-b74a-5daec4d8fec8 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 02:27:19.770 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 02:27:19.770 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 02:27:19.770 1 ERROR cinder     sys.exit(main())
>2018-06-26 02:27:19.770 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 02:27:19.770 1 ERROR cinder     service.wait()
>2018-06-26 02:27:19.770 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 02:27:19.770 1 ERROR cinder     _launcher.wait()
>2018-06-26 02:27:19.770 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 02:27:19.770 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 02:27:19.770 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 02:27:19.770 1 ERROR cinder     self.services.wait()
>2018-06-26 02:27:19.770 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 02:27:19.770 1 ERROR cinder     service.wait()
>2018-06-26 02:27:19.770 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 02:27:19.770 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 02:27:19.770 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 02:27:19.770 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 02:27:19.770 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 02:27:19.770 1 ERROR cinder     post_fn = fn()
>2018-06-26 02:27:19.770 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 02:27:19.770 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 02:27:19.770 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 02:27:19.770 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 02:27:19.770 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 02:27:19.770 1 ERROR cinder 
>2018-06-26 02:27:22.514 1 WARNING cinder.scheduler.host_manager [req-01325e7a-b14b-4ecd-8786-6335fcdffb66 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 02:27:22.521 1 INFO cinder.rpc [req-01325e7a-b14b-4ecd-8786-6335fcdffb66 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 02:27:22.530 1 INFO cinder.rpc [req-01325e7a-b14b-4ecd-8786-6335fcdffb66 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 02:27:22.543 1 INFO cinder.rpc [req-01325e7a-b14b-4ecd-8786-6335fcdffb66 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 02:27:22.551 1 INFO cinder.rpc [req-01325e7a-b14b-4ecd-8786-6335fcdffb66 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 02:27:22.575 1 WARNING oslo_config.cfg [req-01325e7a-b14b-4ecd-8786-6335fcdffb66 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 02:27:22.578 1 WARNING oslo_config.cfg [req-01325e7a-b14b-4ecd-8786-6335fcdffb66 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:27:22.578 1 WARNING oslo_config.cfg [req-01325e7a-b14b-4ecd-8786-6335fcdffb66 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:27:22.579 1 WARNING oslo_config.cfg [req-01325e7a-b14b-4ecd-8786-6335fcdffb66 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:27:22.584 1 WARNING oslo_config.cfg [req-01325e7a-b14b-4ecd-8786-6335fcdffb66 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 02:27:22.586 1 WARNING oslo_config.cfg [req-01325e7a-b14b-4ecd-8786-6335fcdffb66 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 02:27:22.589 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 02:27:22.594 1 INFO cinder.manager [req-63889fe7-0d70-4f5b-88ab-fa757ff0b2ea - - - - -] Initiating service 5 cleanup
>2018-06-26 02:27:22.600 1 INFO cinder.manager [req-63889fe7-0d70-4f5b-88ab-fa757ff0b2ea - - - - -] Service 5 cleanup completed.
>2018-06-26 02:29:28.660 1 ERROR oslo.messaging._drivers.impl_rabbit [req-63889fe7-0d70-4f5b-88ab-fa757ff0b2ea - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:29:28.661 1 ERROR oslo.messaging._drivers.impl_rabbit [req-63889fe7-0d70-4f5b-88ab-fa757ff0b2ea - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:29:28.662 1 ERROR oslo_service.service [req-63889fe7-0d70-4f5b-88ab-fa757ff0b2ea - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:29:28.662 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 02:29:28.662 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 02:29:28.662 1 ERROR oslo_service.service     service.start()
>2018-06-26 02:29:28.662 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 02:29:28.662 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 02:29:28.662 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 02:29:28.662 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 02:29:28.662 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 02:29:28.662 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 02:29:28.662 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 02:29:28.662 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 02:29:28.662 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 02:29:28.662 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 02:29:28.662 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 02:29:28.662 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 02:29:28.662 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 02:29:28.662 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 02:29:28.662 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 02:29:28.662 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 02:29:28.662 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 02:29:28.662 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 02:29:28.662 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 02:29:28.662 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 02:29:28.662 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 02:29:28.662 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 02:29:28.662 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:29:28.662 1 ERROR oslo_service.service 
>2018-06-26 02:29:28.665 1 CRITICAL cinder [req-01325e7a-b14b-4ecd-8786-6335fcdffb66 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 02:29:28.665 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 02:29:28.665 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 02:29:28.665 1 ERROR cinder     sys.exit(main())
>2018-06-26 02:29:28.665 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 02:29:28.665 1 ERROR cinder     service.wait()
>2018-06-26 02:29:28.665 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 02:29:28.665 1 ERROR cinder     _launcher.wait()
>2018-06-26 02:29:28.665 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 02:29:28.665 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 02:29:28.665 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 02:29:28.665 1 ERROR cinder     self.services.wait()
>2018-06-26 02:29:28.665 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 02:29:28.665 1 ERROR cinder     service.wait()
>2018-06-26 02:29:28.665 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 02:29:28.665 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 02:29:28.665 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 02:29:28.665 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 02:29:28.665 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 02:29:28.665 1 ERROR cinder     post_fn = fn()
>2018-06-26 02:29:28.665 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 02:29:28.665 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 02:29:28.665 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 02:29:28.665 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 02:29:28.665 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 02:29:28.665 1 ERROR cinder 
>2018-06-26 02:29:31.367 1 WARNING cinder.scheduler.host_manager [req-501f4c9a-801f-4bae-8bb1-b63cf0290b11 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 02:29:31.373 1 INFO cinder.rpc [req-501f4c9a-801f-4bae-8bb1-b63cf0290b11 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 02:29:31.378 1 INFO cinder.rpc [req-501f4c9a-801f-4bae-8bb1-b63cf0290b11 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 02:29:31.392 1 INFO cinder.rpc [req-501f4c9a-801f-4bae-8bb1-b63cf0290b11 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 02:29:31.398 1 INFO cinder.rpc [req-501f4c9a-801f-4bae-8bb1-b63cf0290b11 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 02:29:31.425 1 WARNING oslo_config.cfg [req-501f4c9a-801f-4bae-8bb1-b63cf0290b11 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 02:29:31.427 1 WARNING oslo_config.cfg [req-501f4c9a-801f-4bae-8bb1-b63cf0290b11 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:29:31.427 1 WARNING oslo_config.cfg [req-501f4c9a-801f-4bae-8bb1-b63cf0290b11 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:29:31.428 1 WARNING oslo_config.cfg [req-501f4c9a-801f-4bae-8bb1-b63cf0290b11 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:29:31.433 1 WARNING oslo_config.cfg [req-501f4c9a-801f-4bae-8bb1-b63cf0290b11 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 02:29:31.434 1 WARNING oslo_config.cfg [req-501f4c9a-801f-4bae-8bb1-b63cf0290b11 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 02:29:31.437 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 02:29:31.443 1 INFO cinder.manager [req-a7d62a1c-1dcb-401e-b6c8-f1daeff94c82 - - - - -] Initiating service 5 cleanup
>2018-06-26 02:29:31.447 1 INFO cinder.manager [req-a7d62a1c-1dcb-401e-b6c8-f1daeff94c82 - - - - -] Service 5 cleanup completed.
>2018-06-26 02:31:44.372 1 ERROR oslo.messaging._drivers.impl_rabbit [req-a7d62a1c-1dcb-401e-b6c8-f1daeff94c82 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:31:44.374 1 ERROR oslo.messaging._drivers.impl_rabbit [req-a7d62a1c-1dcb-401e-b6c8-f1daeff94c82 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:31:44.375 1 ERROR oslo_service.service [req-a7d62a1c-1dcb-401e-b6c8-f1daeff94c82 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:31:44.375 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 02:31:44.375 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 02:31:44.375 1 ERROR oslo_service.service     service.start()
>2018-06-26 02:31:44.375 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 02:31:44.375 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 02:31:44.375 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 02:31:44.375 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 02:31:44.375 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 02:31:44.375 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 02:31:44.375 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 02:31:44.375 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 02:31:44.375 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 02:31:44.375 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 02:31:44.375 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 02:31:44.375 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 02:31:44.375 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 02:31:44.375 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 02:31:44.375 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 02:31:44.375 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 02:31:44.375 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 02:31:44.375 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 02:31:44.375 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 02:31:44.375 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 02:31:44.375 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 02:31:44.375 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 02:31:44.375 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:31:44.375 1 ERROR oslo_service.service 
>2018-06-26 02:31:44.378 1 CRITICAL cinder [req-501f4c9a-801f-4bae-8bb1-b63cf0290b11 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 02:31:44.378 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 02:31:44.378 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 02:31:44.378 1 ERROR cinder     sys.exit(main())
>2018-06-26 02:31:44.378 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 02:31:44.378 1 ERROR cinder     service.wait()
>2018-06-26 02:31:44.378 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 02:31:44.378 1 ERROR cinder     _launcher.wait()
>2018-06-26 02:31:44.378 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 02:31:44.378 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 02:31:44.378 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 02:31:44.378 1 ERROR cinder     self.services.wait()
>2018-06-26 02:31:44.378 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 02:31:44.378 1 ERROR cinder     service.wait()
>2018-06-26 02:31:44.378 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 02:31:44.378 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 02:31:44.378 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 02:31:44.378 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 02:31:44.378 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 02:31:44.378 1 ERROR cinder     post_fn = fn()
>2018-06-26 02:31:44.378 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 02:31:44.378 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 02:31:44.378 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 02:31:44.378 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 02:31:44.378 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 02:31:44.378 1 ERROR cinder 
>2018-06-26 02:31:47.064 1 WARNING cinder.scheduler.host_manager [req-faa8798d-5274-4977-b90d-acb5bc1fc2fa - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 02:31:47.072 1 INFO cinder.rpc [req-faa8798d-5274-4977-b90d-acb5bc1fc2fa - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 02:31:47.079 1 INFO cinder.rpc [req-faa8798d-5274-4977-b90d-acb5bc1fc2fa - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 02:31:47.095 1 INFO cinder.rpc [req-faa8798d-5274-4977-b90d-acb5bc1fc2fa - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 02:31:47.102 1 INFO cinder.rpc [req-faa8798d-5274-4977-b90d-acb5bc1fc2fa - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 02:31:47.125 1 WARNING oslo_config.cfg [req-faa8798d-5274-4977-b90d-acb5bc1fc2fa - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 02:31:47.128 1 WARNING oslo_config.cfg [req-faa8798d-5274-4977-b90d-acb5bc1fc2fa - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:31:47.128 1 WARNING oslo_config.cfg [req-faa8798d-5274-4977-b90d-acb5bc1fc2fa - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:31:47.129 1 WARNING oslo_config.cfg [req-faa8798d-5274-4977-b90d-acb5bc1fc2fa - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:31:47.133 1 WARNING oslo_config.cfg [req-faa8798d-5274-4977-b90d-acb5bc1fc2fa - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 02:31:47.135 1 WARNING oslo_config.cfg [req-faa8798d-5274-4977-b90d-acb5bc1fc2fa - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 02:31:47.137 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 02:31:47.144 1 INFO cinder.manager [req-6bdce6ab-4551-4f09-b431-525c6ce8b824 - - - - -] Initiating service 5 cleanup
>2018-06-26 02:31:47.149 1 INFO cinder.manager [req-6bdce6ab-4551-4f09-b431-525c6ce8b824 - - - - -] Service 5 cleanup completed.
>2018-06-26 02:33:51.550 1 ERROR oslo.messaging._drivers.impl_rabbit [req-6bdce6ab-4551-4f09-b431-525c6ce8b824 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:33:51.552 1 ERROR oslo.messaging._drivers.impl_rabbit [req-6bdce6ab-4551-4f09-b431-525c6ce8b824 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:33:51.552 1 ERROR oslo_service.service [req-6bdce6ab-4551-4f09-b431-525c6ce8b824 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:33:51.552 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 02:33:51.552 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 02:33:51.552 1 ERROR oslo_service.service     service.start()
>2018-06-26 02:33:51.552 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 02:33:51.552 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 02:33:51.552 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 02:33:51.552 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 02:33:51.552 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 02:33:51.552 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 02:33:51.552 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 02:33:51.552 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 02:33:51.552 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 02:33:51.552 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 02:33:51.552 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 02:33:51.552 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 02:33:51.552 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 02:33:51.552 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 02:33:51.552 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 02:33:51.552 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 02:33:51.552 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 02:33:51.552 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 02:33:51.552 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 02:33:51.552 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 02:33:51.552 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 02:33:51.552 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 02:33:51.552 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:33:51.552 1 ERROR oslo_service.service 
>2018-06-26 02:33:51.556 1 CRITICAL cinder [req-faa8798d-5274-4977-b90d-acb5bc1fc2fa - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 02:33:51.556 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 02:33:51.556 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 02:33:51.556 1 ERROR cinder     sys.exit(main())
>2018-06-26 02:33:51.556 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 02:33:51.556 1 ERROR cinder     service.wait()
>2018-06-26 02:33:51.556 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 02:33:51.556 1 ERROR cinder     _launcher.wait()
>2018-06-26 02:33:51.556 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 02:33:51.556 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 02:33:51.556 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 02:33:51.556 1 ERROR cinder     self.services.wait()
>2018-06-26 02:33:51.556 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 02:33:51.556 1 ERROR cinder     service.wait()
>2018-06-26 02:33:51.556 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 02:33:51.556 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 02:33:51.556 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 02:33:51.556 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 02:33:51.556 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 02:33:51.556 1 ERROR cinder     post_fn = fn()
>2018-06-26 02:33:51.556 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 02:33:51.556 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 02:33:51.556 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 02:33:51.556 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 02:33:51.556 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 02:33:51.556 1 ERROR cinder 
>2018-06-26 02:33:54.202 1 WARNING cinder.scheduler.host_manager [req-10ed092b-9f39-4932-889b-c6de5f33d676 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 02:33:54.208 1 INFO cinder.rpc [req-10ed092b-9f39-4932-889b-c6de5f33d676 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 02:33:54.219 1 INFO cinder.rpc [req-10ed092b-9f39-4932-889b-c6de5f33d676 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 02:33:54.235 1 INFO cinder.rpc [req-10ed092b-9f39-4932-889b-c6de5f33d676 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 02:33:54.241 1 INFO cinder.rpc [req-10ed092b-9f39-4932-889b-c6de5f33d676 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 02:33:54.262 1 WARNING oslo_config.cfg [req-10ed092b-9f39-4932-889b-c6de5f33d676 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 02:33:54.264 1 WARNING oslo_config.cfg [req-10ed092b-9f39-4932-889b-c6de5f33d676 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:33:54.264 1 WARNING oslo_config.cfg [req-10ed092b-9f39-4932-889b-c6de5f33d676 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:33:54.265 1 WARNING oslo_config.cfg [req-10ed092b-9f39-4932-889b-c6de5f33d676 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:33:54.270 1 WARNING oslo_config.cfg [req-10ed092b-9f39-4932-889b-c6de5f33d676 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 02:33:54.271 1 WARNING oslo_config.cfg [req-10ed092b-9f39-4932-889b-c6de5f33d676 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 02:33:54.274 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 02:33:54.279 1 INFO cinder.manager [req-a7f218ef-38d8-46d8-8cdc-cd490446b91b - - - - -] Initiating service 5 cleanup
>2018-06-26 02:33:54.285 1 INFO cinder.manager [req-a7f218ef-38d8-46d8-8cdc-cd490446b91b - - - - -] Service 5 cleanup completed.
>2018-06-26 02:35:58.620 1 ERROR oslo.messaging._drivers.impl_rabbit [req-a7f218ef-38d8-46d8-8cdc-cd490446b91b - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:35:58.622 1 ERROR oslo.messaging._drivers.impl_rabbit [req-a7f218ef-38d8-46d8-8cdc-cd490446b91b - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:35:58.623 1 ERROR oslo_service.service [req-a7f218ef-38d8-46d8-8cdc-cd490446b91b - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:35:58.623 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 02:35:58.623 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 02:35:58.623 1 ERROR oslo_service.service     service.start()
>2018-06-26 02:35:58.623 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 02:35:58.623 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 02:35:58.623 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 02:35:58.623 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 02:35:58.623 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 02:35:58.623 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 02:35:58.623 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 02:35:58.623 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 02:35:58.623 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 02:35:58.623 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 02:35:58.623 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 02:35:58.623 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 02:35:58.623 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 02:35:58.623 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 02:35:58.623 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 02:35:58.623 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 02:35:58.623 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 02:35:58.623 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 02:35:58.623 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 02:35:58.623 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 02:35:58.623 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 02:35:58.623 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 02:35:58.623 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:35:58.623 1 ERROR oslo_service.service 
>2018-06-26 02:35:58.626 1 CRITICAL cinder [req-10ed092b-9f39-4932-889b-c6de5f33d676 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 02:35:58.626 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 02:35:58.626 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 02:35:58.626 1 ERROR cinder     sys.exit(main())
>2018-06-26 02:35:58.626 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 02:35:58.626 1 ERROR cinder     service.wait()
>2018-06-26 02:35:58.626 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 02:35:58.626 1 ERROR cinder     _launcher.wait()
>2018-06-26 02:35:58.626 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 02:35:58.626 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 02:35:58.626 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 02:35:58.626 1 ERROR cinder     self.services.wait()
>2018-06-26 02:35:58.626 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 02:35:58.626 1 ERROR cinder     service.wait()
>2018-06-26 02:35:58.626 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 02:35:58.626 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 02:35:58.626 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 02:35:58.626 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 02:35:58.626 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 02:35:58.626 1 ERROR cinder     post_fn = fn()
>2018-06-26 02:35:58.626 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 02:35:58.626 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 02:35:58.626 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 02:35:58.626 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 02:35:58.626 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 02:35:58.626 1 ERROR cinder 
>2018-06-26 02:36:01.410 1 WARNING cinder.scheduler.host_manager [req-c87f279f-d651-4044-8f71-db7b21586b7b - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 02:36:01.418 1 INFO cinder.rpc [req-c87f279f-d651-4044-8f71-db7b21586b7b - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 02:36:01.424 1 INFO cinder.rpc [req-c87f279f-d651-4044-8f71-db7b21586b7b - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 02:36:01.436 1 INFO cinder.rpc [req-c87f279f-d651-4044-8f71-db7b21586b7b - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 02:36:01.443 1 INFO cinder.rpc [req-c87f279f-d651-4044-8f71-db7b21586b7b - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 02:36:01.467 1 WARNING oslo_config.cfg [req-c87f279f-d651-4044-8f71-db7b21586b7b - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 02:36:01.469 1 WARNING oslo_config.cfg [req-c87f279f-d651-4044-8f71-db7b21586b7b - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:36:01.470 1 WARNING oslo_config.cfg [req-c87f279f-d651-4044-8f71-db7b21586b7b - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:36:01.470 1 WARNING oslo_config.cfg [req-c87f279f-d651-4044-8f71-db7b21586b7b - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:36:01.476 1 WARNING oslo_config.cfg [req-c87f279f-d651-4044-8f71-db7b21586b7b - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 02:36:01.477 1 WARNING oslo_config.cfg [req-c87f279f-d651-4044-8f71-db7b21586b7b - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 02:36:01.480 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 02:36:01.486 1 INFO cinder.manager [req-127ba0db-fdce-472f-8a82-f83c5fd9c9af - - - - -] Initiating service 5 cleanup
>2018-06-26 02:36:01.490 1 INFO cinder.manager [req-127ba0db-fdce-472f-8a82-f83c5fd9c9af - - - - -] Service 5 cleanup completed.
>2018-06-26 02:38:05.821 1 ERROR oslo.messaging._drivers.impl_rabbit [req-127ba0db-fdce-472f-8a82-f83c5fd9c9af - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:38:05.824 1 ERROR oslo.messaging._drivers.impl_rabbit [req-127ba0db-fdce-472f-8a82-f83c5fd9c9af - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:38:05.824 1 ERROR oslo_service.service [req-127ba0db-fdce-472f-8a82-f83c5fd9c9af - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:38:05.824 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 02:38:05.824 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 02:38:05.824 1 ERROR oslo_service.service     service.start()
>2018-06-26 02:38:05.824 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 02:38:05.824 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 02:38:05.824 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 02:38:05.824 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 02:38:05.824 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 02:38:05.824 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 02:38:05.824 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 02:38:05.824 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 02:38:05.824 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 02:38:05.824 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 02:38:05.824 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 02:38:05.824 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 02:38:05.824 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 02:38:05.824 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 02:38:05.824 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 02:38:05.824 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 02:38:05.824 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 02:38:05.824 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 02:38:05.824 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 02:38:05.824 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 02:38:05.824 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 02:38:05.824 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 02:38:05.824 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:38:05.824 1 ERROR oslo_service.service 
>2018-06-26 02:38:05.827 1 CRITICAL cinder [req-c87f279f-d651-4044-8f71-db7b21586b7b - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 02:38:05.827 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 02:38:05.827 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 02:38:05.827 1 ERROR cinder     sys.exit(main())
>2018-06-26 02:38:05.827 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 02:38:05.827 1 ERROR cinder     service.wait()
>2018-06-26 02:38:05.827 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 02:38:05.827 1 ERROR cinder     _launcher.wait()
>2018-06-26 02:38:05.827 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 02:38:05.827 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 02:38:05.827 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 02:38:05.827 1 ERROR cinder     self.services.wait()
>2018-06-26 02:38:05.827 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 02:38:05.827 1 ERROR cinder     service.wait()
>2018-06-26 02:38:05.827 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 02:38:05.827 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 02:38:05.827 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 02:38:05.827 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 02:38:05.827 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 02:38:05.827 1 ERROR cinder     post_fn = fn()
>2018-06-26 02:38:05.827 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 02:38:05.827 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 02:38:05.827 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 02:38:05.827 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 02:38:05.827 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 02:38:05.827 1 ERROR cinder 
>2018-06-26 02:38:08.551 1 WARNING cinder.scheduler.host_manager [req-3c421527-9805-4e33-b630-de836b3ecf32 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 02:38:08.557 1 INFO cinder.rpc [req-3c421527-9805-4e33-b630-de836b3ecf32 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 02:38:08.563 1 INFO cinder.rpc [req-3c421527-9805-4e33-b630-de836b3ecf32 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 02:38:08.574 1 INFO cinder.rpc [req-3c421527-9805-4e33-b630-de836b3ecf32 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 02:38:08.581 1 INFO cinder.rpc [req-3c421527-9805-4e33-b630-de836b3ecf32 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 02:38:08.607 1 WARNING oslo_config.cfg [req-3c421527-9805-4e33-b630-de836b3ecf32 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 02:38:08.609 1 WARNING oslo_config.cfg [req-3c421527-9805-4e33-b630-de836b3ecf32 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:38:08.610 1 WARNING oslo_config.cfg [req-3c421527-9805-4e33-b630-de836b3ecf32 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:38:08.610 1 WARNING oslo_config.cfg [req-3c421527-9805-4e33-b630-de836b3ecf32 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:38:08.615 1 WARNING oslo_config.cfg [req-3c421527-9805-4e33-b630-de836b3ecf32 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 02:38:08.616 1 WARNING oslo_config.cfg [req-3c421527-9805-4e33-b630-de836b3ecf32 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 02:38:08.619 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 02:38:08.625 1 INFO cinder.manager [req-82bd4f08-7cd6-45c1-9993-45ede64a5379 - - - - -] Initiating service 5 cleanup
>2018-06-26 02:38:08.630 1 INFO cinder.manager [req-82bd4f08-7cd6-45c1-9993-45ede64a5379 - - - - -] Service 5 cleanup completed.
>2018-06-26 02:40:13.111 1 ERROR oslo.messaging._drivers.impl_rabbit [req-82bd4f08-7cd6-45c1-9993-45ede64a5379 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:40:13.114 1 ERROR oslo.messaging._drivers.impl_rabbit [req-82bd4f08-7cd6-45c1-9993-45ede64a5379 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:40:13.115 1 ERROR oslo_service.service [req-82bd4f08-7cd6-45c1-9993-45ede64a5379 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:40:13.115 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 02:40:13.115 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 02:40:13.115 1 ERROR oslo_service.service     service.start()
>2018-06-26 02:40:13.115 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 02:40:13.115 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 02:40:13.115 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 02:40:13.115 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 02:40:13.115 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 02:40:13.115 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 02:40:13.115 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 02:40:13.115 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 02:40:13.115 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 02:40:13.115 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 02:40:13.115 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 02:40:13.115 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 02:40:13.115 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 02:40:13.115 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 02:40:13.115 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 02:40:13.115 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 02:40:13.115 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 02:40:13.115 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 02:40:13.115 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 02:40:13.115 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 02:40:13.115 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 02:40:13.115 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 02:40:13.115 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:40:13.115 1 ERROR oslo_service.service 
>2018-06-26 02:40:13.118 1 CRITICAL cinder [req-3c421527-9805-4e33-b630-de836b3ecf32 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 02:40:13.118 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 02:40:13.118 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 02:40:13.118 1 ERROR cinder     sys.exit(main())
>2018-06-26 02:40:13.118 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 02:40:13.118 1 ERROR cinder     service.wait()
>2018-06-26 02:40:13.118 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 02:40:13.118 1 ERROR cinder     _launcher.wait()
>2018-06-26 02:40:13.118 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 02:40:13.118 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 02:40:13.118 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 02:40:13.118 1 ERROR cinder     self.services.wait()
>2018-06-26 02:40:13.118 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 02:40:13.118 1 ERROR cinder     service.wait()
>2018-06-26 02:40:13.118 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 02:40:13.118 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 02:40:13.118 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 02:40:13.118 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 02:40:13.118 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 02:40:13.118 1 ERROR cinder     post_fn = fn()
>2018-06-26 02:40:13.118 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 02:40:13.118 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 02:40:13.118 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 02:40:13.118 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 02:40:13.118 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 02:40:13.118 1 ERROR cinder 
>2018-06-26 02:40:15.945 1 WARNING cinder.scheduler.host_manager [req-a9e8642c-403c-435f-8ca6-cd6723db083b - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 02:40:15.950 1 INFO cinder.rpc [req-a9e8642c-403c-435f-8ca6-cd6723db083b - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 02:40:15.957 1 INFO cinder.rpc [req-a9e8642c-403c-435f-8ca6-cd6723db083b - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 02:40:15.972 1 INFO cinder.rpc [req-a9e8642c-403c-435f-8ca6-cd6723db083b - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 02:40:15.981 1 INFO cinder.rpc [req-a9e8642c-403c-435f-8ca6-cd6723db083b - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 02:40:16.006 1 WARNING oslo_config.cfg [req-a9e8642c-403c-435f-8ca6-cd6723db083b - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 02:40:16.008 1 WARNING oslo_config.cfg [req-a9e8642c-403c-435f-8ca6-cd6723db083b - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:40:16.008 1 WARNING oslo_config.cfg [req-a9e8642c-403c-435f-8ca6-cd6723db083b - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:40:16.009 1 WARNING oslo_config.cfg [req-a9e8642c-403c-435f-8ca6-cd6723db083b - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:40:16.015 1 WARNING oslo_config.cfg [req-a9e8642c-403c-435f-8ca6-cd6723db083b - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 02:40:16.017 1 WARNING oslo_config.cfg [req-a9e8642c-403c-435f-8ca6-cd6723db083b - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 02:40:16.019 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 02:40:16.025 1 INFO cinder.manager [req-7d71c6af-d112-431a-abb6-99454f5656d0 - - - - -] Initiating service 5 cleanup
>2018-06-26 02:40:16.031 1 INFO cinder.manager [req-7d71c6af-d112-431a-abb6-99454f5656d0 - - - - -] Service 5 cleanup completed.
>2018-06-26 02:42:22.119 1 ERROR oslo.messaging._drivers.impl_rabbit [req-7d71c6af-d112-431a-abb6-99454f5656d0 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:42:22.121 1 ERROR oslo.messaging._drivers.impl_rabbit [req-7d71c6af-d112-431a-abb6-99454f5656d0 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:42:22.122 1 ERROR oslo_service.service [req-7d71c6af-d112-431a-abb6-99454f5656d0 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:42:22.122 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 02:42:22.122 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 02:42:22.122 1 ERROR oslo_service.service     service.start()
>2018-06-26 02:42:22.122 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 02:42:22.122 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 02:42:22.122 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 02:42:22.122 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 02:42:22.122 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 02:42:22.122 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 02:42:22.122 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 02:42:22.122 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 02:42:22.122 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 02:42:22.122 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 02:42:22.122 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 02:42:22.122 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 02:42:22.122 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 02:42:22.122 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 02:42:22.122 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 02:42:22.122 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 02:42:22.122 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 02:42:22.122 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 02:42:22.122 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 02:42:22.122 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 02:42:22.122 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 02:42:22.122 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 02:42:22.122 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:42:22.122 1 ERROR oslo_service.service 
>2018-06-26 02:42:22.124 1 CRITICAL cinder [req-a9e8642c-403c-435f-8ca6-cd6723db083b - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 02:42:22.124 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 02:42:22.124 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 02:42:22.124 1 ERROR cinder     sys.exit(main())
>2018-06-26 02:42:22.124 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 02:42:22.124 1 ERROR cinder     service.wait()
>2018-06-26 02:42:22.124 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 02:42:22.124 1 ERROR cinder     _launcher.wait()
>2018-06-26 02:42:22.124 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 02:42:22.124 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 02:42:22.124 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 02:42:22.124 1 ERROR cinder     self.services.wait()
>2018-06-26 02:42:22.124 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 02:42:22.124 1 ERROR cinder     service.wait()
>2018-06-26 02:42:22.124 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 02:42:22.124 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 02:42:22.124 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 02:42:22.124 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 02:42:22.124 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 02:42:22.124 1 ERROR cinder     post_fn = fn()
>2018-06-26 02:42:22.124 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 02:42:22.124 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 02:42:22.124 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 02:42:22.124 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 02:42:22.124 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 02:42:22.124 1 ERROR cinder 
>2018-06-26 02:42:24.698 1 WARNING cinder.scheduler.host_manager [req-7b3216ff-ae4a-4279-bf12-ce59e54d14d1 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 02:42:24.704 1 INFO cinder.rpc [req-7b3216ff-ae4a-4279-bf12-ce59e54d14d1 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 02:42:24.710 1 INFO cinder.rpc [req-7b3216ff-ae4a-4279-bf12-ce59e54d14d1 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 02:42:24.732 1 INFO cinder.rpc [req-7b3216ff-ae4a-4279-bf12-ce59e54d14d1 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 02:42:24.741 1 INFO cinder.rpc [req-7b3216ff-ae4a-4279-bf12-ce59e54d14d1 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 02:42:24.767 1 WARNING oslo_config.cfg [req-7b3216ff-ae4a-4279-bf12-ce59e54d14d1 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 02:42:24.769 1 WARNING oslo_config.cfg [req-7b3216ff-ae4a-4279-bf12-ce59e54d14d1 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:42:24.769 1 WARNING oslo_config.cfg [req-7b3216ff-ae4a-4279-bf12-ce59e54d14d1 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:42:24.770 1 WARNING oslo_config.cfg [req-7b3216ff-ae4a-4279-bf12-ce59e54d14d1 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:42:24.775 1 WARNING oslo_config.cfg [req-7b3216ff-ae4a-4279-bf12-ce59e54d14d1 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 02:42:24.776 1 WARNING oslo_config.cfg [req-7b3216ff-ae4a-4279-bf12-ce59e54d14d1 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 02:42:24.779 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 02:42:24.785 1 INFO cinder.manager [req-fa6ab288-de43-49cd-8396-daf402962e5c - - - - -] Initiating service 5 cleanup
>2018-06-26 02:42:24.789 1 INFO cinder.manager [req-fa6ab288-de43-49cd-8396-daf402962e5c - - - - -] Service 5 cleanup completed.
>2018-06-26 02:44:36.475 1 ERROR oslo.messaging._drivers.impl_rabbit [req-fa6ab288-de43-49cd-8396-daf402962e5c - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:44:36.477 1 ERROR oslo.messaging._drivers.impl_rabbit [req-fa6ab288-de43-49cd-8396-daf402962e5c - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:44:36.477 1 ERROR oslo_service.service [req-fa6ab288-de43-49cd-8396-daf402962e5c - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:44:36.477 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 02:44:36.477 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 02:44:36.477 1 ERROR oslo_service.service     service.start()
>2018-06-26 02:44:36.477 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 02:44:36.477 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 02:44:36.477 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 02:44:36.477 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 02:44:36.477 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 02:44:36.477 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 02:44:36.477 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 02:44:36.477 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 02:44:36.477 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 02:44:36.477 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 02:44:36.477 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 02:44:36.477 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 02:44:36.477 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 02:44:36.477 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 02:44:36.477 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 02:44:36.477 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 02:44:36.477 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 02:44:36.477 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 02:44:36.477 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 02:44:36.477 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 02:44:36.477 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 02:44:36.477 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 02:44:36.477 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:44:36.477 1 ERROR oslo_service.service 
>2018-06-26 02:44:36.480 1 CRITICAL cinder [req-7b3216ff-ae4a-4279-bf12-ce59e54d14d1 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 02:44:36.480 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 02:44:36.480 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 02:44:36.480 1 ERROR cinder     sys.exit(main())
>2018-06-26 02:44:36.480 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 02:44:36.480 1 ERROR cinder     service.wait()
>2018-06-26 02:44:36.480 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 02:44:36.480 1 ERROR cinder     _launcher.wait()
>2018-06-26 02:44:36.480 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 02:44:36.480 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 02:44:36.480 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 02:44:36.480 1 ERROR cinder     self.services.wait()
>2018-06-26 02:44:36.480 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 02:44:36.480 1 ERROR cinder     service.wait()
>2018-06-26 02:44:36.480 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 02:44:36.480 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 02:44:36.480 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 02:44:36.480 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 02:44:36.480 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 02:44:36.480 1 ERROR cinder     post_fn = fn()
>2018-06-26 02:44:36.480 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 02:44:36.480 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 02:44:36.480 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 02:44:36.480 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 02:44:36.480 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 02:44:36.480 1 ERROR cinder 
>2018-06-26 02:44:38.974 1 WARNING cinder.scheduler.host_manager [req-8b582418-488c-435c-985f-ad2881d0cf8a - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 02:44:38.981 1 INFO cinder.rpc [req-8b582418-488c-435c-985f-ad2881d0cf8a - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 02:44:38.992 1 INFO cinder.rpc [req-8b582418-488c-435c-985f-ad2881d0cf8a - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 02:44:39.010 1 INFO cinder.rpc [req-8b582418-488c-435c-985f-ad2881d0cf8a - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 02:44:39.016 1 INFO cinder.rpc [req-8b582418-488c-435c-985f-ad2881d0cf8a - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 02:44:39.043 1 WARNING oslo_config.cfg [req-8b582418-488c-435c-985f-ad2881d0cf8a - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 02:44:39.046 1 WARNING oslo_config.cfg [req-8b582418-488c-435c-985f-ad2881d0cf8a - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:44:39.046 1 WARNING oslo_config.cfg [req-8b582418-488c-435c-985f-ad2881d0cf8a - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:44:39.047 1 WARNING oslo_config.cfg [req-8b582418-488c-435c-985f-ad2881d0cf8a - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:44:39.052 1 WARNING oslo_config.cfg [req-8b582418-488c-435c-985f-ad2881d0cf8a - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 02:44:39.053 1 WARNING oslo_config.cfg [req-8b582418-488c-435c-985f-ad2881d0cf8a - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 02:44:39.056 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 02:44:39.061 1 INFO cinder.manager [req-f83953c1-b858-4f19-8fd0-0b12c174f056 - - - - -] Initiating service 5 cleanup
>2018-06-26 02:44:39.066 1 INFO cinder.manager [req-f83953c1-b858-4f19-8fd0-0b12c174f056 - - - - -] Service 5 cleanup completed.
>2018-06-26 02:46:43.430 1 ERROR oslo.messaging._drivers.impl_rabbit [req-f83953c1-b858-4f19-8fd0-0b12c174f056 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:46:43.432 1 ERROR oslo.messaging._drivers.impl_rabbit [req-f83953c1-b858-4f19-8fd0-0b12c174f056 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:46:43.433 1 ERROR oslo_service.service [req-f83953c1-b858-4f19-8fd0-0b12c174f056 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:46:43.433 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 02:46:43.433 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 02:46:43.433 1 ERROR oslo_service.service     service.start()
>2018-06-26 02:46:43.433 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 02:46:43.433 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 02:46:43.433 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 02:46:43.433 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 02:46:43.433 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 02:46:43.433 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 02:46:43.433 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 02:46:43.433 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 02:46:43.433 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 02:46:43.433 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 02:46:43.433 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 02:46:43.433 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 02:46:43.433 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 02:46:43.433 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 02:46:43.433 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 02:46:43.433 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 02:46:43.433 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 02:46:43.433 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 02:46:43.433 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 02:46:43.433 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 02:46:43.433 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 02:46:43.433 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 02:46:43.433 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:46:43.433 1 ERROR oslo_service.service 
>2018-06-26 02:46:43.435 1 CRITICAL cinder [req-8b582418-488c-435c-985f-ad2881d0cf8a - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 02:46:43.435 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 02:46:43.435 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 02:46:43.435 1 ERROR cinder     sys.exit(main())
>2018-06-26 02:46:43.435 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 02:46:43.435 1 ERROR cinder     service.wait()
>2018-06-26 02:46:43.435 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 02:46:43.435 1 ERROR cinder     _launcher.wait()
>2018-06-26 02:46:43.435 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 02:46:43.435 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 02:46:43.435 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 02:46:43.435 1 ERROR cinder     self.services.wait()
>2018-06-26 02:46:43.435 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 02:46:43.435 1 ERROR cinder     service.wait()
>2018-06-26 02:46:43.435 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 02:46:43.435 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 02:46:43.435 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 02:46:43.435 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 02:46:43.435 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 02:46:43.435 1 ERROR cinder     post_fn = fn()
>2018-06-26 02:46:43.435 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 02:46:43.435 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 02:46:43.435 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 02:46:43.435 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 02:46:43.435 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 02:46:43.435 1 ERROR cinder 
>2018-06-26 02:46:46.035 1 WARNING cinder.scheduler.host_manager [req-40e889ba-c3e8-49ed-8718-8a3e9922092b - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 02:46:46.043 1 INFO cinder.rpc [req-40e889ba-c3e8-49ed-8718-8a3e9922092b - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 02:46:46.049 1 INFO cinder.rpc [req-40e889ba-c3e8-49ed-8718-8a3e9922092b - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 02:46:46.063 1 INFO cinder.rpc [req-40e889ba-c3e8-49ed-8718-8a3e9922092b - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 02:46:46.073 1 INFO cinder.rpc [req-40e889ba-c3e8-49ed-8718-8a3e9922092b - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 02:46:46.103 1 WARNING oslo_config.cfg [req-40e889ba-c3e8-49ed-8718-8a3e9922092b - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 02:46:46.105 1 WARNING oslo_config.cfg [req-40e889ba-c3e8-49ed-8718-8a3e9922092b - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:46:46.105 1 WARNING oslo_config.cfg [req-40e889ba-c3e8-49ed-8718-8a3e9922092b - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:46:46.106 1 WARNING oslo_config.cfg [req-40e889ba-c3e8-49ed-8718-8a3e9922092b - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:46:46.111 1 WARNING oslo_config.cfg [req-40e889ba-c3e8-49ed-8718-8a3e9922092b - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 02:46:46.112 1 WARNING oslo_config.cfg [req-40e889ba-c3e8-49ed-8718-8a3e9922092b - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 02:46:46.115 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 02:46:46.125 1 INFO cinder.manager [req-60e280e4-a2dd-40e6-9a91-43dfaa134760 - - - - -] Initiating service 5 cleanup
>2018-06-26 02:46:46.132 1 INFO cinder.manager [req-60e280e4-a2dd-40e6-9a91-43dfaa134760 - - - - -] Service 5 cleanup completed.
>2018-06-26 02:48:52.253 1 ERROR oslo.messaging._drivers.impl_rabbit [req-60e280e4-a2dd-40e6-9a91-43dfaa134760 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:48:52.255 1 ERROR oslo.messaging._drivers.impl_rabbit [req-60e280e4-a2dd-40e6-9a91-43dfaa134760 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:48:52.255 1 ERROR oslo_service.service [req-60e280e4-a2dd-40e6-9a91-43dfaa134760 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:48:52.255 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 02:48:52.255 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 02:48:52.255 1 ERROR oslo_service.service     service.start()
>2018-06-26 02:48:52.255 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 02:48:52.255 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 02:48:52.255 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 02:48:52.255 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 02:48:52.255 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 02:48:52.255 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 02:48:52.255 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 02:48:52.255 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 02:48:52.255 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 02:48:52.255 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 02:48:52.255 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 02:48:52.255 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 02:48:52.255 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 02:48:52.255 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 02:48:52.255 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 02:48:52.255 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 02:48:52.255 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 02:48:52.255 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 02:48:52.255 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 02:48:52.255 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 02:48:52.255 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 02:48:52.255 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 02:48:52.255 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:48:52.255 1 ERROR oslo_service.service 
>2018-06-26 02:48:52.258 1 CRITICAL cinder [req-40e889ba-c3e8-49ed-8718-8a3e9922092b - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 02:48:52.258 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 02:48:52.258 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 02:48:52.258 1 ERROR cinder     sys.exit(main())
>2018-06-26 02:48:52.258 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 02:48:52.258 1 ERROR cinder     service.wait()
>2018-06-26 02:48:52.258 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 02:48:52.258 1 ERROR cinder     _launcher.wait()
>2018-06-26 02:48:52.258 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 02:48:52.258 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 02:48:52.258 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 02:48:52.258 1 ERROR cinder     self.services.wait()
>2018-06-26 02:48:52.258 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 02:48:52.258 1 ERROR cinder     service.wait()
>2018-06-26 02:48:52.258 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 02:48:52.258 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 02:48:52.258 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 02:48:52.258 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 02:48:52.258 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 02:48:52.258 1 ERROR cinder     post_fn = fn()
>2018-06-26 02:48:52.258 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 02:48:52.258 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 02:48:52.258 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 02:48:52.258 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 02:48:52.258 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 02:48:52.258 1 ERROR cinder 
>2018-06-26 02:48:54.881 1 WARNING cinder.scheduler.host_manager [req-f927bca1-b504-468f-b800-d4312ecafc15 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 02:48:54.887 1 INFO cinder.rpc [req-f927bca1-b504-468f-b800-d4312ecafc15 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 02:48:54.893 1 INFO cinder.rpc [req-f927bca1-b504-468f-b800-d4312ecafc15 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 02:48:54.908 1 INFO cinder.rpc [req-f927bca1-b504-468f-b800-d4312ecafc15 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 02:48:54.915 1 INFO cinder.rpc [req-f927bca1-b504-468f-b800-d4312ecafc15 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 02:48:54.944 1 WARNING oslo_config.cfg [req-f927bca1-b504-468f-b800-d4312ecafc15 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 02:48:54.947 1 WARNING oslo_config.cfg [req-f927bca1-b504-468f-b800-d4312ecafc15 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:48:54.947 1 WARNING oslo_config.cfg [req-f927bca1-b504-468f-b800-d4312ecafc15 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:48:54.948 1 WARNING oslo_config.cfg [req-f927bca1-b504-468f-b800-d4312ecafc15 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:48:54.953 1 WARNING oslo_config.cfg [req-f927bca1-b504-468f-b800-d4312ecafc15 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 02:48:54.954 1 WARNING oslo_config.cfg [req-f927bca1-b504-468f-b800-d4312ecafc15 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 02:48:54.956 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 02:48:54.963 1 INFO cinder.manager [req-1b2b14a9-c583-4861-83e1-f0a0a4bb29e6 - - - - -] Initiating service 5 cleanup
>2018-06-26 02:48:54.968 1 INFO cinder.manager [req-1b2b14a9-c583-4861-83e1-f0a0a4bb29e6 - - - - -] Service 5 cleanup completed.
>2018-06-26 02:50:59.404 1 ERROR oslo.messaging._drivers.impl_rabbit [req-1b2b14a9-c583-4861-83e1-f0a0a4bb29e6 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:50:59.406 1 ERROR oslo.messaging._drivers.impl_rabbit [req-1b2b14a9-c583-4861-83e1-f0a0a4bb29e6 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:50:59.407 1 ERROR oslo_service.service [req-1b2b14a9-c583-4861-83e1-f0a0a4bb29e6 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:50:59.407 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 02:50:59.407 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 02:50:59.407 1 ERROR oslo_service.service     service.start()
>2018-06-26 02:50:59.407 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 02:50:59.407 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 02:50:59.407 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 02:50:59.407 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 02:50:59.407 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 02:50:59.407 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 02:50:59.407 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 02:50:59.407 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 02:50:59.407 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 02:50:59.407 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 02:50:59.407 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 02:50:59.407 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 02:50:59.407 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 02:50:59.407 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 02:50:59.407 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 02:50:59.407 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 02:50:59.407 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 02:50:59.407 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 02:50:59.407 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 02:50:59.407 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 02:50:59.407 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 02:50:59.407 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 02:50:59.407 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:50:59.407 1 ERROR oslo_service.service 
>2018-06-26 02:50:59.409 1 CRITICAL cinder [req-f927bca1-b504-468f-b800-d4312ecafc15 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 02:50:59.409 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 02:50:59.409 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 02:50:59.409 1 ERROR cinder     sys.exit(main())
>2018-06-26 02:50:59.409 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 02:50:59.409 1 ERROR cinder     service.wait()
>2018-06-26 02:50:59.409 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 02:50:59.409 1 ERROR cinder     _launcher.wait()
>2018-06-26 02:50:59.409 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 02:50:59.409 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 02:50:59.409 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 02:50:59.409 1 ERROR cinder     self.services.wait()
>2018-06-26 02:50:59.409 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 02:50:59.409 1 ERROR cinder     service.wait()
>2018-06-26 02:50:59.409 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 02:50:59.409 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 02:50:59.409 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 02:50:59.409 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 02:50:59.409 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 02:50:59.409 1 ERROR cinder     post_fn = fn()
>2018-06-26 02:50:59.409 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 02:50:59.409 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 02:50:59.409 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 02:50:59.409 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 02:50:59.409 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 02:50:59.409 1 ERROR cinder 
>2018-06-26 02:51:02.123 1 WARNING cinder.scheduler.host_manager [req-39a270bc-a410-4014-a84c-b7ccd5d14b5f - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 02:51:02.130 1 INFO cinder.rpc [req-39a270bc-a410-4014-a84c-b7ccd5d14b5f - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 02:51:02.138 1 INFO cinder.rpc [req-39a270bc-a410-4014-a84c-b7ccd5d14b5f - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 02:51:02.166 1 INFO cinder.rpc [req-39a270bc-a410-4014-a84c-b7ccd5d14b5f - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 02:51:02.176 1 INFO cinder.rpc [req-39a270bc-a410-4014-a84c-b7ccd5d14b5f - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 02:51:02.212 1 WARNING oslo_config.cfg [req-39a270bc-a410-4014-a84c-b7ccd5d14b5f - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 02:51:02.214 1 WARNING oslo_config.cfg [req-39a270bc-a410-4014-a84c-b7ccd5d14b5f - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:51:02.215 1 WARNING oslo_config.cfg [req-39a270bc-a410-4014-a84c-b7ccd5d14b5f - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:51:02.216 1 WARNING oslo_config.cfg [req-39a270bc-a410-4014-a84c-b7ccd5d14b5f - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:51:02.221 1 WARNING oslo_config.cfg [req-39a270bc-a410-4014-a84c-b7ccd5d14b5f - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 02:51:02.223 1 WARNING oslo_config.cfg [req-39a270bc-a410-4014-a84c-b7ccd5d14b5f - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 02:51:02.226 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 02:51:02.237 1 INFO cinder.manager [req-dba28f62-200e-4084-9db9-cb65f83573aa - - - - -] Initiating service 5 cleanup
>2018-06-26 02:51:02.245 1 INFO cinder.manager [req-dba28f62-200e-4084-9db9-cb65f83573aa - - - - -] Service 5 cleanup completed.
>2018-06-26 02:53:08.205 1 ERROR oslo.messaging._drivers.impl_rabbit [req-dba28f62-200e-4084-9db9-cb65f83573aa - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:53:08.207 1 ERROR oslo.messaging._drivers.impl_rabbit [req-dba28f62-200e-4084-9db9-cb65f83573aa - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:53:08.207 1 ERROR oslo_service.service [req-dba28f62-200e-4084-9db9-cb65f83573aa - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:53:08.207 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 02:53:08.207 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 02:53:08.207 1 ERROR oslo_service.service     service.start()
>2018-06-26 02:53:08.207 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 02:53:08.207 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 02:53:08.207 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 02:53:08.207 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 02:53:08.207 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 02:53:08.207 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 02:53:08.207 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 02:53:08.207 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 02:53:08.207 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 02:53:08.207 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 02:53:08.207 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 02:53:08.207 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 02:53:08.207 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 02:53:08.207 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 02:53:08.207 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 02:53:08.207 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 02:53:08.207 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 02:53:08.207 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 02:53:08.207 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 02:53:08.207 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 02:53:08.207 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 02:53:08.207 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 02:53:08.207 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:53:08.207 1 ERROR oslo_service.service 
>2018-06-26 02:53:08.211 1 CRITICAL cinder [req-39a270bc-a410-4014-a84c-b7ccd5d14b5f - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 02:53:08.211 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 02:53:08.211 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 02:53:08.211 1 ERROR cinder     sys.exit(main())
>2018-06-26 02:53:08.211 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 02:53:08.211 1 ERROR cinder     service.wait()
>2018-06-26 02:53:08.211 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 02:53:08.211 1 ERROR cinder     _launcher.wait()
>2018-06-26 02:53:08.211 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 02:53:08.211 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 02:53:08.211 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 02:53:08.211 1 ERROR cinder     self.services.wait()
>2018-06-26 02:53:08.211 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 02:53:08.211 1 ERROR cinder     service.wait()
>2018-06-26 02:53:08.211 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 02:53:08.211 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 02:53:08.211 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 02:53:08.211 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 02:53:08.211 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 02:53:08.211 1 ERROR cinder     post_fn = fn()
>2018-06-26 02:53:08.211 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 02:53:08.211 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 02:53:08.211 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 02:53:08.211 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 02:53:08.211 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 02:53:08.211 1 ERROR cinder 
>2018-06-26 02:53:10.824 1 WARNING cinder.scheduler.host_manager [req-a06874de-68d6-4fb7-be5c-341d5c5b64e2 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 02:53:10.830 1 INFO cinder.rpc [req-a06874de-68d6-4fb7-be5c-341d5c5b64e2 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 02:53:10.836 1 INFO cinder.rpc [req-a06874de-68d6-4fb7-be5c-341d5c5b64e2 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 02:53:10.848 1 INFO cinder.rpc [req-a06874de-68d6-4fb7-be5c-341d5c5b64e2 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 02:53:10.853 1 INFO cinder.rpc [req-a06874de-68d6-4fb7-be5c-341d5c5b64e2 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 02:53:10.877 1 WARNING oslo_config.cfg [req-a06874de-68d6-4fb7-be5c-341d5c5b64e2 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 02:53:10.880 1 WARNING oslo_config.cfg [req-a06874de-68d6-4fb7-be5c-341d5c5b64e2 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:53:10.880 1 WARNING oslo_config.cfg [req-a06874de-68d6-4fb7-be5c-341d5c5b64e2 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:53:10.881 1 WARNING oslo_config.cfg [req-a06874de-68d6-4fb7-be5c-341d5c5b64e2 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:53:10.886 1 WARNING oslo_config.cfg [req-a06874de-68d6-4fb7-be5c-341d5c5b64e2 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 02:53:10.887 1 WARNING oslo_config.cfg [req-a06874de-68d6-4fb7-be5c-341d5c5b64e2 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 02:53:10.890 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 02:53:10.896 1 INFO cinder.manager [req-249985c4-5084-48d4-ba16-8a97d15ef1bc - - - - -] Initiating service 5 cleanup
>2018-06-26 02:53:10.901 1 INFO cinder.manager [req-249985c4-5084-48d4-ba16-8a97d15ef1bc - - - - -] Service 5 cleanup completed.
>2018-06-26 02:55:16.945 1 ERROR oslo.messaging._drivers.impl_rabbit [req-249985c4-5084-48d4-ba16-8a97d15ef1bc - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:55:16.946 1 ERROR oslo.messaging._drivers.impl_rabbit [req-249985c4-5084-48d4-ba16-8a97d15ef1bc - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:55:16.947 1 ERROR oslo_service.service [req-249985c4-5084-48d4-ba16-8a97d15ef1bc - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:55:16.947 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 02:55:16.947 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 02:55:16.947 1 ERROR oslo_service.service     service.start()
>2018-06-26 02:55:16.947 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 02:55:16.947 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 02:55:16.947 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 02:55:16.947 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 02:55:16.947 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 02:55:16.947 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 02:55:16.947 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 02:55:16.947 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 02:55:16.947 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 02:55:16.947 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 02:55:16.947 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 02:55:16.947 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 02:55:16.947 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 02:55:16.947 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 02:55:16.947 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 02:55:16.947 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 02:55:16.947 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 02:55:16.947 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 02:55:16.947 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 02:55:16.947 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 02:55:16.947 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 02:55:16.947 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 02:55:16.947 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:55:16.947 1 ERROR oslo_service.service 
>2018-06-26 02:55:16.949 1 CRITICAL cinder [req-a06874de-68d6-4fb7-be5c-341d5c5b64e2 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 02:55:16.949 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 02:55:16.949 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 02:55:16.949 1 ERROR cinder     sys.exit(main())
>2018-06-26 02:55:16.949 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 02:55:16.949 1 ERROR cinder     service.wait()
>2018-06-26 02:55:16.949 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 02:55:16.949 1 ERROR cinder     _launcher.wait()
>2018-06-26 02:55:16.949 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 02:55:16.949 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 02:55:16.949 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 02:55:16.949 1 ERROR cinder     self.services.wait()
>2018-06-26 02:55:16.949 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 02:55:16.949 1 ERROR cinder     service.wait()
>2018-06-26 02:55:16.949 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 02:55:16.949 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 02:55:16.949 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 02:55:16.949 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 02:55:16.949 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 02:55:16.949 1 ERROR cinder     post_fn = fn()
>2018-06-26 02:55:16.949 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 02:55:16.949 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 02:55:16.949 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 02:55:16.949 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 02:55:16.949 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 02:55:16.949 1 ERROR cinder 
>2018-06-26 02:55:19.598 1 WARNING cinder.scheduler.host_manager [req-341e25f7-baef-47ea-a13a-a279bddabc99 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 02:55:19.607 1 INFO cinder.rpc [req-341e25f7-baef-47ea-a13a-a279bddabc99 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 02:55:19.614 1 INFO cinder.rpc [req-341e25f7-baef-47ea-a13a-a279bddabc99 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 02:55:19.631 1 INFO cinder.rpc [req-341e25f7-baef-47ea-a13a-a279bddabc99 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 02:55:19.638 1 INFO cinder.rpc [req-341e25f7-baef-47ea-a13a-a279bddabc99 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 02:55:19.671 1 WARNING oslo_config.cfg [req-341e25f7-baef-47ea-a13a-a279bddabc99 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 02:55:19.676 1 WARNING oslo_config.cfg [req-341e25f7-baef-47ea-a13a-a279bddabc99 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:55:19.677 1 WARNING oslo_config.cfg [req-341e25f7-baef-47ea-a13a-a279bddabc99 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:55:19.678 1 WARNING oslo_config.cfg [req-341e25f7-baef-47ea-a13a-a279bddabc99 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:55:19.688 1 WARNING oslo_config.cfg [req-341e25f7-baef-47ea-a13a-a279bddabc99 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 02:55:19.690 1 WARNING oslo_config.cfg [req-341e25f7-baef-47ea-a13a-a279bddabc99 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 02:55:19.695 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 02:55:19.703 1 INFO cinder.manager [req-3f2fe938-4042-4cf9-a195-6de8df83a199 - - - - -] Initiating service 5 cleanup
>2018-06-26 02:55:19.708 1 INFO cinder.manager [req-3f2fe938-4042-4cf9-a195-6de8df83a199 - - - - -] Service 5 cleanup completed.
>2018-06-26 02:57:25.992 1 ERROR oslo.messaging._drivers.impl_rabbit [req-3f2fe938-4042-4cf9-a195-6de8df83a199 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:57:25.994 1 ERROR oslo.messaging._drivers.impl_rabbit [req-3f2fe938-4042-4cf9-a195-6de8df83a199 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:57:25.995 1 ERROR oslo_service.service [req-3f2fe938-4042-4cf9-a195-6de8df83a199 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:57:25.995 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 02:57:25.995 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 02:57:25.995 1 ERROR oslo_service.service     service.start()
>2018-06-26 02:57:25.995 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 02:57:25.995 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 02:57:25.995 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 02:57:25.995 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 02:57:25.995 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 02:57:25.995 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 02:57:25.995 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 02:57:25.995 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 02:57:25.995 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 02:57:25.995 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 02:57:25.995 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 02:57:25.995 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 02:57:25.995 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 02:57:25.995 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 02:57:25.995 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 02:57:25.995 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 02:57:25.995 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 02:57:25.995 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 02:57:25.995 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 02:57:25.995 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 02:57:25.995 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 02:57:25.995 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 02:57:25.995 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:57:25.995 1 ERROR oslo_service.service 
>2018-06-26 02:57:25.998 1 CRITICAL cinder [req-341e25f7-baef-47ea-a13a-a279bddabc99 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 02:57:25.998 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 02:57:25.998 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 02:57:25.998 1 ERROR cinder     sys.exit(main())
>2018-06-26 02:57:25.998 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 02:57:25.998 1 ERROR cinder     service.wait()
>2018-06-26 02:57:25.998 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 02:57:25.998 1 ERROR cinder     _launcher.wait()
>2018-06-26 02:57:25.998 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 02:57:25.998 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 02:57:25.998 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 02:57:25.998 1 ERROR cinder     self.services.wait()
>2018-06-26 02:57:25.998 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 02:57:25.998 1 ERROR cinder     service.wait()
>2018-06-26 02:57:25.998 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 02:57:25.998 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 02:57:25.998 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 02:57:25.998 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 02:57:25.998 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 02:57:25.998 1 ERROR cinder     post_fn = fn()
>2018-06-26 02:57:25.998 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 02:57:25.998 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 02:57:25.998 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 02:57:25.998 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 02:57:25.998 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 02:57:25.998 1 ERROR cinder 
>2018-06-26 02:57:28.727 1 WARNING cinder.scheduler.host_manager [req-6676ce3e-60d0-435f-a800-34a5ced4708c - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 02:57:28.734 1 INFO cinder.rpc [req-6676ce3e-60d0-435f-a800-34a5ced4708c - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 02:57:28.742 1 INFO cinder.rpc [req-6676ce3e-60d0-435f-a800-34a5ced4708c - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 02:57:28.755 1 INFO cinder.rpc [req-6676ce3e-60d0-435f-a800-34a5ced4708c - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 02:57:28.761 1 INFO cinder.rpc [req-6676ce3e-60d0-435f-a800-34a5ced4708c - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 02:57:28.785 1 WARNING oslo_config.cfg [req-6676ce3e-60d0-435f-a800-34a5ced4708c - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 02:57:28.788 1 WARNING oslo_config.cfg [req-6676ce3e-60d0-435f-a800-34a5ced4708c - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:57:28.788 1 WARNING oslo_config.cfg [req-6676ce3e-60d0-435f-a800-34a5ced4708c - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:57:28.789 1 WARNING oslo_config.cfg [req-6676ce3e-60d0-435f-a800-34a5ced4708c - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:57:28.794 1 WARNING oslo_config.cfg [req-6676ce3e-60d0-435f-a800-34a5ced4708c - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 02:57:28.795 1 WARNING oslo_config.cfg [req-6676ce3e-60d0-435f-a800-34a5ced4708c - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 02:57:28.798 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 02:57:28.806 1 INFO cinder.manager [req-b727dab6-69b1-4a8c-8778-2bb7184fe1d0 - - - - -] Initiating service 5 cleanup
>2018-06-26 02:57:28.811 1 INFO cinder.manager [req-b727dab6-69b1-4a8c-8778-2bb7184fe1d0 - - - - -] Service 5 cleanup completed.
>2018-06-26 02:59:41.619 1 ERROR oslo.messaging._drivers.impl_rabbit [req-b727dab6-69b1-4a8c-8778-2bb7184fe1d0 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:59:41.622 1 ERROR oslo.messaging._drivers.impl_rabbit [req-b727dab6-69b1-4a8c-8778-2bb7184fe1d0 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:59:41.622 1 ERROR oslo_service.service [req-b727dab6-69b1-4a8c-8778-2bb7184fe1d0 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:59:41.622 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 02:59:41.622 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 02:59:41.622 1 ERROR oslo_service.service     service.start()
>2018-06-26 02:59:41.622 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 02:59:41.622 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 02:59:41.622 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 02:59:41.622 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 02:59:41.622 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 02:59:41.622 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 02:59:41.622 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 02:59:41.622 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 02:59:41.622 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 02:59:41.622 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 02:59:41.622 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 02:59:41.622 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 02:59:41.622 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 02:59:41.622 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 02:59:41.622 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 02:59:41.622 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 02:59:41.622 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 02:59:41.622 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 02:59:41.622 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 02:59:41.622 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 02:59:41.622 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 02:59:41.622 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 02:59:41.622 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 02:59:41.622 1 ERROR oslo_service.service 
>2018-06-26 02:59:41.627 1 CRITICAL cinder [req-6676ce3e-60d0-435f-a800-34a5ced4708c - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 02:59:41.627 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 02:59:41.627 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 02:59:41.627 1 ERROR cinder     sys.exit(main())
>2018-06-26 02:59:41.627 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 02:59:41.627 1 ERROR cinder     service.wait()
>2018-06-26 02:59:41.627 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 02:59:41.627 1 ERROR cinder     _launcher.wait()
>2018-06-26 02:59:41.627 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 02:59:41.627 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 02:59:41.627 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 02:59:41.627 1 ERROR cinder     self.services.wait()
>2018-06-26 02:59:41.627 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 02:59:41.627 1 ERROR cinder     service.wait()
>2018-06-26 02:59:41.627 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 02:59:41.627 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 02:59:41.627 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 02:59:41.627 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 02:59:41.627 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 02:59:41.627 1 ERROR cinder     post_fn = fn()
>2018-06-26 02:59:41.627 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 02:59:41.627 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 02:59:41.627 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 02:59:41.627 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 02:59:41.627 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 02:59:41.627 1 ERROR cinder 
>2018-06-26 02:59:44.289 1 WARNING cinder.scheduler.host_manager [req-2c18e553-542c-403f-9d75-9150d80a8c44 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 02:59:44.294 1 INFO cinder.rpc [req-2c18e553-542c-403f-9d75-9150d80a8c44 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 02:59:44.302 1 INFO cinder.rpc [req-2c18e553-542c-403f-9d75-9150d80a8c44 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 02:59:44.316 1 INFO cinder.rpc [req-2c18e553-542c-403f-9d75-9150d80a8c44 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 02:59:44.322 1 INFO cinder.rpc [req-2c18e553-542c-403f-9d75-9150d80a8c44 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 02:59:44.348 1 WARNING oslo_config.cfg [req-2c18e553-542c-403f-9d75-9150d80a8c44 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 02:59:44.350 1 WARNING oslo_config.cfg [req-2c18e553-542c-403f-9d75-9150d80a8c44 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:59:44.350 1 WARNING oslo_config.cfg [req-2c18e553-542c-403f-9d75-9150d80a8c44 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:59:44.351 1 WARNING oslo_config.cfg [req-2c18e553-542c-403f-9d75-9150d80a8c44 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 02:59:44.357 1 WARNING oslo_config.cfg [req-2c18e553-542c-403f-9d75-9150d80a8c44 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 02:59:44.358 1 WARNING oslo_config.cfg [req-2c18e553-542c-403f-9d75-9150d80a8c44 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 02:59:44.361 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 02:59:44.371 1 INFO cinder.manager [req-564cf8dc-865e-4c82-b9d4-283d6cd474b6 - - - - -] Initiating service 5 cleanup
>2018-06-26 02:59:44.377 1 INFO cinder.manager [req-564cf8dc-865e-4c82-b9d4-283d6cd474b6 - - - - -] Service 5 cleanup completed.
>2018-06-26 03:01:50.798 1 ERROR oslo.messaging._drivers.impl_rabbit [req-564cf8dc-865e-4c82-b9d4-283d6cd474b6 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:01:50.800 1 ERROR oslo.messaging._drivers.impl_rabbit [req-564cf8dc-865e-4c82-b9d4-283d6cd474b6 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:01:50.800 1 ERROR oslo_service.service [req-564cf8dc-865e-4c82-b9d4-283d6cd474b6 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:01:50.800 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 03:01:50.800 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 03:01:50.800 1 ERROR oslo_service.service     service.start()
>2018-06-26 03:01:50.800 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 03:01:50.800 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 03:01:50.800 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 03:01:50.800 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 03:01:50.800 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 03:01:50.800 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 03:01:50.800 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 03:01:50.800 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 03:01:50.800 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 03:01:50.800 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 03:01:50.800 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 03:01:50.800 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 03:01:50.800 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 03:01:50.800 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 03:01:50.800 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 03:01:50.800 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 03:01:50.800 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 03:01:50.800 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 03:01:50.800 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 03:01:50.800 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 03:01:50.800 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 03:01:50.800 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 03:01:50.800 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:01:50.800 1 ERROR oslo_service.service 
>2018-06-26 03:01:50.804 1 CRITICAL cinder [req-2c18e553-542c-403f-9d75-9150d80a8c44 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 03:01:50.804 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 03:01:50.804 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 03:01:50.804 1 ERROR cinder     sys.exit(main())
>2018-06-26 03:01:50.804 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 03:01:50.804 1 ERROR cinder     service.wait()
>2018-06-26 03:01:50.804 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 03:01:50.804 1 ERROR cinder     _launcher.wait()
>2018-06-26 03:01:50.804 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 03:01:50.804 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 03:01:50.804 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 03:01:50.804 1 ERROR cinder     self.services.wait()
>2018-06-26 03:01:50.804 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 03:01:50.804 1 ERROR cinder     service.wait()
>2018-06-26 03:01:50.804 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 03:01:50.804 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 03:01:50.804 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 03:01:50.804 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 03:01:50.804 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 03:01:50.804 1 ERROR cinder     post_fn = fn()
>2018-06-26 03:01:50.804 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 03:01:50.804 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 03:01:50.804 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 03:01:50.804 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 03:01:50.804 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 03:01:50.804 1 ERROR cinder 
>2018-06-26 03:01:53.453 1 WARNING cinder.scheduler.host_manager [req-255afc53-4bdd-4da5-ace1-63f08dc8267f - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 03:01:53.459 1 INFO cinder.rpc [req-255afc53-4bdd-4da5-ace1-63f08dc8267f - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 03:01:53.465 1 INFO cinder.rpc [req-255afc53-4bdd-4da5-ace1-63f08dc8267f - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 03:01:53.475 1 INFO cinder.rpc [req-255afc53-4bdd-4da5-ace1-63f08dc8267f - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 03:01:53.480 1 INFO cinder.rpc [req-255afc53-4bdd-4da5-ace1-63f08dc8267f - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 03:01:53.502 1 WARNING oslo_config.cfg [req-255afc53-4bdd-4da5-ace1-63f08dc8267f - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 03:01:53.504 1 WARNING oslo_config.cfg [req-255afc53-4bdd-4da5-ace1-63f08dc8267f - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:01:53.505 1 WARNING oslo_config.cfg [req-255afc53-4bdd-4da5-ace1-63f08dc8267f - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:01:53.506 1 WARNING oslo_config.cfg [req-255afc53-4bdd-4da5-ace1-63f08dc8267f - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:01:53.511 1 WARNING oslo_config.cfg [req-255afc53-4bdd-4da5-ace1-63f08dc8267f - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 03:01:53.512 1 WARNING oslo_config.cfg [req-255afc53-4bdd-4da5-ace1-63f08dc8267f - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 03:01:53.514 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 03:01:53.520 1 INFO cinder.manager [req-c76e922c-78d7-47b6-b490-dac080e913ca - - - - -] Initiating service 5 cleanup
>2018-06-26 03:01:53.524 1 INFO cinder.manager [req-c76e922c-78d7-47b6-b490-dac080e913ca - - - - -] Service 5 cleanup completed.
>2018-06-26 03:03:59.555 1 ERROR oslo.messaging._drivers.impl_rabbit [req-c76e922c-78d7-47b6-b490-dac080e913ca - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:03:59.557 1 ERROR oslo.messaging._drivers.impl_rabbit [req-c76e922c-78d7-47b6-b490-dac080e913ca - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:03:59.557 1 ERROR oslo_service.service [req-c76e922c-78d7-47b6-b490-dac080e913ca - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:03:59.557 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 03:03:59.557 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 03:03:59.557 1 ERROR oslo_service.service     service.start()
>2018-06-26 03:03:59.557 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 03:03:59.557 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 03:03:59.557 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 03:03:59.557 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 03:03:59.557 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 03:03:59.557 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 03:03:59.557 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 03:03:59.557 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 03:03:59.557 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 03:03:59.557 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 03:03:59.557 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 03:03:59.557 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 03:03:59.557 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 03:03:59.557 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 03:03:59.557 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 03:03:59.557 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 03:03:59.557 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 03:03:59.557 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 03:03:59.557 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 03:03:59.557 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 03:03:59.557 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 03:03:59.557 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 03:03:59.557 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:03:59.557 1 ERROR oslo_service.service 
>2018-06-26 03:03:59.560 1 CRITICAL cinder [req-255afc53-4bdd-4da5-ace1-63f08dc8267f - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 03:03:59.560 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 03:03:59.560 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 03:03:59.560 1 ERROR cinder     sys.exit(main())
>2018-06-26 03:03:59.560 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 03:03:59.560 1 ERROR cinder     service.wait()
>2018-06-26 03:03:59.560 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 03:03:59.560 1 ERROR cinder     _launcher.wait()
>2018-06-26 03:03:59.560 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 03:03:59.560 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 03:03:59.560 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 03:03:59.560 1 ERROR cinder     self.services.wait()
>2018-06-26 03:03:59.560 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 03:03:59.560 1 ERROR cinder     service.wait()
>2018-06-26 03:03:59.560 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 03:03:59.560 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 03:03:59.560 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 03:03:59.560 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 03:03:59.560 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 03:03:59.560 1 ERROR cinder     post_fn = fn()
>2018-06-26 03:03:59.560 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 03:03:59.560 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 03:03:59.560 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 03:03:59.560 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 03:03:59.560 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 03:03:59.560 1 ERROR cinder 
>2018-06-26 03:04:02.179 1 WARNING cinder.scheduler.host_manager [req-d2628aad-d0aa-4b6f-afc7-ecf0f271ceb6 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 03:04:02.184 1 INFO cinder.rpc [req-d2628aad-d0aa-4b6f-afc7-ecf0f271ceb6 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 03:04:02.190 1 INFO cinder.rpc [req-d2628aad-d0aa-4b6f-afc7-ecf0f271ceb6 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 03:04:02.201 1 INFO cinder.rpc [req-d2628aad-d0aa-4b6f-afc7-ecf0f271ceb6 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 03:04:02.207 1 INFO cinder.rpc [req-d2628aad-d0aa-4b6f-afc7-ecf0f271ceb6 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 03:04:02.228 1 WARNING oslo_config.cfg [req-d2628aad-d0aa-4b6f-afc7-ecf0f271ceb6 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 03:04:02.230 1 WARNING oslo_config.cfg [req-d2628aad-d0aa-4b6f-afc7-ecf0f271ceb6 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:04:02.231 1 WARNING oslo_config.cfg [req-d2628aad-d0aa-4b6f-afc7-ecf0f271ceb6 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:04:02.231 1 WARNING oslo_config.cfg [req-d2628aad-d0aa-4b6f-afc7-ecf0f271ceb6 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:04:02.236 1 WARNING oslo_config.cfg [req-d2628aad-d0aa-4b6f-afc7-ecf0f271ceb6 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 03:04:02.237 1 WARNING oslo_config.cfg [req-d2628aad-d0aa-4b6f-afc7-ecf0f271ceb6 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 03:04:02.239 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 03:04:02.245 1 INFO cinder.manager [req-a62297ed-004d-4a5c-8a35-8a7c2c3fb94d - - - - -] Initiating service 5 cleanup
>2018-06-26 03:04:02.249 1 INFO cinder.manager [req-a62297ed-004d-4a5c-8a35-8a7c2c3fb94d - - - - -] Service 5 cleanup completed.
>2018-06-26 03:06:14.474 1 ERROR oslo.messaging._drivers.impl_rabbit [req-a62297ed-004d-4a5c-8a35-8a7c2c3fb94d - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:06:14.476 1 ERROR oslo.messaging._drivers.impl_rabbit [req-a62297ed-004d-4a5c-8a35-8a7c2c3fb94d - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:06:14.476 1 ERROR oslo_service.service [req-a62297ed-004d-4a5c-8a35-8a7c2c3fb94d - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:06:14.476 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 03:06:14.476 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 03:06:14.476 1 ERROR oslo_service.service     service.start()
>2018-06-26 03:06:14.476 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 03:06:14.476 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 03:06:14.476 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 03:06:14.476 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 03:06:14.476 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 03:06:14.476 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 03:06:14.476 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 03:06:14.476 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 03:06:14.476 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 03:06:14.476 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 03:06:14.476 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 03:06:14.476 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 03:06:14.476 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 03:06:14.476 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 03:06:14.476 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 03:06:14.476 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 03:06:14.476 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 03:06:14.476 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 03:06:14.476 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 03:06:14.476 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 03:06:14.476 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 03:06:14.476 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 03:06:14.476 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:06:14.476 1 ERROR oslo_service.service 
>2018-06-26 03:06:14.480 1 CRITICAL cinder [req-d2628aad-d0aa-4b6f-afc7-ecf0f271ceb6 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 03:06:14.480 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 03:06:14.480 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 03:06:14.480 1 ERROR cinder     sys.exit(main())
>2018-06-26 03:06:14.480 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 03:06:14.480 1 ERROR cinder     service.wait()
>2018-06-26 03:06:14.480 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 03:06:14.480 1 ERROR cinder     _launcher.wait()
>2018-06-26 03:06:14.480 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 03:06:14.480 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 03:06:14.480 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 03:06:14.480 1 ERROR cinder     self.services.wait()
>2018-06-26 03:06:14.480 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 03:06:14.480 1 ERROR cinder     service.wait()
>2018-06-26 03:06:14.480 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 03:06:14.480 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 03:06:14.480 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 03:06:14.480 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 03:06:14.480 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 03:06:14.480 1 ERROR cinder     post_fn = fn()
>2018-06-26 03:06:14.480 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 03:06:14.480 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 03:06:14.480 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 03:06:14.480 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 03:06:14.480 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 03:06:14.480 1 ERROR cinder 
>2018-06-26 03:06:17.102 1 WARNING cinder.scheduler.host_manager [req-7655bacf-ceef-4050-8d67-9741be0e1fd3 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 03:06:17.109 1 INFO cinder.rpc [req-7655bacf-ceef-4050-8d67-9741be0e1fd3 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 03:06:17.116 1 INFO cinder.rpc [req-7655bacf-ceef-4050-8d67-9741be0e1fd3 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 03:06:17.128 1 INFO cinder.rpc [req-7655bacf-ceef-4050-8d67-9741be0e1fd3 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 03:06:17.134 1 INFO cinder.rpc [req-7655bacf-ceef-4050-8d67-9741be0e1fd3 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 03:06:17.157 1 WARNING oslo_config.cfg [req-7655bacf-ceef-4050-8d67-9741be0e1fd3 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 03:06:17.159 1 WARNING oslo_config.cfg [req-7655bacf-ceef-4050-8d67-9741be0e1fd3 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:06:17.160 1 WARNING oslo_config.cfg [req-7655bacf-ceef-4050-8d67-9741be0e1fd3 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:06:17.160 1 WARNING oslo_config.cfg [req-7655bacf-ceef-4050-8d67-9741be0e1fd3 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:06:17.165 1 WARNING oslo_config.cfg [req-7655bacf-ceef-4050-8d67-9741be0e1fd3 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 03:06:17.167 1 WARNING oslo_config.cfg [req-7655bacf-ceef-4050-8d67-9741be0e1fd3 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 03:06:17.169 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 03:06:17.178 1 INFO cinder.manager [req-a9876ab0-7065-4d4a-91b1-e7d285e832a4 - - - - -] Initiating service 5 cleanup
>2018-06-26 03:06:17.183 1 INFO cinder.manager [req-a9876ab0-7065-4d4a-91b1-e7d285e832a4 - - - - -] Service 5 cleanup completed.
>2018-06-26 03:08:23.313 1 ERROR oslo.messaging._drivers.impl_rabbit [req-a9876ab0-7065-4d4a-91b1-e7d285e832a4 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:08:23.315 1 ERROR oslo.messaging._drivers.impl_rabbit [req-a9876ab0-7065-4d4a-91b1-e7d285e832a4 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:08:23.315 1 ERROR oslo_service.service [req-a9876ab0-7065-4d4a-91b1-e7d285e832a4 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:08:23.315 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 03:08:23.315 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 03:08:23.315 1 ERROR oslo_service.service     service.start()
>2018-06-26 03:08:23.315 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 03:08:23.315 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 03:08:23.315 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 03:08:23.315 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 03:08:23.315 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 03:08:23.315 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 03:08:23.315 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 03:08:23.315 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 03:08:23.315 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 03:08:23.315 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 03:08:23.315 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 03:08:23.315 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 03:08:23.315 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 03:08:23.315 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 03:08:23.315 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 03:08:23.315 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 03:08:23.315 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 03:08:23.315 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 03:08:23.315 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 03:08:23.315 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 03:08:23.315 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 03:08:23.315 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 03:08:23.315 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:08:23.315 1 ERROR oslo_service.service 
>2018-06-26 03:08:23.318 1 CRITICAL cinder [req-7655bacf-ceef-4050-8d67-9741be0e1fd3 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 03:08:23.318 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 03:08:23.318 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 03:08:23.318 1 ERROR cinder     sys.exit(main())
>2018-06-26 03:08:23.318 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 03:08:23.318 1 ERROR cinder     service.wait()
>2018-06-26 03:08:23.318 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 03:08:23.318 1 ERROR cinder     _launcher.wait()
>2018-06-26 03:08:23.318 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 03:08:23.318 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 03:08:23.318 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 03:08:23.318 1 ERROR cinder     self.services.wait()
>2018-06-26 03:08:23.318 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 03:08:23.318 1 ERROR cinder     service.wait()
>2018-06-26 03:08:23.318 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 03:08:23.318 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 03:08:23.318 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 03:08:23.318 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 03:08:23.318 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 03:08:23.318 1 ERROR cinder     post_fn = fn()
>2018-06-26 03:08:23.318 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 03:08:23.318 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 03:08:23.318 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 03:08:23.318 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 03:08:23.318 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 03:08:23.318 1 ERROR cinder 
>2018-06-26 03:08:25.922 1 WARNING cinder.scheduler.host_manager [req-ff8aaf54-d103-463b-9d61-c2124bf1bb70 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 03:08:25.929 1 INFO cinder.rpc [req-ff8aaf54-d103-463b-9d61-c2124bf1bb70 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 03:08:25.934 1 INFO cinder.rpc [req-ff8aaf54-d103-463b-9d61-c2124bf1bb70 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 03:08:25.946 1 INFO cinder.rpc [req-ff8aaf54-d103-463b-9d61-c2124bf1bb70 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 03:08:25.952 1 INFO cinder.rpc [req-ff8aaf54-d103-463b-9d61-c2124bf1bb70 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 03:08:25.978 1 WARNING oslo_config.cfg [req-ff8aaf54-d103-463b-9d61-c2124bf1bb70 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 03:08:25.980 1 WARNING oslo_config.cfg [req-ff8aaf54-d103-463b-9d61-c2124bf1bb70 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:08:25.981 1 WARNING oslo_config.cfg [req-ff8aaf54-d103-463b-9d61-c2124bf1bb70 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:08:25.981 1 WARNING oslo_config.cfg [req-ff8aaf54-d103-463b-9d61-c2124bf1bb70 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:08:25.986 1 WARNING oslo_config.cfg [req-ff8aaf54-d103-463b-9d61-c2124bf1bb70 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 03:08:25.988 1 WARNING oslo_config.cfg [req-ff8aaf54-d103-463b-9d61-c2124bf1bb70 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 03:08:25.991 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 03:08:25.999 1 INFO cinder.manager [req-dd3b7cc3-ce47-48ae-8d13-af104c5e7df1 - - - - -] Initiating service 5 cleanup
>2018-06-26 03:08:26.003 1 INFO cinder.manager [req-dd3b7cc3-ce47-48ae-8d13-af104c5e7df1 - - - - -] Service 5 cleanup completed.
>2018-06-26 03:10:30.581 1 ERROR oslo.messaging._drivers.impl_rabbit [req-dd3b7cc3-ce47-48ae-8d13-af104c5e7df1 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:10:30.583 1 ERROR oslo.messaging._drivers.impl_rabbit [req-dd3b7cc3-ce47-48ae-8d13-af104c5e7df1 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:10:30.584 1 ERROR oslo_service.service [req-dd3b7cc3-ce47-48ae-8d13-af104c5e7df1 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:10:30.584 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 03:10:30.584 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 03:10:30.584 1 ERROR oslo_service.service     service.start()
>2018-06-26 03:10:30.584 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 03:10:30.584 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 03:10:30.584 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 03:10:30.584 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 03:10:30.584 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 03:10:30.584 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 03:10:30.584 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 03:10:30.584 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 03:10:30.584 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 03:10:30.584 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 03:10:30.584 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 03:10:30.584 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 03:10:30.584 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 03:10:30.584 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 03:10:30.584 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 03:10:30.584 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 03:10:30.584 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 03:10:30.584 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 03:10:30.584 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 03:10:30.584 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 03:10:30.584 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 03:10:30.584 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 03:10:30.584 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:10:30.584 1 ERROR oslo_service.service 
>2018-06-26 03:10:30.587 1 CRITICAL cinder [req-ff8aaf54-d103-463b-9d61-c2124bf1bb70 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 03:10:30.587 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 03:10:30.587 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 03:10:30.587 1 ERROR cinder     sys.exit(main())
>2018-06-26 03:10:30.587 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 03:10:30.587 1 ERROR cinder     service.wait()
>2018-06-26 03:10:30.587 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 03:10:30.587 1 ERROR cinder     _launcher.wait()
>2018-06-26 03:10:30.587 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 03:10:30.587 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 03:10:30.587 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 03:10:30.587 1 ERROR cinder     self.services.wait()
>2018-06-26 03:10:30.587 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 03:10:30.587 1 ERROR cinder     service.wait()
>2018-06-26 03:10:30.587 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 03:10:30.587 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 03:10:30.587 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 03:10:30.587 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 03:10:30.587 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 03:10:30.587 1 ERROR cinder     post_fn = fn()
>2018-06-26 03:10:30.587 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 03:10:30.587 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 03:10:30.587 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 03:10:30.587 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 03:10:30.587 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 03:10:30.587 1 ERROR cinder 
>2018-06-26 03:10:33.401 1 WARNING cinder.scheduler.host_manager [req-f778118f-d84d-4a88-a670-1b06a1a2628f - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 03:10:33.407 1 INFO cinder.rpc [req-f778118f-d84d-4a88-a670-1b06a1a2628f - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 03:10:33.412 1 INFO cinder.rpc [req-f778118f-d84d-4a88-a670-1b06a1a2628f - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 03:10:33.424 1 INFO cinder.rpc [req-f778118f-d84d-4a88-a670-1b06a1a2628f - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 03:10:33.430 1 INFO cinder.rpc [req-f778118f-d84d-4a88-a670-1b06a1a2628f - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 03:10:33.462 1 WARNING oslo_config.cfg [req-f778118f-d84d-4a88-a670-1b06a1a2628f - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 03:10:33.466 1 WARNING oslo_config.cfg [req-f778118f-d84d-4a88-a670-1b06a1a2628f - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:10:33.467 1 WARNING oslo_config.cfg [req-f778118f-d84d-4a88-a670-1b06a1a2628f - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:10:33.468 1 WARNING oslo_config.cfg [req-f778118f-d84d-4a88-a670-1b06a1a2628f - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:10:33.476 1 WARNING oslo_config.cfg [req-f778118f-d84d-4a88-a670-1b06a1a2628f - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 03:10:33.477 1 WARNING oslo_config.cfg [req-f778118f-d84d-4a88-a670-1b06a1a2628f - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 03:10:33.480 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 03:10:33.487 1 INFO cinder.manager [req-22abcf1f-477f-4c78-8c0a-eef85fcc0b88 - - - - -] Initiating service 5 cleanup
>2018-06-26 03:10:33.493 1 INFO cinder.manager [req-22abcf1f-477f-4c78-8c0a-eef85fcc0b88 - - - - -] Service 5 cleanup completed.
>2018-06-26 03:12:45.795 1 ERROR oslo.messaging._drivers.impl_rabbit [req-22abcf1f-477f-4c78-8c0a-eef85fcc0b88 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:12:45.797 1 ERROR oslo.messaging._drivers.impl_rabbit [req-22abcf1f-477f-4c78-8c0a-eef85fcc0b88 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:12:45.797 1 ERROR oslo_service.service [req-22abcf1f-477f-4c78-8c0a-eef85fcc0b88 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:12:45.797 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 03:12:45.797 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 03:12:45.797 1 ERROR oslo_service.service     service.start()
>2018-06-26 03:12:45.797 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 03:12:45.797 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 03:12:45.797 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 03:12:45.797 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 03:12:45.797 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 03:12:45.797 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 03:12:45.797 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 03:12:45.797 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 03:12:45.797 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 03:12:45.797 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 03:12:45.797 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 03:12:45.797 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 03:12:45.797 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 03:12:45.797 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 03:12:45.797 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 03:12:45.797 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 03:12:45.797 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 03:12:45.797 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 03:12:45.797 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 03:12:45.797 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 03:12:45.797 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 03:12:45.797 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 03:12:45.797 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:12:45.797 1 ERROR oslo_service.service 
>2018-06-26 03:12:45.800 1 CRITICAL cinder [req-f778118f-d84d-4a88-a670-1b06a1a2628f - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 03:12:45.800 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 03:12:45.800 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 03:12:45.800 1 ERROR cinder     sys.exit(main())
>2018-06-26 03:12:45.800 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 03:12:45.800 1 ERROR cinder     service.wait()
>2018-06-26 03:12:45.800 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 03:12:45.800 1 ERROR cinder     _launcher.wait()
>2018-06-26 03:12:45.800 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 03:12:45.800 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 03:12:45.800 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 03:12:45.800 1 ERROR cinder     self.services.wait()
>2018-06-26 03:12:45.800 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 03:12:45.800 1 ERROR cinder     service.wait()
>2018-06-26 03:12:45.800 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 03:12:45.800 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 03:12:45.800 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 03:12:45.800 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 03:12:45.800 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 03:12:45.800 1 ERROR cinder     post_fn = fn()
>2018-06-26 03:12:45.800 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 03:12:45.800 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 03:12:45.800 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 03:12:45.800 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 03:12:45.800 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 03:12:45.800 1 ERROR cinder 
>2018-06-26 03:12:48.511 1 WARNING cinder.scheduler.host_manager [req-a74bc814-a74c-4043-b823-9daa1e40257e - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 03:12:48.516 1 INFO cinder.rpc [req-a74bc814-a74c-4043-b823-9daa1e40257e - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 03:12:48.522 1 INFO cinder.rpc [req-a74bc814-a74c-4043-b823-9daa1e40257e - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 03:12:48.535 1 INFO cinder.rpc [req-a74bc814-a74c-4043-b823-9daa1e40257e - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 03:12:48.541 1 INFO cinder.rpc [req-a74bc814-a74c-4043-b823-9daa1e40257e - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 03:12:48.570 1 WARNING oslo_config.cfg [req-a74bc814-a74c-4043-b823-9daa1e40257e - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 03:12:48.572 1 WARNING oslo_config.cfg [req-a74bc814-a74c-4043-b823-9daa1e40257e - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:12:48.573 1 WARNING oslo_config.cfg [req-a74bc814-a74c-4043-b823-9daa1e40257e - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:12:48.573 1 WARNING oslo_config.cfg [req-a74bc814-a74c-4043-b823-9daa1e40257e - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:12:48.579 1 WARNING oslo_config.cfg [req-a74bc814-a74c-4043-b823-9daa1e40257e - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 03:12:48.580 1 WARNING oslo_config.cfg [req-a74bc814-a74c-4043-b823-9daa1e40257e - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 03:12:48.583 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 03:12:48.589 1 INFO cinder.manager [req-db5385c5-ed54-4865-8760-56574e2bc233 - - - - -] Initiating service 5 cleanup
>2018-06-26 03:12:48.593 1 INFO cinder.manager [req-db5385c5-ed54-4865-8760-56574e2bc233 - - - - -] Service 5 cleanup completed.
>2018-06-26 03:15:00.220 1 ERROR oslo.messaging._drivers.impl_rabbit [req-db5385c5-ed54-4865-8760-56574e2bc233 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:15:00.222 1 ERROR oslo.messaging._drivers.impl_rabbit [req-db5385c5-ed54-4865-8760-56574e2bc233 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:15:00.223 1 ERROR oslo_service.service [req-db5385c5-ed54-4865-8760-56574e2bc233 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:15:00.223 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 03:15:00.223 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 03:15:00.223 1 ERROR oslo_service.service     service.start()
>2018-06-26 03:15:00.223 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 03:15:00.223 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 03:15:00.223 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 03:15:00.223 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 03:15:00.223 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 03:15:00.223 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 03:15:00.223 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 03:15:00.223 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 03:15:00.223 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 03:15:00.223 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 03:15:00.223 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 03:15:00.223 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 03:15:00.223 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 03:15:00.223 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 03:15:00.223 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 03:15:00.223 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 03:15:00.223 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 03:15:00.223 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 03:15:00.223 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 03:15:00.223 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 03:15:00.223 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 03:15:00.223 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 03:15:00.223 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:15:00.223 1 ERROR oslo_service.service 
>2018-06-26 03:15:00.226 1 CRITICAL cinder [req-a74bc814-a74c-4043-b823-9daa1e40257e - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 03:15:00.226 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 03:15:00.226 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 03:15:00.226 1 ERROR cinder     sys.exit(main())
>2018-06-26 03:15:00.226 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 03:15:00.226 1 ERROR cinder     service.wait()
>2018-06-26 03:15:00.226 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 03:15:00.226 1 ERROR cinder     _launcher.wait()
>2018-06-26 03:15:00.226 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 03:15:00.226 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 03:15:00.226 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 03:15:00.226 1 ERROR cinder     self.services.wait()
>2018-06-26 03:15:00.226 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 03:15:00.226 1 ERROR cinder     service.wait()
>2018-06-26 03:15:00.226 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 03:15:00.226 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 03:15:00.226 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 03:15:00.226 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 03:15:00.226 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 03:15:00.226 1 ERROR cinder     post_fn = fn()
>2018-06-26 03:15:00.226 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 03:15:00.226 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 03:15:00.226 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 03:15:00.226 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 03:15:00.226 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 03:15:00.226 1 ERROR cinder 
>2018-06-26 03:15:02.911 1 WARNING cinder.scheduler.host_manager [req-e698c677-5090-4f23-98cc-0a386dc6e9a2 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 03:15:02.918 1 INFO cinder.rpc [req-e698c677-5090-4f23-98cc-0a386dc6e9a2 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 03:15:02.924 1 INFO cinder.rpc [req-e698c677-5090-4f23-98cc-0a386dc6e9a2 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 03:15:02.934 1 INFO cinder.rpc [req-e698c677-5090-4f23-98cc-0a386dc6e9a2 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 03:15:02.942 1 INFO cinder.rpc [req-e698c677-5090-4f23-98cc-0a386dc6e9a2 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 03:15:02.974 1 WARNING oslo_config.cfg [req-e698c677-5090-4f23-98cc-0a386dc6e9a2 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 03:15:02.976 1 WARNING oslo_config.cfg [req-e698c677-5090-4f23-98cc-0a386dc6e9a2 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:15:02.977 1 WARNING oslo_config.cfg [req-e698c677-5090-4f23-98cc-0a386dc6e9a2 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:15:02.977 1 WARNING oslo_config.cfg [req-e698c677-5090-4f23-98cc-0a386dc6e9a2 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:15:02.982 1 WARNING oslo_config.cfg [req-e698c677-5090-4f23-98cc-0a386dc6e9a2 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 03:15:02.983 1 WARNING oslo_config.cfg [req-e698c677-5090-4f23-98cc-0a386dc6e9a2 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 03:15:02.986 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 03:15:02.995 1 INFO cinder.manager [req-3122d8b0-654c-4d5b-ad26-147561bedc9d - - - - -] Initiating service 5 cleanup
>2018-06-26 03:15:03.001 1 INFO cinder.manager [req-3122d8b0-654c-4d5b-ad26-147561bedc9d - - - - -] Service 5 cleanup completed.
>2018-06-26 03:17:09.197 1 ERROR oslo.messaging._drivers.impl_rabbit [req-3122d8b0-654c-4d5b-ad26-147561bedc9d - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:17:09.199 1 ERROR oslo.messaging._drivers.impl_rabbit [req-3122d8b0-654c-4d5b-ad26-147561bedc9d - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:17:09.199 1 ERROR oslo_service.service [req-3122d8b0-654c-4d5b-ad26-147561bedc9d - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:17:09.199 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 03:17:09.199 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 03:17:09.199 1 ERROR oslo_service.service     service.start()
>2018-06-26 03:17:09.199 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 03:17:09.199 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 03:17:09.199 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 03:17:09.199 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 03:17:09.199 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 03:17:09.199 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 03:17:09.199 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 03:17:09.199 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 03:17:09.199 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 03:17:09.199 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 03:17:09.199 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 03:17:09.199 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 03:17:09.199 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 03:17:09.199 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 03:17:09.199 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 03:17:09.199 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 03:17:09.199 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 03:17:09.199 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 03:17:09.199 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 03:17:09.199 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 03:17:09.199 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 03:17:09.199 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 03:17:09.199 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:17:09.199 1 ERROR oslo_service.service 
>2018-06-26 03:17:09.202 1 CRITICAL cinder [req-e698c677-5090-4f23-98cc-0a386dc6e9a2 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 03:17:09.202 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 03:17:09.202 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 03:17:09.202 1 ERROR cinder     sys.exit(main())
>2018-06-26 03:17:09.202 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 03:17:09.202 1 ERROR cinder     service.wait()
>2018-06-26 03:17:09.202 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 03:17:09.202 1 ERROR cinder     _launcher.wait()
>2018-06-26 03:17:09.202 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 03:17:09.202 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 03:17:09.202 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 03:17:09.202 1 ERROR cinder     self.services.wait()
>2018-06-26 03:17:09.202 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 03:17:09.202 1 ERROR cinder     service.wait()
>2018-06-26 03:17:09.202 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 03:17:09.202 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 03:17:09.202 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 03:17:09.202 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 03:17:09.202 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 03:17:09.202 1 ERROR cinder     post_fn = fn()
>2018-06-26 03:17:09.202 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 03:17:09.202 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 03:17:09.202 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 03:17:09.202 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 03:17:09.202 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 03:17:09.202 1 ERROR cinder 
>2018-06-26 03:17:11.745 1 WARNING cinder.scheduler.host_manager [req-7154f514-5fc6-42e7-9610-e99cf2b89152 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 03:17:11.750 1 INFO cinder.rpc [req-7154f514-5fc6-42e7-9610-e99cf2b89152 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 03:17:11.755 1 INFO cinder.rpc [req-7154f514-5fc6-42e7-9610-e99cf2b89152 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 03:17:11.767 1 INFO cinder.rpc [req-7154f514-5fc6-42e7-9610-e99cf2b89152 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 03:17:11.774 1 INFO cinder.rpc [req-7154f514-5fc6-42e7-9610-e99cf2b89152 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 03:17:11.798 1 WARNING oslo_config.cfg [req-7154f514-5fc6-42e7-9610-e99cf2b89152 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 03:17:11.800 1 WARNING oslo_config.cfg [req-7154f514-5fc6-42e7-9610-e99cf2b89152 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:17:11.800 1 WARNING oslo_config.cfg [req-7154f514-5fc6-42e7-9610-e99cf2b89152 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:17:11.801 1 WARNING oslo_config.cfg [req-7154f514-5fc6-42e7-9610-e99cf2b89152 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:17:11.806 1 WARNING oslo_config.cfg [req-7154f514-5fc6-42e7-9610-e99cf2b89152 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 03:17:11.807 1 WARNING oslo_config.cfg [req-7154f514-5fc6-42e7-9610-e99cf2b89152 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 03:17:11.810 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 03:17:11.815 1 INFO cinder.manager [req-6aef2e71-36ec-4f26-9e86-989cc684290e - - - - -] Initiating service 5 cleanup
>2018-06-26 03:17:11.820 1 INFO cinder.manager [req-6aef2e71-36ec-4f26-9e86-989cc684290e - - - - -] Service 5 cleanup completed.
>2018-06-26 03:19:17.831 1 ERROR oslo.messaging._drivers.impl_rabbit [req-6aef2e71-36ec-4f26-9e86-989cc684290e - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:19:17.833 1 ERROR oslo.messaging._drivers.impl_rabbit [req-6aef2e71-36ec-4f26-9e86-989cc684290e - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:19:17.833 1 ERROR oslo_service.service [req-6aef2e71-36ec-4f26-9e86-989cc684290e - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:19:17.833 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 03:19:17.833 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 03:19:17.833 1 ERROR oslo_service.service     service.start()
>2018-06-26 03:19:17.833 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 03:19:17.833 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 03:19:17.833 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 03:19:17.833 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 03:19:17.833 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 03:19:17.833 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 03:19:17.833 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 03:19:17.833 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 03:19:17.833 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 03:19:17.833 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 03:19:17.833 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 03:19:17.833 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 03:19:17.833 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 03:19:17.833 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 03:19:17.833 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 03:19:17.833 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 03:19:17.833 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 03:19:17.833 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 03:19:17.833 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 03:19:17.833 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 03:19:17.833 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 03:19:17.833 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 03:19:17.833 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:19:17.833 1 ERROR oslo_service.service 
>2018-06-26 03:19:17.836 1 CRITICAL cinder [req-7154f514-5fc6-42e7-9610-e99cf2b89152 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 03:19:17.836 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 03:19:17.836 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 03:19:17.836 1 ERROR cinder     sys.exit(main())
>2018-06-26 03:19:17.836 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 03:19:17.836 1 ERROR cinder     service.wait()
>2018-06-26 03:19:17.836 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 03:19:17.836 1 ERROR cinder     _launcher.wait()
>2018-06-26 03:19:17.836 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 03:19:17.836 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 03:19:17.836 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 03:19:17.836 1 ERROR cinder     self.services.wait()
>2018-06-26 03:19:17.836 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 03:19:17.836 1 ERROR cinder     service.wait()
>2018-06-26 03:19:17.836 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 03:19:17.836 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 03:19:17.836 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 03:19:17.836 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 03:19:17.836 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 03:19:17.836 1 ERROR cinder     post_fn = fn()
>2018-06-26 03:19:17.836 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 03:19:17.836 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 03:19:17.836 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 03:19:17.836 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 03:19:17.836 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 03:19:17.836 1 ERROR cinder 
>2018-06-26 03:19:20.578 1 WARNING cinder.scheduler.host_manager [req-b009baca-6454-4723-9502-1cbb09b742d3 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 03:19:20.589 1 INFO cinder.rpc [req-b009baca-6454-4723-9502-1cbb09b742d3 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 03:19:20.594 1 INFO cinder.rpc [req-b009baca-6454-4723-9502-1cbb09b742d3 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 03:19:20.607 1 INFO cinder.rpc [req-b009baca-6454-4723-9502-1cbb09b742d3 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 03:19:20.612 1 INFO cinder.rpc [req-b009baca-6454-4723-9502-1cbb09b742d3 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 03:19:20.641 1 WARNING oslo_config.cfg [req-b009baca-6454-4723-9502-1cbb09b742d3 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 03:19:20.643 1 WARNING oslo_config.cfg [req-b009baca-6454-4723-9502-1cbb09b742d3 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:19:20.643 1 WARNING oslo_config.cfg [req-b009baca-6454-4723-9502-1cbb09b742d3 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:19:20.644 1 WARNING oslo_config.cfg [req-b009baca-6454-4723-9502-1cbb09b742d3 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:19:20.649 1 WARNING oslo_config.cfg [req-b009baca-6454-4723-9502-1cbb09b742d3 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 03:19:20.650 1 WARNING oslo_config.cfg [req-b009baca-6454-4723-9502-1cbb09b742d3 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 03:19:20.653 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 03:19:20.658 1 INFO cinder.manager [req-5d22657b-b363-42d0-875c-8e454a452630 - - - - -] Initiating service 5 cleanup
>2018-06-26 03:19:20.663 1 INFO cinder.manager [req-5d22657b-b363-42d0-875c-8e454a452630 - - - - -] Service 5 cleanup completed.
>2018-06-26 03:21:27.088 1 ERROR oslo.messaging._drivers.impl_rabbit [req-5d22657b-b363-42d0-875c-8e454a452630 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:21:27.092 1 ERROR oslo.messaging._drivers.impl_rabbit [req-5d22657b-b363-42d0-875c-8e454a452630 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:21:27.093 1 ERROR oslo_service.service [req-5d22657b-b363-42d0-875c-8e454a452630 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:21:27.093 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 03:21:27.093 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 03:21:27.093 1 ERROR oslo_service.service     service.start()
>2018-06-26 03:21:27.093 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 03:21:27.093 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 03:21:27.093 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 03:21:27.093 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 03:21:27.093 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 03:21:27.093 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 03:21:27.093 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 03:21:27.093 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 03:21:27.093 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 03:21:27.093 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 03:21:27.093 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 03:21:27.093 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 03:21:27.093 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 03:21:27.093 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 03:21:27.093 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 03:21:27.093 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 03:21:27.093 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 03:21:27.093 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 03:21:27.093 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 03:21:27.093 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 03:21:27.093 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 03:21:27.093 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 03:21:27.093 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:21:27.093 1 ERROR oslo_service.service 
>2018-06-26 03:21:27.096 1 CRITICAL cinder [req-b009baca-6454-4723-9502-1cbb09b742d3 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 03:21:27.096 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 03:21:27.096 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 03:21:27.096 1 ERROR cinder     sys.exit(main())
>2018-06-26 03:21:27.096 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 03:21:27.096 1 ERROR cinder     service.wait()
>2018-06-26 03:21:27.096 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 03:21:27.096 1 ERROR cinder     _launcher.wait()
>2018-06-26 03:21:27.096 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 03:21:27.096 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 03:21:27.096 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 03:21:27.096 1 ERROR cinder     self.services.wait()
>2018-06-26 03:21:27.096 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 03:21:27.096 1 ERROR cinder     service.wait()
>2018-06-26 03:21:27.096 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 03:21:27.096 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 03:21:27.096 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 03:21:27.096 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 03:21:27.096 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 03:21:27.096 1 ERROR cinder     post_fn = fn()
>2018-06-26 03:21:27.096 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 03:21:27.096 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 03:21:27.096 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 03:21:27.096 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 03:21:27.096 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 03:21:27.096 1 ERROR cinder 
>2018-06-26 03:21:30.014 1 WARNING cinder.scheduler.host_manager [req-c429ee0c-fd5a-47ed-874c-73a988dea4b4 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 03:21:30.023 1 INFO cinder.rpc [req-c429ee0c-fd5a-47ed-874c-73a988dea4b4 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 03:21:30.033 1 INFO cinder.rpc [req-c429ee0c-fd5a-47ed-874c-73a988dea4b4 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 03:21:30.046 1 INFO cinder.rpc [req-c429ee0c-fd5a-47ed-874c-73a988dea4b4 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 03:21:30.052 1 INFO cinder.rpc [req-c429ee0c-fd5a-47ed-874c-73a988dea4b4 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 03:21:30.073 1 WARNING oslo_config.cfg [req-c429ee0c-fd5a-47ed-874c-73a988dea4b4 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 03:21:30.075 1 WARNING oslo_config.cfg [req-c429ee0c-fd5a-47ed-874c-73a988dea4b4 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:21:30.076 1 WARNING oslo_config.cfg [req-c429ee0c-fd5a-47ed-874c-73a988dea4b4 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:21:30.076 1 WARNING oslo_config.cfg [req-c429ee0c-fd5a-47ed-874c-73a988dea4b4 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:21:30.081 1 WARNING oslo_config.cfg [req-c429ee0c-fd5a-47ed-874c-73a988dea4b4 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 03:21:30.082 1 WARNING oslo_config.cfg [req-c429ee0c-fd5a-47ed-874c-73a988dea4b4 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 03:21:30.085 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 03:21:30.091 1 INFO cinder.manager [req-e6fda32d-1907-47f3-be7a-9e4fd7725397 - - - - -] Initiating service 5 cleanup
>2018-06-26 03:21:30.095 1 INFO cinder.manager [req-e6fda32d-1907-47f3-be7a-9e4fd7725397 - - - - -] Service 5 cleanup completed.
>2018-06-26 03:23:42.026 1 ERROR oslo.messaging._drivers.impl_rabbit [req-e6fda32d-1907-47f3-be7a-9e4fd7725397 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:23:42.028 1 ERROR oslo.messaging._drivers.impl_rabbit [req-e6fda32d-1907-47f3-be7a-9e4fd7725397 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:23:42.028 1 ERROR oslo_service.service [req-e6fda32d-1907-47f3-be7a-9e4fd7725397 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:23:42.028 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 03:23:42.028 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 03:23:42.028 1 ERROR oslo_service.service     service.start()
>2018-06-26 03:23:42.028 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 03:23:42.028 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 03:23:42.028 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 03:23:42.028 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 03:23:42.028 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 03:23:42.028 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 03:23:42.028 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 03:23:42.028 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 03:23:42.028 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 03:23:42.028 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 03:23:42.028 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 03:23:42.028 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 03:23:42.028 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 03:23:42.028 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 03:23:42.028 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 03:23:42.028 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 03:23:42.028 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 03:23:42.028 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 03:23:42.028 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 03:23:42.028 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 03:23:42.028 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 03:23:42.028 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 03:23:42.028 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:23:42.028 1 ERROR oslo_service.service 
>2018-06-26 03:23:42.031 1 CRITICAL cinder [req-c429ee0c-fd5a-47ed-874c-73a988dea4b4 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 03:23:42.031 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 03:23:42.031 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 03:23:42.031 1 ERROR cinder     sys.exit(main())
>2018-06-26 03:23:42.031 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 03:23:42.031 1 ERROR cinder     service.wait()
>2018-06-26 03:23:42.031 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 03:23:42.031 1 ERROR cinder     _launcher.wait()
>2018-06-26 03:23:42.031 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 03:23:42.031 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 03:23:42.031 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 03:23:42.031 1 ERROR cinder     self.services.wait()
>2018-06-26 03:23:42.031 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 03:23:42.031 1 ERROR cinder     service.wait()
>2018-06-26 03:23:42.031 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 03:23:42.031 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 03:23:42.031 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 03:23:42.031 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 03:23:42.031 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 03:23:42.031 1 ERROR cinder     post_fn = fn()
>2018-06-26 03:23:42.031 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 03:23:42.031 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 03:23:42.031 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 03:23:42.031 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 03:23:42.031 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 03:23:42.031 1 ERROR cinder 
>2018-06-26 03:23:44.606 1 WARNING cinder.scheduler.host_manager [req-f193761a-3b9f-4f18-a4fe-7441241dba89 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 03:23:44.613 1 INFO cinder.rpc [req-f193761a-3b9f-4f18-a4fe-7441241dba89 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 03:23:44.618 1 INFO cinder.rpc [req-f193761a-3b9f-4f18-a4fe-7441241dba89 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 03:23:44.632 1 INFO cinder.rpc [req-f193761a-3b9f-4f18-a4fe-7441241dba89 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 03:23:44.640 1 INFO cinder.rpc [req-f193761a-3b9f-4f18-a4fe-7441241dba89 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 03:23:44.661 1 WARNING oslo_config.cfg [req-f193761a-3b9f-4f18-a4fe-7441241dba89 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 03:23:44.664 1 WARNING oslo_config.cfg [req-f193761a-3b9f-4f18-a4fe-7441241dba89 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:23:44.664 1 WARNING oslo_config.cfg [req-f193761a-3b9f-4f18-a4fe-7441241dba89 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:23:44.665 1 WARNING oslo_config.cfg [req-f193761a-3b9f-4f18-a4fe-7441241dba89 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:23:44.670 1 WARNING oslo_config.cfg [req-f193761a-3b9f-4f18-a4fe-7441241dba89 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 03:23:44.671 1 WARNING oslo_config.cfg [req-f193761a-3b9f-4f18-a4fe-7441241dba89 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 03:23:44.674 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 03:23:44.680 1 INFO cinder.manager [req-31a7a739-5a83-4f01-8c69-34f08404e8aa - - - - -] Initiating service 5 cleanup
>2018-06-26 03:23:44.687 1 INFO cinder.manager [req-31a7a739-5a83-4f01-8c69-34f08404e8aa - - - - -] Service 5 cleanup completed.
>2018-06-26 03:25:50.866 1 ERROR oslo.messaging._drivers.impl_rabbit [req-31a7a739-5a83-4f01-8c69-34f08404e8aa - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:25:50.867 1 ERROR oslo.messaging._drivers.impl_rabbit [req-31a7a739-5a83-4f01-8c69-34f08404e8aa - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:25:50.868 1 ERROR oslo_service.service [req-31a7a739-5a83-4f01-8c69-34f08404e8aa - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:25:50.868 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 03:25:50.868 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 03:25:50.868 1 ERROR oslo_service.service     service.start()
>2018-06-26 03:25:50.868 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 03:25:50.868 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 03:25:50.868 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 03:25:50.868 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 03:25:50.868 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 03:25:50.868 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 03:25:50.868 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 03:25:50.868 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 03:25:50.868 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 03:25:50.868 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 03:25:50.868 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 03:25:50.868 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 03:25:50.868 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 03:25:50.868 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 03:25:50.868 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 03:25:50.868 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 03:25:50.868 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 03:25:50.868 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 03:25:50.868 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 03:25:50.868 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 03:25:50.868 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 03:25:50.868 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 03:25:50.868 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:25:50.868 1 ERROR oslo_service.service 
>2018-06-26 03:25:50.871 1 CRITICAL cinder [req-f193761a-3b9f-4f18-a4fe-7441241dba89 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 03:25:50.871 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 03:25:50.871 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 03:25:50.871 1 ERROR cinder     sys.exit(main())
>2018-06-26 03:25:50.871 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 03:25:50.871 1 ERROR cinder     service.wait()
>2018-06-26 03:25:50.871 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 03:25:50.871 1 ERROR cinder     _launcher.wait()
>2018-06-26 03:25:50.871 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 03:25:50.871 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 03:25:50.871 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 03:25:50.871 1 ERROR cinder     self.services.wait()
>2018-06-26 03:25:50.871 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 03:25:50.871 1 ERROR cinder     service.wait()
>2018-06-26 03:25:50.871 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 03:25:50.871 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 03:25:50.871 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 03:25:50.871 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 03:25:50.871 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 03:25:50.871 1 ERROR cinder     post_fn = fn()
>2018-06-26 03:25:50.871 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 03:25:50.871 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 03:25:50.871 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 03:25:50.871 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 03:25:50.871 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 03:25:50.871 1 ERROR cinder 
>2018-06-26 03:25:53.474 1 WARNING cinder.scheduler.host_manager [req-5f86ddaa-f590-4617-9ecd-b27027af978c - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 03:25:53.481 1 INFO cinder.rpc [req-5f86ddaa-f590-4617-9ecd-b27027af978c - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 03:25:53.486 1 INFO cinder.rpc [req-5f86ddaa-f590-4617-9ecd-b27027af978c - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 03:25:53.499 1 INFO cinder.rpc [req-5f86ddaa-f590-4617-9ecd-b27027af978c - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 03:25:53.505 1 INFO cinder.rpc [req-5f86ddaa-f590-4617-9ecd-b27027af978c - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 03:25:53.536 1 WARNING oslo_config.cfg [req-5f86ddaa-f590-4617-9ecd-b27027af978c - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 03:25:53.538 1 WARNING oslo_config.cfg [req-5f86ddaa-f590-4617-9ecd-b27027af978c - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:25:53.538 1 WARNING oslo_config.cfg [req-5f86ddaa-f590-4617-9ecd-b27027af978c - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:25:53.539 1 WARNING oslo_config.cfg [req-5f86ddaa-f590-4617-9ecd-b27027af978c - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:25:53.544 1 WARNING oslo_config.cfg [req-5f86ddaa-f590-4617-9ecd-b27027af978c - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 03:25:53.545 1 WARNING oslo_config.cfg [req-5f86ddaa-f590-4617-9ecd-b27027af978c - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 03:25:53.548 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 03:25:53.553 1 INFO cinder.manager [req-eca7bc77-6683-486b-9f5a-029554ec545c - - - - -] Initiating service 5 cleanup
>2018-06-26 03:25:53.558 1 INFO cinder.manager [req-eca7bc77-6683-486b-9f5a-029554ec545c - - - - -] Service 5 cleanup completed.
>2018-06-26 03:28:05.640 1 ERROR oslo.messaging._drivers.impl_rabbit [req-eca7bc77-6683-486b-9f5a-029554ec545c - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:28:05.642 1 ERROR oslo.messaging._drivers.impl_rabbit [req-eca7bc77-6683-486b-9f5a-029554ec545c - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:28:05.642 1 ERROR oslo_service.service [req-eca7bc77-6683-486b-9f5a-029554ec545c - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:28:05.642 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 03:28:05.642 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 03:28:05.642 1 ERROR oslo_service.service     service.start()
>2018-06-26 03:28:05.642 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 03:28:05.642 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 03:28:05.642 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 03:28:05.642 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 03:28:05.642 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 03:28:05.642 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 03:28:05.642 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 03:28:05.642 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 03:28:05.642 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 03:28:05.642 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 03:28:05.642 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 03:28:05.642 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 03:28:05.642 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 03:28:05.642 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 03:28:05.642 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 03:28:05.642 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 03:28:05.642 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 03:28:05.642 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 03:28:05.642 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 03:28:05.642 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 03:28:05.642 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 03:28:05.642 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 03:28:05.642 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:28:05.642 1 ERROR oslo_service.service 
>2018-06-26 03:28:05.645 1 CRITICAL cinder [req-5f86ddaa-f590-4617-9ecd-b27027af978c - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 03:28:05.645 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 03:28:05.645 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 03:28:05.645 1 ERROR cinder     sys.exit(main())
>2018-06-26 03:28:05.645 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 03:28:05.645 1 ERROR cinder     service.wait()
>2018-06-26 03:28:05.645 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 03:28:05.645 1 ERROR cinder     _launcher.wait()
>2018-06-26 03:28:05.645 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 03:28:05.645 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 03:28:05.645 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 03:28:05.645 1 ERROR cinder     self.services.wait()
>2018-06-26 03:28:05.645 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 03:28:05.645 1 ERROR cinder     service.wait()
>2018-06-26 03:28:05.645 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 03:28:05.645 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 03:28:05.645 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 03:28:05.645 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 03:28:05.645 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 03:28:05.645 1 ERROR cinder     post_fn = fn()
>2018-06-26 03:28:05.645 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 03:28:05.645 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 03:28:05.645 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 03:28:05.645 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 03:28:05.645 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 03:28:05.645 1 ERROR cinder 
>2018-06-26 03:28:08.288 1 WARNING cinder.scheduler.host_manager [req-ec6fc8da-9915-4dd0-837a-0f93ac59998a - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 03:28:08.295 1 INFO cinder.rpc [req-ec6fc8da-9915-4dd0-837a-0f93ac59998a - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 03:28:08.302 1 INFO cinder.rpc [req-ec6fc8da-9915-4dd0-837a-0f93ac59998a - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 03:28:08.317 1 INFO cinder.rpc [req-ec6fc8da-9915-4dd0-837a-0f93ac59998a - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 03:28:08.327 1 INFO cinder.rpc [req-ec6fc8da-9915-4dd0-837a-0f93ac59998a - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 03:28:08.363 1 WARNING oslo_config.cfg [req-ec6fc8da-9915-4dd0-837a-0f93ac59998a - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 03:28:08.367 1 WARNING oslo_config.cfg [req-ec6fc8da-9915-4dd0-837a-0f93ac59998a - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:28:08.368 1 WARNING oslo_config.cfg [req-ec6fc8da-9915-4dd0-837a-0f93ac59998a - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:28:08.369 1 WARNING oslo_config.cfg [req-ec6fc8da-9915-4dd0-837a-0f93ac59998a - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:28:08.380 1 WARNING oslo_config.cfg [req-ec6fc8da-9915-4dd0-837a-0f93ac59998a - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 03:28:08.381 1 WARNING oslo_config.cfg [req-ec6fc8da-9915-4dd0-837a-0f93ac59998a - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 03:28:08.384 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 03:28:08.391 1 INFO cinder.manager [req-19063a94-5e14-46cd-8e92-24ac9e13c491 - - - - -] Initiating service 5 cleanup
>2018-06-26 03:28:08.396 1 INFO cinder.manager [req-19063a94-5e14-46cd-8e92-24ac9e13c491 - - - - -] Service 5 cleanup completed.
>2018-06-26 03:30:20.330 1 ERROR oslo.messaging._drivers.impl_rabbit [req-19063a94-5e14-46cd-8e92-24ac9e13c491 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:30:20.331 1 ERROR oslo.messaging._drivers.impl_rabbit [req-19063a94-5e14-46cd-8e92-24ac9e13c491 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:30:20.332 1 ERROR oslo_service.service [req-19063a94-5e14-46cd-8e92-24ac9e13c491 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:30:20.332 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 03:30:20.332 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 03:30:20.332 1 ERROR oslo_service.service     service.start()
>2018-06-26 03:30:20.332 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 03:30:20.332 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 03:30:20.332 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 03:30:20.332 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 03:30:20.332 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 03:30:20.332 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 03:30:20.332 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 03:30:20.332 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 03:30:20.332 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 03:30:20.332 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 03:30:20.332 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 03:30:20.332 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 03:30:20.332 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 03:30:20.332 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 03:30:20.332 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 03:30:20.332 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 03:30:20.332 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 03:30:20.332 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 03:30:20.332 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 03:30:20.332 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 03:30:20.332 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 03:30:20.332 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 03:30:20.332 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:30:20.332 1 ERROR oslo_service.service 
>2018-06-26 03:30:20.335 1 CRITICAL cinder [req-ec6fc8da-9915-4dd0-837a-0f93ac59998a - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 03:30:20.335 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 03:30:20.335 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 03:30:20.335 1 ERROR cinder     sys.exit(main())
>2018-06-26 03:30:20.335 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 03:30:20.335 1 ERROR cinder     service.wait()
>2018-06-26 03:30:20.335 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 03:30:20.335 1 ERROR cinder     _launcher.wait()
>2018-06-26 03:30:20.335 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 03:30:20.335 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 03:30:20.335 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 03:30:20.335 1 ERROR cinder     self.services.wait()
>2018-06-26 03:30:20.335 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 03:30:20.335 1 ERROR cinder     service.wait()
>2018-06-26 03:30:20.335 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 03:30:20.335 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 03:30:20.335 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 03:30:20.335 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 03:30:20.335 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 03:30:20.335 1 ERROR cinder     post_fn = fn()
>2018-06-26 03:30:20.335 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 03:30:20.335 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 03:30:20.335 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 03:30:20.335 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 03:30:20.335 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 03:30:20.335 1 ERROR cinder 
>2018-06-26 03:30:22.853 1 WARNING cinder.scheduler.host_manager [req-3dbfbd31-d82f-4cfa-abb9-69cef50f48ea - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 03:30:22.859 1 INFO cinder.rpc [req-3dbfbd31-d82f-4cfa-abb9-69cef50f48ea - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 03:30:22.864 1 INFO cinder.rpc [req-3dbfbd31-d82f-4cfa-abb9-69cef50f48ea - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 03:30:22.880 1 INFO cinder.rpc [req-3dbfbd31-d82f-4cfa-abb9-69cef50f48ea - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 03:30:22.886 1 INFO cinder.rpc [req-3dbfbd31-d82f-4cfa-abb9-69cef50f48ea - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 03:30:22.910 1 WARNING oslo_config.cfg [req-3dbfbd31-d82f-4cfa-abb9-69cef50f48ea - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 03:30:22.912 1 WARNING oslo_config.cfg [req-3dbfbd31-d82f-4cfa-abb9-69cef50f48ea - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:30:22.912 1 WARNING oslo_config.cfg [req-3dbfbd31-d82f-4cfa-abb9-69cef50f48ea - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:30:22.913 1 WARNING oslo_config.cfg [req-3dbfbd31-d82f-4cfa-abb9-69cef50f48ea - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:30:22.918 1 WARNING oslo_config.cfg [req-3dbfbd31-d82f-4cfa-abb9-69cef50f48ea - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 03:30:22.919 1 WARNING oslo_config.cfg [req-3dbfbd31-d82f-4cfa-abb9-69cef50f48ea - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 03:30:22.921 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 03:30:22.927 1 INFO cinder.manager [req-c78e3438-3f2b-4e24-9a6a-b674e2620b98 - - - - -] Initiating service 5 cleanup
>2018-06-26 03:30:22.931 1 INFO cinder.manager [req-c78e3438-3f2b-4e24-9a6a-b674e2620b98 - - - - -] Service 5 cleanup completed.
>2018-06-26 03:32:29.350 1 ERROR oslo.messaging._drivers.impl_rabbit [req-c78e3438-3f2b-4e24-9a6a-b674e2620b98 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:32:29.352 1 ERROR oslo.messaging._drivers.impl_rabbit [req-c78e3438-3f2b-4e24-9a6a-b674e2620b98 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:32:29.352 1 ERROR oslo_service.service [req-c78e3438-3f2b-4e24-9a6a-b674e2620b98 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:32:29.352 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 03:32:29.352 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 03:32:29.352 1 ERROR oslo_service.service     service.start()
>2018-06-26 03:32:29.352 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 03:32:29.352 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 03:32:29.352 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 03:32:29.352 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 03:32:29.352 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 03:32:29.352 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 03:32:29.352 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 03:32:29.352 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 03:32:29.352 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 03:32:29.352 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 03:32:29.352 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 03:32:29.352 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 03:32:29.352 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 03:32:29.352 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 03:32:29.352 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 03:32:29.352 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 03:32:29.352 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 03:32:29.352 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 03:32:29.352 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 03:32:29.352 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 03:32:29.352 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 03:32:29.352 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 03:32:29.352 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:32:29.352 1 ERROR oslo_service.service 
>2018-06-26 03:32:29.356 1 CRITICAL cinder [req-3dbfbd31-d82f-4cfa-abb9-69cef50f48ea - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 03:32:29.356 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 03:32:29.356 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 03:32:29.356 1 ERROR cinder     sys.exit(main())
>2018-06-26 03:32:29.356 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 03:32:29.356 1 ERROR cinder     service.wait()
>2018-06-26 03:32:29.356 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 03:32:29.356 1 ERROR cinder     _launcher.wait()
>2018-06-26 03:32:29.356 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 03:32:29.356 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 03:32:29.356 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 03:32:29.356 1 ERROR cinder     self.services.wait()
>2018-06-26 03:32:29.356 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 03:32:29.356 1 ERROR cinder     service.wait()
>2018-06-26 03:32:29.356 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 03:32:29.356 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 03:32:29.356 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 03:32:29.356 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 03:32:29.356 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 03:32:29.356 1 ERROR cinder     post_fn = fn()
>2018-06-26 03:32:29.356 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 03:32:29.356 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 03:32:29.356 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 03:32:29.356 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 03:32:29.356 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 03:32:29.356 1 ERROR cinder 
>2018-06-26 03:32:32.061 1 WARNING cinder.scheduler.host_manager [req-4411ddcf-e7ed-4532-a9a0-8c8cec6d9d0c - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 03:32:32.068 1 INFO cinder.rpc [req-4411ddcf-e7ed-4532-a9a0-8c8cec6d9d0c - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 03:32:32.074 1 INFO cinder.rpc [req-4411ddcf-e7ed-4532-a9a0-8c8cec6d9d0c - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 03:32:32.089 1 INFO cinder.rpc [req-4411ddcf-e7ed-4532-a9a0-8c8cec6d9d0c - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 03:32:32.098 1 INFO cinder.rpc [req-4411ddcf-e7ed-4532-a9a0-8c8cec6d9d0c - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 03:32:32.120 1 WARNING oslo_config.cfg [req-4411ddcf-e7ed-4532-a9a0-8c8cec6d9d0c - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 03:32:32.122 1 WARNING oslo_config.cfg [req-4411ddcf-e7ed-4532-a9a0-8c8cec6d9d0c - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:32:32.123 1 WARNING oslo_config.cfg [req-4411ddcf-e7ed-4532-a9a0-8c8cec6d9d0c - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:32:32.123 1 WARNING oslo_config.cfg [req-4411ddcf-e7ed-4532-a9a0-8c8cec6d9d0c - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:32:32.128 1 WARNING oslo_config.cfg [req-4411ddcf-e7ed-4532-a9a0-8c8cec6d9d0c - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 03:32:32.129 1 WARNING oslo_config.cfg [req-4411ddcf-e7ed-4532-a9a0-8c8cec6d9d0c - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 03:32:32.132 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 03:32:32.137 1 INFO cinder.manager [req-e7610f82-7f43-4d44-b484-dd433f3ebd30 - - - - -] Initiating service 5 cleanup
>2018-06-26 03:32:32.141 1 INFO cinder.manager [req-e7610f82-7f43-4d44-b484-dd433f3ebd30 - - - - -] Service 5 cleanup completed.
>2018-06-26 03:34:43.993 1 ERROR oslo.messaging._drivers.impl_rabbit [req-e7610f82-7f43-4d44-b484-dd433f3ebd30 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:34:43.994 1 ERROR oslo.messaging._drivers.impl_rabbit [req-e7610f82-7f43-4d44-b484-dd433f3ebd30 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:34:43.995 1 ERROR oslo_service.service [req-e7610f82-7f43-4d44-b484-dd433f3ebd30 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:34:43.995 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 03:34:43.995 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 03:34:43.995 1 ERROR oslo_service.service     service.start()
>2018-06-26 03:34:43.995 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 03:34:43.995 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 03:34:43.995 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 03:34:43.995 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 03:34:43.995 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 03:34:43.995 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 03:34:43.995 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 03:34:43.995 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 03:34:43.995 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 03:34:43.995 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 03:34:43.995 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 03:34:43.995 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 03:34:43.995 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 03:34:43.995 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 03:34:43.995 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 03:34:43.995 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 03:34:43.995 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 03:34:43.995 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 03:34:43.995 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 03:34:43.995 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 03:34:43.995 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 03:34:43.995 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 03:34:43.995 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:34:43.995 1 ERROR oslo_service.service 
>2018-06-26 03:34:43.998 1 CRITICAL cinder [req-4411ddcf-e7ed-4532-a9a0-8c8cec6d9d0c - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 03:34:43.998 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 03:34:43.998 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 03:34:43.998 1 ERROR cinder     sys.exit(main())
>2018-06-26 03:34:43.998 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 03:34:43.998 1 ERROR cinder     service.wait()
>2018-06-26 03:34:43.998 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 03:34:43.998 1 ERROR cinder     _launcher.wait()
>2018-06-26 03:34:43.998 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 03:34:43.998 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 03:34:43.998 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 03:34:43.998 1 ERROR cinder     self.services.wait()
>2018-06-26 03:34:43.998 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 03:34:43.998 1 ERROR cinder     service.wait()
>2018-06-26 03:34:43.998 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 03:34:43.998 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 03:34:43.998 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 03:34:43.998 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 03:34:43.998 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 03:34:43.998 1 ERROR cinder     post_fn = fn()
>2018-06-26 03:34:43.998 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 03:34:43.998 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 03:34:43.998 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 03:34:43.998 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 03:34:43.998 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 03:34:43.998 1 ERROR cinder 
>2018-06-26 03:34:46.702 1 WARNING cinder.scheduler.host_manager [req-3c9ba6f3-da36-400d-8f95-5aefdcfed6ad - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 03:34:46.708 1 INFO cinder.rpc [req-3c9ba6f3-da36-400d-8f95-5aefdcfed6ad - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 03:34:46.713 1 INFO cinder.rpc [req-3c9ba6f3-da36-400d-8f95-5aefdcfed6ad - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 03:34:46.727 1 INFO cinder.rpc [req-3c9ba6f3-da36-400d-8f95-5aefdcfed6ad - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 03:34:46.734 1 INFO cinder.rpc [req-3c9ba6f3-da36-400d-8f95-5aefdcfed6ad - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 03:34:46.766 1 WARNING oslo_config.cfg [req-3c9ba6f3-da36-400d-8f95-5aefdcfed6ad - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 03:34:46.768 1 WARNING oslo_config.cfg [req-3c9ba6f3-da36-400d-8f95-5aefdcfed6ad - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:34:46.769 1 WARNING oslo_config.cfg [req-3c9ba6f3-da36-400d-8f95-5aefdcfed6ad - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:34:46.769 1 WARNING oslo_config.cfg [req-3c9ba6f3-da36-400d-8f95-5aefdcfed6ad - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:34:46.775 1 WARNING oslo_config.cfg [req-3c9ba6f3-da36-400d-8f95-5aefdcfed6ad - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 03:34:46.776 1 WARNING oslo_config.cfg [req-3c9ba6f3-da36-400d-8f95-5aefdcfed6ad - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 03:34:46.779 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 03:34:46.787 1 INFO cinder.manager [req-9112003f-d265-4ef4-a903-a4a651b9d8be - - - - -] Initiating service 5 cleanup
>2018-06-26 03:34:46.793 1 INFO cinder.manager [req-9112003f-d265-4ef4-a903-a4a651b9d8be - - - - -] Service 5 cleanup completed.
>2018-06-26 03:36:51.201 1 ERROR oslo.messaging._drivers.impl_rabbit [req-9112003f-d265-4ef4-a903-a4a651b9d8be - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:36:51.203 1 ERROR oslo.messaging._drivers.impl_rabbit [req-9112003f-d265-4ef4-a903-a4a651b9d8be - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:36:51.204 1 ERROR oslo_service.service [req-9112003f-d265-4ef4-a903-a4a651b9d8be - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:36:51.204 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 03:36:51.204 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 03:36:51.204 1 ERROR oslo_service.service     service.start()
>2018-06-26 03:36:51.204 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 03:36:51.204 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 03:36:51.204 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 03:36:51.204 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 03:36:51.204 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 03:36:51.204 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 03:36:51.204 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 03:36:51.204 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 03:36:51.204 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 03:36:51.204 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 03:36:51.204 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 03:36:51.204 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 03:36:51.204 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 03:36:51.204 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 03:36:51.204 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 03:36:51.204 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 03:36:51.204 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 03:36:51.204 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 03:36:51.204 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 03:36:51.204 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 03:36:51.204 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 03:36:51.204 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 03:36:51.204 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:36:51.204 1 ERROR oslo_service.service 
>2018-06-26 03:36:51.207 1 CRITICAL cinder [req-3c9ba6f3-da36-400d-8f95-5aefdcfed6ad - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 03:36:51.207 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 03:36:51.207 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 03:36:51.207 1 ERROR cinder     sys.exit(main())
>2018-06-26 03:36:51.207 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 03:36:51.207 1 ERROR cinder     service.wait()
>2018-06-26 03:36:51.207 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 03:36:51.207 1 ERROR cinder     _launcher.wait()
>2018-06-26 03:36:51.207 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 03:36:51.207 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 03:36:51.207 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 03:36:51.207 1 ERROR cinder     self.services.wait()
>2018-06-26 03:36:51.207 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 03:36:51.207 1 ERROR cinder     service.wait()
>2018-06-26 03:36:51.207 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 03:36:51.207 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 03:36:51.207 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 03:36:51.207 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 03:36:51.207 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 03:36:51.207 1 ERROR cinder     post_fn = fn()
>2018-06-26 03:36:51.207 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 03:36:51.207 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 03:36:51.207 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 03:36:51.207 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 03:36:51.207 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 03:36:51.207 1 ERROR cinder 
>2018-06-26 03:36:53.807 1 WARNING cinder.scheduler.host_manager [req-eedd9f81-951d-4509-a987-76db4eab8d86 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 03:36:53.812 1 INFO cinder.rpc [req-eedd9f81-951d-4509-a987-76db4eab8d86 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 03:36:53.817 1 INFO cinder.rpc [req-eedd9f81-951d-4509-a987-76db4eab8d86 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 03:36:53.829 1 INFO cinder.rpc [req-eedd9f81-951d-4509-a987-76db4eab8d86 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 03:36:53.837 1 INFO cinder.rpc [req-eedd9f81-951d-4509-a987-76db4eab8d86 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 03:36:53.861 1 WARNING oslo_config.cfg [req-eedd9f81-951d-4509-a987-76db4eab8d86 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 03:36:53.863 1 WARNING oslo_config.cfg [req-eedd9f81-951d-4509-a987-76db4eab8d86 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:36:53.864 1 WARNING oslo_config.cfg [req-eedd9f81-951d-4509-a987-76db4eab8d86 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:36:53.864 1 WARNING oslo_config.cfg [req-eedd9f81-951d-4509-a987-76db4eab8d86 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:36:53.869 1 WARNING oslo_config.cfg [req-eedd9f81-951d-4509-a987-76db4eab8d86 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 03:36:53.870 1 WARNING oslo_config.cfg [req-eedd9f81-951d-4509-a987-76db4eab8d86 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 03:36:53.873 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 03:36:53.885 1 INFO cinder.manager [req-7d136f1d-7ac0-407d-82da-148b028f8cb0 - - - - -] Initiating service 5 cleanup
>2018-06-26 03:36:53.889 1 INFO cinder.manager [req-7d136f1d-7ac0-407d-82da-148b028f8cb0 - - - - -] Service 5 cleanup completed.
>2018-06-26 03:38:58.369 1 ERROR oslo.messaging._drivers.impl_rabbit [req-7d136f1d-7ac0-407d-82da-148b028f8cb0 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:38:58.372 1 ERROR oslo.messaging._drivers.impl_rabbit [req-7d136f1d-7ac0-407d-82da-148b028f8cb0 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:38:58.372 1 ERROR oslo_service.service [req-7d136f1d-7ac0-407d-82da-148b028f8cb0 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:38:58.372 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 03:38:58.372 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 03:38:58.372 1 ERROR oslo_service.service     service.start()
>2018-06-26 03:38:58.372 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 03:38:58.372 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 03:38:58.372 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 03:38:58.372 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 03:38:58.372 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 03:38:58.372 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 03:38:58.372 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 03:38:58.372 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 03:38:58.372 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 03:38:58.372 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 03:38:58.372 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 03:38:58.372 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 03:38:58.372 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 03:38:58.372 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 03:38:58.372 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 03:38:58.372 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 03:38:58.372 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 03:38:58.372 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 03:38:58.372 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 03:38:58.372 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 03:38:58.372 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 03:38:58.372 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 03:38:58.372 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:38:58.372 1 ERROR oslo_service.service 
>2018-06-26 03:38:58.377 1 CRITICAL cinder [req-eedd9f81-951d-4509-a987-76db4eab8d86 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 03:38:58.377 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 03:38:58.377 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 03:38:58.377 1 ERROR cinder     sys.exit(main())
>2018-06-26 03:38:58.377 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 03:38:58.377 1 ERROR cinder     service.wait()
>2018-06-26 03:38:58.377 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 03:38:58.377 1 ERROR cinder     _launcher.wait()
>2018-06-26 03:38:58.377 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 03:38:58.377 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 03:38:58.377 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 03:38:58.377 1 ERROR cinder     self.services.wait()
>2018-06-26 03:38:58.377 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 03:38:58.377 1 ERROR cinder     service.wait()
>2018-06-26 03:38:58.377 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 03:38:58.377 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 03:38:58.377 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 03:38:58.377 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 03:38:58.377 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 03:38:58.377 1 ERROR cinder     post_fn = fn()
>2018-06-26 03:38:58.377 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 03:38:58.377 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 03:38:58.377 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 03:38:58.377 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 03:38:58.377 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 03:38:58.377 1 ERROR cinder 
>2018-06-26 03:39:01.439 1 WARNING cinder.scheduler.host_manager [req-a1e51714-220f-4249-8e58-7cd09b45de86 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 03:39:01.446 1 INFO cinder.rpc [req-a1e51714-220f-4249-8e58-7cd09b45de86 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 03:39:01.452 1 INFO cinder.rpc [req-a1e51714-220f-4249-8e58-7cd09b45de86 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 03:39:01.474 1 INFO cinder.rpc [req-a1e51714-220f-4249-8e58-7cd09b45de86 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 03:39:01.485 1 INFO cinder.rpc [req-a1e51714-220f-4249-8e58-7cd09b45de86 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 03:39:01.519 1 WARNING oslo_config.cfg [req-a1e51714-220f-4249-8e58-7cd09b45de86 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 03:39:01.522 1 WARNING oslo_config.cfg [req-a1e51714-220f-4249-8e58-7cd09b45de86 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:39:01.522 1 WARNING oslo_config.cfg [req-a1e51714-220f-4249-8e58-7cd09b45de86 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:39:01.523 1 WARNING oslo_config.cfg [req-a1e51714-220f-4249-8e58-7cd09b45de86 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:39:01.530 1 WARNING oslo_config.cfg [req-a1e51714-220f-4249-8e58-7cd09b45de86 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 03:39:01.532 1 WARNING oslo_config.cfg [req-a1e51714-220f-4249-8e58-7cd09b45de86 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 03:39:01.534 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 03:39:01.550 1 INFO cinder.manager [req-c7e2dcdb-c205-4383-9725-d7573e030161 - - - - -] Initiating service 5 cleanup
>2018-06-26 03:39:01.559 1 INFO cinder.manager [req-c7e2dcdb-c205-4383-9725-d7573e030161 - - - - -] Service 5 cleanup completed.
>2018-06-26 03:41:06.152 1 ERROR oslo.messaging._drivers.impl_rabbit [req-c7e2dcdb-c205-4383-9725-d7573e030161 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:41:06.155 1 ERROR oslo.messaging._drivers.impl_rabbit [req-c7e2dcdb-c205-4383-9725-d7573e030161 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:41:06.155 1 ERROR oslo_service.service [req-c7e2dcdb-c205-4383-9725-d7573e030161 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:41:06.155 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 03:41:06.155 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 03:41:06.155 1 ERROR oslo_service.service     service.start()
>2018-06-26 03:41:06.155 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 03:41:06.155 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 03:41:06.155 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 03:41:06.155 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 03:41:06.155 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 03:41:06.155 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 03:41:06.155 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 03:41:06.155 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 03:41:06.155 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 03:41:06.155 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 03:41:06.155 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 03:41:06.155 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 03:41:06.155 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 03:41:06.155 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 03:41:06.155 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 03:41:06.155 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 03:41:06.155 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 03:41:06.155 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 03:41:06.155 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 03:41:06.155 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 03:41:06.155 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 03:41:06.155 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 03:41:06.155 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:41:06.155 1 ERROR oslo_service.service 
>2018-06-26 03:41:06.158 1 CRITICAL cinder [req-a1e51714-220f-4249-8e58-7cd09b45de86 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 03:41:06.158 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 03:41:06.158 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 03:41:06.158 1 ERROR cinder     sys.exit(main())
>2018-06-26 03:41:06.158 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 03:41:06.158 1 ERROR cinder     service.wait()
>2018-06-26 03:41:06.158 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 03:41:06.158 1 ERROR cinder     _launcher.wait()
>2018-06-26 03:41:06.158 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 03:41:06.158 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 03:41:06.158 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 03:41:06.158 1 ERROR cinder     self.services.wait()
>2018-06-26 03:41:06.158 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 03:41:06.158 1 ERROR cinder     service.wait()
>2018-06-26 03:41:06.158 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 03:41:06.158 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 03:41:06.158 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 03:41:06.158 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 03:41:06.158 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 03:41:06.158 1 ERROR cinder     post_fn = fn()
>2018-06-26 03:41:06.158 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 03:41:06.158 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 03:41:06.158 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 03:41:06.158 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 03:41:06.158 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 03:41:06.158 1 ERROR cinder 
>2018-06-26 03:41:08.964 1 WARNING cinder.scheduler.host_manager [req-5241efeb-2c2c-493e-9941-6d0f27ed4de4 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 03:41:08.972 1 INFO cinder.rpc [req-5241efeb-2c2c-493e-9941-6d0f27ed4de4 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 03:41:08.978 1 INFO cinder.rpc [req-5241efeb-2c2c-493e-9941-6d0f27ed4de4 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 03:41:08.989 1 INFO cinder.rpc [req-5241efeb-2c2c-493e-9941-6d0f27ed4de4 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 03:41:08.997 1 INFO cinder.rpc [req-5241efeb-2c2c-493e-9941-6d0f27ed4de4 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 03:41:09.020 1 WARNING oslo_config.cfg [req-5241efeb-2c2c-493e-9941-6d0f27ed4de4 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 03:41:09.022 1 WARNING oslo_config.cfg [req-5241efeb-2c2c-493e-9941-6d0f27ed4de4 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:41:09.023 1 WARNING oslo_config.cfg [req-5241efeb-2c2c-493e-9941-6d0f27ed4de4 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:41:09.023 1 WARNING oslo_config.cfg [req-5241efeb-2c2c-493e-9941-6d0f27ed4de4 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:41:09.028 1 WARNING oslo_config.cfg [req-5241efeb-2c2c-493e-9941-6d0f27ed4de4 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 03:41:09.030 1 WARNING oslo_config.cfg [req-5241efeb-2c2c-493e-9941-6d0f27ed4de4 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 03:41:09.032 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 03:41:09.038 1 INFO cinder.manager [req-73a8abb8-9ab8-4bee-88fc-76030b56a20b - - - - -] Initiating service 5 cleanup
>2018-06-26 03:41:09.043 1 INFO cinder.manager [req-73a8abb8-9ab8-4bee-88fc-76030b56a20b - - - - -] Service 5 cleanup completed.
>2018-06-26 03:43:21.179 1 ERROR oslo.messaging._drivers.impl_rabbit [req-73a8abb8-9ab8-4bee-88fc-76030b56a20b - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:43:21.182 1 ERROR oslo.messaging._drivers.impl_rabbit [req-73a8abb8-9ab8-4bee-88fc-76030b56a20b - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:43:21.182 1 ERROR oslo_service.service [req-73a8abb8-9ab8-4bee-88fc-76030b56a20b - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:43:21.182 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 03:43:21.182 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 03:43:21.182 1 ERROR oslo_service.service     service.start()
>2018-06-26 03:43:21.182 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 03:43:21.182 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 03:43:21.182 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 03:43:21.182 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 03:43:21.182 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 03:43:21.182 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 03:43:21.182 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 03:43:21.182 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 03:43:21.182 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 03:43:21.182 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 03:43:21.182 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 03:43:21.182 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 03:43:21.182 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 03:43:21.182 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 03:43:21.182 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 03:43:21.182 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 03:43:21.182 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 03:43:21.182 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 03:43:21.182 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 03:43:21.182 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 03:43:21.182 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 03:43:21.182 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 03:43:21.182 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:43:21.182 1 ERROR oslo_service.service 
>2018-06-26 03:43:21.187 1 CRITICAL cinder [req-5241efeb-2c2c-493e-9941-6d0f27ed4de4 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 03:43:21.187 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 03:43:21.187 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 03:43:21.187 1 ERROR cinder     sys.exit(main())
>2018-06-26 03:43:21.187 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 03:43:21.187 1 ERROR cinder     service.wait()
>2018-06-26 03:43:21.187 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 03:43:21.187 1 ERROR cinder     _launcher.wait()
>2018-06-26 03:43:21.187 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 03:43:21.187 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 03:43:21.187 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 03:43:21.187 1 ERROR cinder     self.services.wait()
>2018-06-26 03:43:21.187 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 03:43:21.187 1 ERROR cinder     service.wait()
>2018-06-26 03:43:21.187 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 03:43:21.187 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 03:43:21.187 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 03:43:21.187 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 03:43:21.187 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 03:43:21.187 1 ERROR cinder     post_fn = fn()
>2018-06-26 03:43:21.187 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 03:43:21.187 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 03:43:21.187 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 03:43:21.187 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 03:43:21.187 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 03:43:21.187 1 ERROR cinder 
>2018-06-26 03:43:23.867 1 WARNING cinder.scheduler.host_manager [req-156b1e73-e99e-4588-9a0f-cd2b626156e3 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 03:43:23.873 1 INFO cinder.rpc [req-156b1e73-e99e-4588-9a0f-cd2b626156e3 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 03:43:23.878 1 INFO cinder.rpc [req-156b1e73-e99e-4588-9a0f-cd2b626156e3 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 03:43:23.889 1 INFO cinder.rpc [req-156b1e73-e99e-4588-9a0f-cd2b626156e3 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 03:43:23.896 1 INFO cinder.rpc [req-156b1e73-e99e-4588-9a0f-cd2b626156e3 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 03:43:23.921 1 WARNING oslo_config.cfg [req-156b1e73-e99e-4588-9a0f-cd2b626156e3 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 03:43:23.923 1 WARNING oslo_config.cfg [req-156b1e73-e99e-4588-9a0f-cd2b626156e3 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:43:23.923 1 WARNING oslo_config.cfg [req-156b1e73-e99e-4588-9a0f-cd2b626156e3 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:43:23.924 1 WARNING oslo_config.cfg [req-156b1e73-e99e-4588-9a0f-cd2b626156e3 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:43:23.929 1 WARNING oslo_config.cfg [req-156b1e73-e99e-4588-9a0f-cd2b626156e3 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 03:43:23.931 1 WARNING oslo_config.cfg [req-156b1e73-e99e-4588-9a0f-cd2b626156e3 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 03:43:23.933 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 03:43:23.941 1 INFO cinder.manager [req-4533ba20-565c-4dcd-ae7a-76cd72ccaade - - - - -] Initiating service 5 cleanup
>2018-06-26 03:43:23.946 1 INFO cinder.manager [req-4533ba20-565c-4dcd-ae7a-76cd72ccaade - - - - -] Service 5 cleanup completed.
>2018-06-26 03:45:30.183 1 ERROR oslo.messaging._drivers.impl_rabbit [req-4533ba20-565c-4dcd-ae7a-76cd72ccaade - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:45:30.184 1 ERROR oslo.messaging._drivers.impl_rabbit [req-4533ba20-565c-4dcd-ae7a-76cd72ccaade - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:45:30.185 1 ERROR oslo_service.service [req-4533ba20-565c-4dcd-ae7a-76cd72ccaade - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:45:30.185 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 03:45:30.185 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 03:45:30.185 1 ERROR oslo_service.service     service.start()
>2018-06-26 03:45:30.185 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 03:45:30.185 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 03:45:30.185 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 03:45:30.185 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 03:45:30.185 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 03:45:30.185 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 03:45:30.185 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 03:45:30.185 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 03:45:30.185 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 03:45:30.185 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 03:45:30.185 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 03:45:30.185 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 03:45:30.185 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 03:45:30.185 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 03:45:30.185 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 03:45:30.185 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 03:45:30.185 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 03:45:30.185 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 03:45:30.185 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 03:45:30.185 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 03:45:30.185 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 03:45:30.185 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 03:45:30.185 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:45:30.185 1 ERROR oslo_service.service 
>2018-06-26 03:45:30.187 1 CRITICAL cinder [req-156b1e73-e99e-4588-9a0f-cd2b626156e3 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 03:45:30.187 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 03:45:30.187 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 03:45:30.187 1 ERROR cinder     sys.exit(main())
>2018-06-26 03:45:30.187 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 03:45:30.187 1 ERROR cinder     service.wait()
>2018-06-26 03:45:30.187 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 03:45:30.187 1 ERROR cinder     _launcher.wait()
>2018-06-26 03:45:30.187 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 03:45:30.187 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 03:45:30.187 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 03:45:30.187 1 ERROR cinder     self.services.wait()
>2018-06-26 03:45:30.187 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 03:45:30.187 1 ERROR cinder     service.wait()
>2018-06-26 03:45:30.187 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 03:45:30.187 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 03:45:30.187 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 03:45:30.187 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 03:45:30.187 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 03:45:30.187 1 ERROR cinder     post_fn = fn()
>2018-06-26 03:45:30.187 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 03:45:30.187 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 03:45:30.187 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 03:45:30.187 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 03:45:30.187 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 03:45:30.187 1 ERROR cinder 
>2018-06-26 03:45:32.819 1 WARNING cinder.scheduler.host_manager [req-e765111f-e609-4c94-b778-53cfe9d99ebe - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 03:45:32.826 1 INFO cinder.rpc [req-e765111f-e609-4c94-b778-53cfe9d99ebe - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 03:45:32.830 1 INFO cinder.rpc [req-e765111f-e609-4c94-b778-53cfe9d99ebe - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 03:45:32.842 1 INFO cinder.rpc [req-e765111f-e609-4c94-b778-53cfe9d99ebe - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 03:45:32.847 1 INFO cinder.rpc [req-e765111f-e609-4c94-b778-53cfe9d99ebe - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 03:45:32.872 1 WARNING oslo_config.cfg [req-e765111f-e609-4c94-b778-53cfe9d99ebe - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 03:45:32.876 1 WARNING oslo_config.cfg [req-e765111f-e609-4c94-b778-53cfe9d99ebe - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:45:32.876 1 WARNING oslo_config.cfg [req-e765111f-e609-4c94-b778-53cfe9d99ebe - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:45:32.877 1 WARNING oslo_config.cfg [req-e765111f-e609-4c94-b778-53cfe9d99ebe - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:45:32.885 1 WARNING oslo_config.cfg [req-e765111f-e609-4c94-b778-53cfe9d99ebe - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 03:45:32.886 1 WARNING oslo_config.cfg [req-e765111f-e609-4c94-b778-53cfe9d99ebe - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 03:45:32.888 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 03:45:32.895 1 INFO cinder.manager [req-7ed6d8b4-81a0-4b19-a62e-6b0e2ae7aabf - - - - -] Initiating service 5 cleanup
>2018-06-26 03:45:32.899 1 INFO cinder.manager [req-7ed6d8b4-81a0-4b19-a62e-6b0e2ae7aabf - - - - -] Service 5 cleanup completed.
>2018-06-26 03:47:44.676 1 ERROR oslo.messaging._drivers.impl_rabbit [req-7ed6d8b4-81a0-4b19-a62e-6b0e2ae7aabf - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:47:44.678 1 ERROR oslo.messaging._drivers.impl_rabbit [req-7ed6d8b4-81a0-4b19-a62e-6b0e2ae7aabf - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:47:44.678 1 ERROR oslo_service.service [req-7ed6d8b4-81a0-4b19-a62e-6b0e2ae7aabf - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:47:44.678 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 03:47:44.678 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 03:47:44.678 1 ERROR oslo_service.service     service.start()
>2018-06-26 03:47:44.678 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 03:47:44.678 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 03:47:44.678 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 03:47:44.678 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 03:47:44.678 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 03:47:44.678 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 03:47:44.678 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 03:47:44.678 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 03:47:44.678 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 03:47:44.678 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 03:47:44.678 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 03:47:44.678 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 03:47:44.678 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 03:47:44.678 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 03:47:44.678 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 03:47:44.678 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 03:47:44.678 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 03:47:44.678 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 03:47:44.678 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 03:47:44.678 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 03:47:44.678 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 03:47:44.678 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 03:47:44.678 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:47:44.678 1 ERROR oslo_service.service 
>2018-06-26 03:47:44.681 1 CRITICAL cinder [req-e765111f-e609-4c94-b778-53cfe9d99ebe - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 03:47:44.681 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 03:47:44.681 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 03:47:44.681 1 ERROR cinder     sys.exit(main())
>2018-06-26 03:47:44.681 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 03:47:44.681 1 ERROR cinder     service.wait()
>2018-06-26 03:47:44.681 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 03:47:44.681 1 ERROR cinder     _launcher.wait()
>2018-06-26 03:47:44.681 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 03:47:44.681 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 03:47:44.681 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 03:47:44.681 1 ERROR cinder     self.services.wait()
>2018-06-26 03:47:44.681 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 03:47:44.681 1 ERROR cinder     service.wait()
>2018-06-26 03:47:44.681 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 03:47:44.681 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 03:47:44.681 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 03:47:44.681 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 03:47:44.681 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 03:47:44.681 1 ERROR cinder     post_fn = fn()
>2018-06-26 03:47:44.681 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 03:47:44.681 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 03:47:44.681 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 03:47:44.681 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 03:47:44.681 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 03:47:44.681 1 ERROR cinder 
>2018-06-26 03:47:47.431 1 WARNING cinder.scheduler.host_manager [req-03a16595-cf56-46db-a21d-565ce05aaf85 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 03:47:47.439 1 INFO cinder.rpc [req-03a16595-cf56-46db-a21d-565ce05aaf85 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 03:47:47.447 1 INFO cinder.rpc [req-03a16595-cf56-46db-a21d-565ce05aaf85 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 03:47:47.459 1 INFO cinder.rpc [req-03a16595-cf56-46db-a21d-565ce05aaf85 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 03:47:47.465 1 INFO cinder.rpc [req-03a16595-cf56-46db-a21d-565ce05aaf85 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 03:47:47.493 1 WARNING oslo_config.cfg [req-03a16595-cf56-46db-a21d-565ce05aaf85 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 03:47:47.496 1 WARNING oslo_config.cfg [req-03a16595-cf56-46db-a21d-565ce05aaf85 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:47:47.496 1 WARNING oslo_config.cfg [req-03a16595-cf56-46db-a21d-565ce05aaf85 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:47:47.497 1 WARNING oslo_config.cfg [req-03a16595-cf56-46db-a21d-565ce05aaf85 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:47:47.502 1 WARNING oslo_config.cfg [req-03a16595-cf56-46db-a21d-565ce05aaf85 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 03:47:47.503 1 WARNING oslo_config.cfg [req-03a16595-cf56-46db-a21d-565ce05aaf85 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 03:47:47.505 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 03:47:47.513 1 INFO cinder.manager [req-f9c64cc9-3fb8-4751-8e54-6a2ba8fd8562 - - - - -] Initiating service 5 cleanup
>2018-06-26 03:47:47.517 1 INFO cinder.manager [req-f9c64cc9-3fb8-4751-8e54-6a2ba8fd8562 - - - - -] Service 5 cleanup completed.
>2018-06-26 03:49:51.898 1 ERROR oslo.messaging._drivers.impl_rabbit [req-f9c64cc9-3fb8-4751-8e54-6a2ba8fd8562 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:49:51.900 1 ERROR oslo.messaging._drivers.impl_rabbit [req-f9c64cc9-3fb8-4751-8e54-6a2ba8fd8562 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:49:51.900 1 ERROR oslo_service.service [req-f9c64cc9-3fb8-4751-8e54-6a2ba8fd8562 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:49:51.900 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 03:49:51.900 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 03:49:51.900 1 ERROR oslo_service.service     service.start()
>2018-06-26 03:49:51.900 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 03:49:51.900 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 03:49:51.900 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 03:49:51.900 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 03:49:51.900 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 03:49:51.900 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 03:49:51.900 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 03:49:51.900 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 03:49:51.900 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 03:49:51.900 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 03:49:51.900 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 03:49:51.900 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 03:49:51.900 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 03:49:51.900 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 03:49:51.900 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 03:49:51.900 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 03:49:51.900 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 03:49:51.900 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 03:49:51.900 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 03:49:51.900 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 03:49:51.900 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 03:49:51.900 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 03:49:51.900 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:49:51.900 1 ERROR oslo_service.service 
>2018-06-26 03:49:51.903 1 CRITICAL cinder [req-03a16595-cf56-46db-a21d-565ce05aaf85 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 03:49:51.903 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 03:49:51.903 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 03:49:51.903 1 ERROR cinder     sys.exit(main())
>2018-06-26 03:49:51.903 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 03:49:51.903 1 ERROR cinder     service.wait()
>2018-06-26 03:49:51.903 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 03:49:51.903 1 ERROR cinder     _launcher.wait()
>2018-06-26 03:49:51.903 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 03:49:51.903 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 03:49:51.903 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 03:49:51.903 1 ERROR cinder     self.services.wait()
>2018-06-26 03:49:51.903 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 03:49:51.903 1 ERROR cinder     service.wait()
>2018-06-26 03:49:51.903 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 03:49:51.903 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 03:49:51.903 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 03:49:51.903 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 03:49:51.903 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 03:49:51.903 1 ERROR cinder     post_fn = fn()
>2018-06-26 03:49:51.903 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 03:49:51.903 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 03:49:51.903 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 03:49:51.903 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 03:49:51.903 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 03:49:51.903 1 ERROR cinder 
>2018-06-26 03:49:54.460 1 WARNING cinder.scheduler.host_manager [req-cff0bfc5-f17c-410e-8de0-4ad976a93ae0 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 03:49:54.468 1 INFO cinder.rpc [req-cff0bfc5-f17c-410e-8de0-4ad976a93ae0 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 03:49:54.476 1 INFO cinder.rpc [req-cff0bfc5-f17c-410e-8de0-4ad976a93ae0 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 03:49:54.490 1 INFO cinder.rpc [req-cff0bfc5-f17c-410e-8de0-4ad976a93ae0 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 03:49:54.499 1 INFO cinder.rpc [req-cff0bfc5-f17c-410e-8de0-4ad976a93ae0 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 03:49:54.525 1 WARNING oslo_config.cfg [req-cff0bfc5-f17c-410e-8de0-4ad976a93ae0 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 03:49:54.527 1 WARNING oslo_config.cfg [req-cff0bfc5-f17c-410e-8de0-4ad976a93ae0 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:49:54.528 1 WARNING oslo_config.cfg [req-cff0bfc5-f17c-410e-8de0-4ad976a93ae0 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:49:54.528 1 WARNING oslo_config.cfg [req-cff0bfc5-f17c-410e-8de0-4ad976a93ae0 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:49:54.534 1 WARNING oslo_config.cfg [req-cff0bfc5-f17c-410e-8de0-4ad976a93ae0 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 03:49:54.535 1 WARNING oslo_config.cfg [req-cff0bfc5-f17c-410e-8de0-4ad976a93ae0 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 03:49:54.538 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 03:49:54.546 1 INFO cinder.manager [req-51d4a0ab-9039-4a02-86f0-03f42500106e - - - - -] Initiating service 5 cleanup
>2018-06-26 03:49:54.552 1 INFO cinder.manager [req-51d4a0ab-9039-4a02-86f0-03f42500106e - - - - -] Service 5 cleanup completed.
>2018-06-26 03:52:07.658 1 ERROR oslo.messaging._drivers.impl_rabbit [req-51d4a0ab-9039-4a02-86f0-03f42500106e - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:52:07.660 1 ERROR oslo.messaging._drivers.impl_rabbit [req-51d4a0ab-9039-4a02-86f0-03f42500106e - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:52:07.660 1 ERROR oslo_service.service [req-51d4a0ab-9039-4a02-86f0-03f42500106e - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:52:07.660 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 03:52:07.660 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 03:52:07.660 1 ERROR oslo_service.service     service.start()
>2018-06-26 03:52:07.660 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 03:52:07.660 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 03:52:07.660 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 03:52:07.660 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 03:52:07.660 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 03:52:07.660 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 03:52:07.660 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 03:52:07.660 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 03:52:07.660 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 03:52:07.660 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 03:52:07.660 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 03:52:07.660 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 03:52:07.660 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 03:52:07.660 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 03:52:07.660 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 03:52:07.660 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 03:52:07.660 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 03:52:07.660 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 03:52:07.660 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 03:52:07.660 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 03:52:07.660 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 03:52:07.660 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 03:52:07.660 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:52:07.660 1 ERROR oslo_service.service 
>2018-06-26 03:52:07.663 1 CRITICAL cinder [req-cff0bfc5-f17c-410e-8de0-4ad976a93ae0 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 03:52:07.663 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 03:52:07.663 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 03:52:07.663 1 ERROR cinder     sys.exit(main())
>2018-06-26 03:52:07.663 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 03:52:07.663 1 ERROR cinder     service.wait()
>2018-06-26 03:52:07.663 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 03:52:07.663 1 ERROR cinder     _launcher.wait()
>2018-06-26 03:52:07.663 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 03:52:07.663 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 03:52:07.663 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 03:52:07.663 1 ERROR cinder     self.services.wait()
>2018-06-26 03:52:07.663 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 03:52:07.663 1 ERROR cinder     service.wait()
>2018-06-26 03:52:07.663 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 03:52:07.663 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 03:52:07.663 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 03:52:07.663 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 03:52:07.663 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 03:52:07.663 1 ERROR cinder     post_fn = fn()
>2018-06-26 03:52:07.663 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 03:52:07.663 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 03:52:07.663 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 03:52:07.663 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 03:52:07.663 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 03:52:07.663 1 ERROR cinder 
>2018-06-26 03:52:10.267 1 WARNING cinder.scheduler.host_manager [req-a2741faa-1bdf-4c45-a251-e438cb620d85 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 03:52:10.273 1 INFO cinder.rpc [req-a2741faa-1bdf-4c45-a251-e438cb620d85 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 03:52:10.278 1 INFO cinder.rpc [req-a2741faa-1bdf-4c45-a251-e438cb620d85 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 03:52:10.288 1 INFO cinder.rpc [req-a2741faa-1bdf-4c45-a251-e438cb620d85 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 03:52:10.293 1 INFO cinder.rpc [req-a2741faa-1bdf-4c45-a251-e438cb620d85 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 03:52:10.318 1 WARNING oslo_config.cfg [req-a2741faa-1bdf-4c45-a251-e438cb620d85 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 03:52:10.320 1 WARNING oslo_config.cfg [req-a2741faa-1bdf-4c45-a251-e438cb620d85 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:52:10.321 1 WARNING oslo_config.cfg [req-a2741faa-1bdf-4c45-a251-e438cb620d85 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:52:10.321 1 WARNING oslo_config.cfg [req-a2741faa-1bdf-4c45-a251-e438cb620d85 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:52:10.327 1 WARNING oslo_config.cfg [req-a2741faa-1bdf-4c45-a251-e438cb620d85 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 03:52:10.328 1 WARNING oslo_config.cfg [req-a2741faa-1bdf-4c45-a251-e438cb620d85 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 03:52:10.330 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 03:52:10.336 1 INFO cinder.manager [req-2c56e709-c526-4b88-839d-cc98da04de47 - - - - -] Initiating service 5 cleanup
>2018-06-26 03:52:10.340 1 INFO cinder.manager [req-2c56e709-c526-4b88-839d-cc98da04de47 - - - - -] Service 5 cleanup completed.
>2018-06-26 03:54:16.679 1 ERROR oslo.messaging._drivers.impl_rabbit [req-2c56e709-c526-4b88-839d-cc98da04de47 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:54:16.681 1 ERROR oslo.messaging._drivers.impl_rabbit [req-2c56e709-c526-4b88-839d-cc98da04de47 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:54:16.682 1 ERROR oslo_service.service [req-2c56e709-c526-4b88-839d-cc98da04de47 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:54:16.682 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 03:54:16.682 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 03:54:16.682 1 ERROR oslo_service.service     service.start()
>2018-06-26 03:54:16.682 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 03:54:16.682 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 03:54:16.682 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 03:54:16.682 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 03:54:16.682 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 03:54:16.682 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 03:54:16.682 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 03:54:16.682 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 03:54:16.682 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 03:54:16.682 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 03:54:16.682 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 03:54:16.682 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 03:54:16.682 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 03:54:16.682 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 03:54:16.682 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 03:54:16.682 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 03:54:16.682 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 03:54:16.682 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 03:54:16.682 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 03:54:16.682 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 03:54:16.682 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 03:54:16.682 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 03:54:16.682 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:54:16.682 1 ERROR oslo_service.service 
>2018-06-26 03:54:16.684 1 CRITICAL cinder [req-a2741faa-1bdf-4c45-a251-e438cb620d85 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 03:54:16.684 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 03:54:16.684 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 03:54:16.684 1 ERROR cinder     sys.exit(main())
>2018-06-26 03:54:16.684 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 03:54:16.684 1 ERROR cinder     service.wait()
>2018-06-26 03:54:16.684 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 03:54:16.684 1 ERROR cinder     _launcher.wait()
>2018-06-26 03:54:16.684 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 03:54:16.684 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 03:54:16.684 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 03:54:16.684 1 ERROR cinder     self.services.wait()
>2018-06-26 03:54:16.684 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 03:54:16.684 1 ERROR cinder     service.wait()
>2018-06-26 03:54:16.684 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 03:54:16.684 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 03:54:16.684 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 03:54:16.684 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 03:54:16.684 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 03:54:16.684 1 ERROR cinder     post_fn = fn()
>2018-06-26 03:54:16.684 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 03:54:16.684 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 03:54:16.684 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 03:54:16.684 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 03:54:16.684 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 03:54:16.684 1 ERROR cinder 
>2018-06-26 03:54:19.384 1 WARNING cinder.scheduler.host_manager [req-fa549ec4-7424-4388-8b98-8b48362f8e80 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 03:54:19.394 1 INFO cinder.rpc [req-fa549ec4-7424-4388-8b98-8b48362f8e80 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 03:54:19.402 1 INFO cinder.rpc [req-fa549ec4-7424-4388-8b98-8b48362f8e80 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 03:54:19.428 1 INFO cinder.rpc [req-fa549ec4-7424-4388-8b98-8b48362f8e80 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 03:54:19.435 1 INFO cinder.rpc [req-fa549ec4-7424-4388-8b98-8b48362f8e80 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 03:54:19.470 1 WARNING oslo_config.cfg [req-fa549ec4-7424-4388-8b98-8b48362f8e80 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 03:54:19.472 1 WARNING oslo_config.cfg [req-fa549ec4-7424-4388-8b98-8b48362f8e80 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:54:19.473 1 WARNING oslo_config.cfg [req-fa549ec4-7424-4388-8b98-8b48362f8e80 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:54:19.474 1 WARNING oslo_config.cfg [req-fa549ec4-7424-4388-8b98-8b48362f8e80 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:54:19.479 1 WARNING oslo_config.cfg [req-fa549ec4-7424-4388-8b98-8b48362f8e80 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 03:54:19.480 1 WARNING oslo_config.cfg [req-fa549ec4-7424-4388-8b98-8b48362f8e80 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 03:54:19.483 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 03:54:19.491 1 INFO cinder.manager [req-29f2c690-576e-441c-b8a7-9520489d44fa - - - - -] Initiating service 5 cleanup
>2018-06-26 03:54:19.497 1 INFO cinder.manager [req-29f2c690-576e-441c-b8a7-9520489d44fa - - - - -] Service 5 cleanup completed.
>2018-06-26 03:56:23.857 1 ERROR oslo.messaging._drivers.impl_rabbit [req-29f2c690-576e-441c-b8a7-9520489d44fa - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:56:23.859 1 ERROR oslo.messaging._drivers.impl_rabbit [req-29f2c690-576e-441c-b8a7-9520489d44fa - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:56:23.859 1 ERROR oslo_service.service [req-29f2c690-576e-441c-b8a7-9520489d44fa - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:56:23.859 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 03:56:23.859 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 03:56:23.859 1 ERROR oslo_service.service     service.start()
>2018-06-26 03:56:23.859 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 03:56:23.859 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 03:56:23.859 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 03:56:23.859 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 03:56:23.859 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 03:56:23.859 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 03:56:23.859 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 03:56:23.859 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 03:56:23.859 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 03:56:23.859 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 03:56:23.859 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 03:56:23.859 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 03:56:23.859 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 03:56:23.859 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 03:56:23.859 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 03:56:23.859 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 03:56:23.859 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 03:56:23.859 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 03:56:23.859 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 03:56:23.859 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 03:56:23.859 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 03:56:23.859 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 03:56:23.859 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:56:23.859 1 ERROR oslo_service.service 
>2018-06-26 03:56:23.862 1 CRITICAL cinder [req-fa549ec4-7424-4388-8b98-8b48362f8e80 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 03:56:23.862 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 03:56:23.862 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 03:56:23.862 1 ERROR cinder     sys.exit(main())
>2018-06-26 03:56:23.862 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 03:56:23.862 1 ERROR cinder     service.wait()
>2018-06-26 03:56:23.862 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 03:56:23.862 1 ERROR cinder     _launcher.wait()
>2018-06-26 03:56:23.862 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 03:56:23.862 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 03:56:23.862 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 03:56:23.862 1 ERROR cinder     self.services.wait()
>2018-06-26 03:56:23.862 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 03:56:23.862 1 ERROR cinder     service.wait()
>2018-06-26 03:56:23.862 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 03:56:23.862 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 03:56:23.862 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 03:56:23.862 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 03:56:23.862 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 03:56:23.862 1 ERROR cinder     post_fn = fn()
>2018-06-26 03:56:23.862 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 03:56:23.862 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 03:56:23.862 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 03:56:23.862 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 03:56:23.862 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 03:56:23.862 1 ERROR cinder 
>2018-06-26 03:56:26.497 1 WARNING cinder.scheduler.host_manager [req-16a047e9-a92e-4f3e-bebe-4cb444850aee - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 03:56:26.512 1 INFO cinder.rpc [req-16a047e9-a92e-4f3e-bebe-4cb444850aee - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 03:56:26.519 1 INFO cinder.rpc [req-16a047e9-a92e-4f3e-bebe-4cb444850aee - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 03:56:26.535 1 INFO cinder.rpc [req-16a047e9-a92e-4f3e-bebe-4cb444850aee - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 03:56:26.543 1 INFO cinder.rpc [req-16a047e9-a92e-4f3e-bebe-4cb444850aee - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 03:56:26.572 1 WARNING oslo_config.cfg [req-16a047e9-a92e-4f3e-bebe-4cb444850aee - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 03:56:26.575 1 WARNING oslo_config.cfg [req-16a047e9-a92e-4f3e-bebe-4cb444850aee - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:56:26.575 1 WARNING oslo_config.cfg [req-16a047e9-a92e-4f3e-bebe-4cb444850aee - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:56:26.576 1 WARNING oslo_config.cfg [req-16a047e9-a92e-4f3e-bebe-4cb444850aee - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:56:26.581 1 WARNING oslo_config.cfg [req-16a047e9-a92e-4f3e-bebe-4cb444850aee - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 03:56:26.583 1 WARNING oslo_config.cfg [req-16a047e9-a92e-4f3e-bebe-4cb444850aee - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 03:56:26.586 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 03:56:26.594 1 INFO cinder.manager [req-411c44f0-361f-489a-ab79-2c0c68707fd7 - - - - -] Initiating service 5 cleanup
>2018-06-26 03:56:26.601 1 INFO cinder.manager [req-411c44f0-361f-489a-ab79-2c0c68707fd7 - - - - -] Service 5 cleanup completed.
>2018-06-26 03:58:32.455 1 ERROR oslo.messaging._drivers.impl_rabbit [req-411c44f0-361f-489a-ab79-2c0c68707fd7 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:58:32.456 1 ERROR oslo.messaging._drivers.impl_rabbit [req-411c44f0-361f-489a-ab79-2c0c68707fd7 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:58:32.457 1 ERROR oslo_service.service [req-411c44f0-361f-489a-ab79-2c0c68707fd7 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:58:32.457 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 03:58:32.457 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 03:58:32.457 1 ERROR oslo_service.service     service.start()
>2018-06-26 03:58:32.457 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 03:58:32.457 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 03:58:32.457 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 03:58:32.457 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 03:58:32.457 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 03:58:32.457 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 03:58:32.457 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 03:58:32.457 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 03:58:32.457 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 03:58:32.457 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 03:58:32.457 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 03:58:32.457 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 03:58:32.457 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 03:58:32.457 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 03:58:32.457 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 03:58:32.457 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 03:58:32.457 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 03:58:32.457 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 03:58:32.457 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 03:58:32.457 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 03:58:32.457 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 03:58:32.457 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 03:58:32.457 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 03:58:32.457 1 ERROR oslo_service.service 
>2018-06-26 03:58:32.459 1 CRITICAL cinder [req-16a047e9-a92e-4f3e-bebe-4cb444850aee - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 03:58:32.459 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 03:58:32.459 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 03:58:32.459 1 ERROR cinder     sys.exit(main())
>2018-06-26 03:58:32.459 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 03:58:32.459 1 ERROR cinder     service.wait()
>2018-06-26 03:58:32.459 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 03:58:32.459 1 ERROR cinder     _launcher.wait()
>2018-06-26 03:58:32.459 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 03:58:32.459 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 03:58:32.459 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 03:58:32.459 1 ERROR cinder     self.services.wait()
>2018-06-26 03:58:32.459 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 03:58:32.459 1 ERROR cinder     service.wait()
>2018-06-26 03:58:32.459 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 03:58:32.459 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 03:58:32.459 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 03:58:32.459 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 03:58:32.459 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 03:58:32.459 1 ERROR cinder     post_fn = fn()
>2018-06-26 03:58:32.459 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 03:58:32.459 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 03:58:32.459 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 03:58:32.459 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 03:58:32.459 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 03:58:32.459 1 ERROR cinder 
>2018-06-26 03:58:34.963 1 WARNING cinder.scheduler.host_manager [req-6a78f251-ea8b-4118-bb0b-61901ad5fb2b - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 03:58:34.969 1 INFO cinder.rpc [req-6a78f251-ea8b-4118-bb0b-61901ad5fb2b - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 03:58:34.974 1 INFO cinder.rpc [req-6a78f251-ea8b-4118-bb0b-61901ad5fb2b - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 03:58:34.996 1 INFO cinder.rpc [req-6a78f251-ea8b-4118-bb0b-61901ad5fb2b - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 03:58:35.002 1 INFO cinder.rpc [req-6a78f251-ea8b-4118-bb0b-61901ad5fb2b - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 03:58:35.026 1 WARNING oslo_config.cfg [req-6a78f251-ea8b-4118-bb0b-61901ad5fb2b - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 03:58:35.028 1 WARNING oslo_config.cfg [req-6a78f251-ea8b-4118-bb0b-61901ad5fb2b - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:58:35.028 1 WARNING oslo_config.cfg [req-6a78f251-ea8b-4118-bb0b-61901ad5fb2b - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:58:35.029 1 WARNING oslo_config.cfg [req-6a78f251-ea8b-4118-bb0b-61901ad5fb2b - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 03:58:35.034 1 WARNING oslo_config.cfg [req-6a78f251-ea8b-4118-bb0b-61901ad5fb2b - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 03:58:35.035 1 WARNING oslo_config.cfg [req-6a78f251-ea8b-4118-bb0b-61901ad5fb2b - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 03:58:35.037 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 03:58:35.043 1 INFO cinder.manager [req-e31176ea-406c-4dfc-81d4-3f2a637cf4eb - - - - -] Initiating service 5 cleanup
>2018-06-26 03:58:35.048 1 INFO cinder.manager [req-e31176ea-406c-4dfc-81d4-3f2a637cf4eb - - - - -] Service 5 cleanup completed.
>2018-06-26 04:00:47.873 1 ERROR oslo.messaging._drivers.impl_rabbit [req-e31176ea-406c-4dfc-81d4-3f2a637cf4eb - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:00:47.875 1 ERROR oslo.messaging._drivers.impl_rabbit [req-e31176ea-406c-4dfc-81d4-3f2a637cf4eb - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:00:47.875 1 ERROR oslo_service.service [req-e31176ea-406c-4dfc-81d4-3f2a637cf4eb - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:00:47.875 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 04:00:47.875 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 04:00:47.875 1 ERROR oslo_service.service     service.start()
>2018-06-26 04:00:47.875 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 04:00:47.875 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 04:00:47.875 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 04:00:47.875 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 04:00:47.875 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 04:00:47.875 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 04:00:47.875 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 04:00:47.875 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 04:00:47.875 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 04:00:47.875 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 04:00:47.875 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 04:00:47.875 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 04:00:47.875 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 04:00:47.875 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 04:00:47.875 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 04:00:47.875 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 04:00:47.875 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 04:00:47.875 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 04:00:47.875 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 04:00:47.875 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 04:00:47.875 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 04:00:47.875 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 04:00:47.875 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:00:47.875 1 ERROR oslo_service.service 
>2018-06-26 04:00:47.878 1 CRITICAL cinder [req-6a78f251-ea8b-4118-bb0b-61901ad5fb2b - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 04:00:47.878 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 04:00:47.878 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 04:00:47.878 1 ERROR cinder     sys.exit(main())
>2018-06-26 04:00:47.878 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 04:00:47.878 1 ERROR cinder     service.wait()
>2018-06-26 04:00:47.878 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 04:00:47.878 1 ERROR cinder     _launcher.wait()
>2018-06-26 04:00:47.878 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 04:00:47.878 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 04:00:47.878 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 04:00:47.878 1 ERROR cinder     self.services.wait()
>2018-06-26 04:00:47.878 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 04:00:47.878 1 ERROR cinder     service.wait()
>2018-06-26 04:00:47.878 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 04:00:47.878 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 04:00:47.878 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 04:00:47.878 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 04:00:47.878 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 04:00:47.878 1 ERROR cinder     post_fn = fn()
>2018-06-26 04:00:47.878 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 04:00:47.878 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 04:00:47.878 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 04:00:47.878 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 04:00:47.878 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 04:00:47.878 1 ERROR cinder 
>2018-06-26 04:00:50.496 1 WARNING cinder.scheduler.host_manager [req-936b5485-44ed-40be-bfbf-2451609a61c4 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 04:00:50.501 1 INFO cinder.rpc [req-936b5485-44ed-40be-bfbf-2451609a61c4 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 04:00:50.507 1 INFO cinder.rpc [req-936b5485-44ed-40be-bfbf-2451609a61c4 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 04:00:50.525 1 INFO cinder.rpc [req-936b5485-44ed-40be-bfbf-2451609a61c4 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 04:00:50.533 1 INFO cinder.rpc [req-936b5485-44ed-40be-bfbf-2451609a61c4 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 04:00:50.558 1 WARNING oslo_config.cfg [req-936b5485-44ed-40be-bfbf-2451609a61c4 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 04:00:50.560 1 WARNING oslo_config.cfg [req-936b5485-44ed-40be-bfbf-2451609a61c4 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:00:50.561 1 WARNING oslo_config.cfg [req-936b5485-44ed-40be-bfbf-2451609a61c4 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:00:50.561 1 WARNING oslo_config.cfg [req-936b5485-44ed-40be-bfbf-2451609a61c4 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:00:50.566 1 WARNING oslo_config.cfg [req-936b5485-44ed-40be-bfbf-2451609a61c4 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 04:00:50.568 1 WARNING oslo_config.cfg [req-936b5485-44ed-40be-bfbf-2451609a61c4 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 04:00:50.570 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 04:00:50.583 1 INFO cinder.manager [req-2d88142c-a087-484c-b61b-7ff9b65757e7 - - - - -] Initiating service 5 cleanup
>2018-06-26 04:00:50.593 1 INFO cinder.manager [req-2d88142c-a087-484c-b61b-7ff9b65757e7 - - - - -] Service 5 cleanup completed.
>2018-06-26 04:02:54.921 1 ERROR oslo.messaging._drivers.impl_rabbit [req-2d88142c-a087-484c-b61b-7ff9b65757e7 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:02:54.923 1 ERROR oslo.messaging._drivers.impl_rabbit [req-2d88142c-a087-484c-b61b-7ff9b65757e7 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:02:54.924 1 ERROR oslo_service.service [req-2d88142c-a087-484c-b61b-7ff9b65757e7 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:02:54.924 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 04:02:54.924 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 04:02:54.924 1 ERROR oslo_service.service     service.start()
>2018-06-26 04:02:54.924 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 04:02:54.924 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 04:02:54.924 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 04:02:54.924 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 04:02:54.924 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 04:02:54.924 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 04:02:54.924 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 04:02:54.924 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 04:02:54.924 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 04:02:54.924 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 04:02:54.924 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 04:02:54.924 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 04:02:54.924 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 04:02:54.924 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 04:02:54.924 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 04:02:54.924 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 04:02:54.924 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 04:02:54.924 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 04:02:54.924 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 04:02:54.924 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 04:02:54.924 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 04:02:54.924 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 04:02:54.924 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:02:54.924 1 ERROR oslo_service.service 
>2018-06-26 04:02:54.926 1 CRITICAL cinder [req-936b5485-44ed-40be-bfbf-2451609a61c4 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 04:02:54.926 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 04:02:54.926 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 04:02:54.926 1 ERROR cinder     sys.exit(main())
>2018-06-26 04:02:54.926 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 04:02:54.926 1 ERROR cinder     service.wait()
>2018-06-26 04:02:54.926 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 04:02:54.926 1 ERROR cinder     _launcher.wait()
>2018-06-26 04:02:54.926 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 04:02:54.926 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 04:02:54.926 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 04:02:54.926 1 ERROR cinder     self.services.wait()
>2018-06-26 04:02:54.926 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 04:02:54.926 1 ERROR cinder     service.wait()
>2018-06-26 04:02:54.926 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 04:02:54.926 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 04:02:54.926 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 04:02:54.926 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 04:02:54.926 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 04:02:54.926 1 ERROR cinder     post_fn = fn()
>2018-06-26 04:02:54.926 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 04:02:54.926 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 04:02:54.926 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 04:02:54.926 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 04:02:54.926 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 04:02:54.926 1 ERROR cinder 
>2018-06-26 04:02:57.544 1 WARNING cinder.scheduler.host_manager [req-8d6742ad-9380-4a28-b561-83b176eb651c - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 04:02:57.550 1 INFO cinder.rpc [req-8d6742ad-9380-4a28-b561-83b176eb651c - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 04:02:57.556 1 INFO cinder.rpc [req-8d6742ad-9380-4a28-b561-83b176eb651c - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 04:02:57.574 1 INFO cinder.rpc [req-8d6742ad-9380-4a28-b561-83b176eb651c - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 04:02:57.580 1 INFO cinder.rpc [req-8d6742ad-9380-4a28-b561-83b176eb651c - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 04:02:57.603 1 WARNING oslo_config.cfg [req-8d6742ad-9380-4a28-b561-83b176eb651c - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 04:02:57.606 1 WARNING oslo_config.cfg [req-8d6742ad-9380-4a28-b561-83b176eb651c - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:02:57.606 1 WARNING oslo_config.cfg [req-8d6742ad-9380-4a28-b561-83b176eb651c - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:02:57.607 1 WARNING oslo_config.cfg [req-8d6742ad-9380-4a28-b561-83b176eb651c - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:02:57.612 1 WARNING oslo_config.cfg [req-8d6742ad-9380-4a28-b561-83b176eb651c - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 04:02:57.613 1 WARNING oslo_config.cfg [req-8d6742ad-9380-4a28-b561-83b176eb651c - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 04:02:57.616 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 04:02:57.621 1 INFO cinder.manager [req-6e6cc438-d32f-4280-98ce-9d4c9f2c6ecb - - - - -] Initiating service 5 cleanup
>2018-06-26 04:02:57.626 1 INFO cinder.manager [req-6e6cc438-d32f-4280-98ce-9d4c9f2c6ecb - - - - -] Service 5 cleanup completed.
>2018-06-26 04:05:02.003 1 ERROR oslo.messaging._drivers.impl_rabbit [req-6e6cc438-d32f-4280-98ce-9d4c9f2c6ecb - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:05:02.005 1 ERROR oslo.messaging._drivers.impl_rabbit [req-6e6cc438-d32f-4280-98ce-9d4c9f2c6ecb - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:05:02.005 1 ERROR oslo_service.service [req-6e6cc438-d32f-4280-98ce-9d4c9f2c6ecb - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:05:02.005 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 04:05:02.005 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 04:05:02.005 1 ERROR oslo_service.service     service.start()
>2018-06-26 04:05:02.005 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 04:05:02.005 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 04:05:02.005 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 04:05:02.005 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 04:05:02.005 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 04:05:02.005 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 04:05:02.005 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 04:05:02.005 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 04:05:02.005 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 04:05:02.005 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 04:05:02.005 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 04:05:02.005 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 04:05:02.005 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 04:05:02.005 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 04:05:02.005 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 04:05:02.005 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 04:05:02.005 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 04:05:02.005 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 04:05:02.005 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 04:05:02.005 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 04:05:02.005 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 04:05:02.005 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 04:05:02.005 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:05:02.005 1 ERROR oslo_service.service 
>2018-06-26 04:05:02.008 1 CRITICAL cinder [req-8d6742ad-9380-4a28-b561-83b176eb651c - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 04:05:02.008 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 04:05:02.008 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 04:05:02.008 1 ERROR cinder     sys.exit(main())
>2018-06-26 04:05:02.008 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 04:05:02.008 1 ERROR cinder     service.wait()
>2018-06-26 04:05:02.008 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 04:05:02.008 1 ERROR cinder     _launcher.wait()
>2018-06-26 04:05:02.008 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 04:05:02.008 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 04:05:02.008 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 04:05:02.008 1 ERROR cinder     self.services.wait()
>2018-06-26 04:05:02.008 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 04:05:02.008 1 ERROR cinder     service.wait()
>2018-06-26 04:05:02.008 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 04:05:02.008 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 04:05:02.008 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 04:05:02.008 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 04:05:02.008 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 04:05:02.008 1 ERROR cinder     post_fn = fn()
>2018-06-26 04:05:02.008 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 04:05:02.008 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 04:05:02.008 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 04:05:02.008 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 04:05:02.008 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 04:05:02.008 1 ERROR cinder 
>2018-06-26 04:05:04.684 1 WARNING cinder.scheduler.host_manager [req-ba29fa75-fa56-4dc5-a7ca-c1bbb1c68419 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 04:05:04.689 1 INFO cinder.rpc [req-ba29fa75-fa56-4dc5-a7ca-c1bbb1c68419 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 04:05:04.694 1 INFO cinder.rpc [req-ba29fa75-fa56-4dc5-a7ca-c1bbb1c68419 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 04:05:04.707 1 INFO cinder.rpc [req-ba29fa75-fa56-4dc5-a7ca-c1bbb1c68419 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 04:05:04.714 1 INFO cinder.rpc [req-ba29fa75-fa56-4dc5-a7ca-c1bbb1c68419 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 04:05:04.738 1 WARNING oslo_config.cfg [req-ba29fa75-fa56-4dc5-a7ca-c1bbb1c68419 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 04:05:04.740 1 WARNING oslo_config.cfg [req-ba29fa75-fa56-4dc5-a7ca-c1bbb1c68419 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:05:04.740 1 WARNING oslo_config.cfg [req-ba29fa75-fa56-4dc5-a7ca-c1bbb1c68419 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:05:04.741 1 WARNING oslo_config.cfg [req-ba29fa75-fa56-4dc5-a7ca-c1bbb1c68419 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:05:04.745 1 WARNING oslo_config.cfg [req-ba29fa75-fa56-4dc5-a7ca-c1bbb1c68419 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 04:05:04.746 1 WARNING oslo_config.cfg [req-ba29fa75-fa56-4dc5-a7ca-c1bbb1c68419 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 04:05:04.749 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 04:05:04.754 1 INFO cinder.manager [req-d5d7488b-e014-4dd9-ac48-ee7f4d04b281 - - - - -] Initiating service 5 cleanup
>2018-06-26 04:05:04.759 1 INFO cinder.manager [req-d5d7488b-e014-4dd9-ac48-ee7f4d04b281 - - - - -] Service 5 cleanup completed.
>2018-06-26 04:07:09.352 1 ERROR oslo.messaging._drivers.impl_rabbit [req-d5d7488b-e014-4dd9-ac48-ee7f4d04b281 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:07:09.354 1 ERROR oslo.messaging._drivers.impl_rabbit [req-d5d7488b-e014-4dd9-ac48-ee7f4d04b281 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:07:09.355 1 ERROR oslo_service.service [req-d5d7488b-e014-4dd9-ac48-ee7f4d04b281 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:07:09.355 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 04:07:09.355 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 04:07:09.355 1 ERROR oslo_service.service     service.start()
>2018-06-26 04:07:09.355 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 04:07:09.355 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 04:07:09.355 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 04:07:09.355 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 04:07:09.355 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 04:07:09.355 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 04:07:09.355 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 04:07:09.355 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 04:07:09.355 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 04:07:09.355 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 04:07:09.355 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 04:07:09.355 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 04:07:09.355 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 04:07:09.355 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 04:07:09.355 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 04:07:09.355 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 04:07:09.355 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 04:07:09.355 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 04:07:09.355 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 04:07:09.355 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 04:07:09.355 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 04:07:09.355 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 04:07:09.355 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:07:09.355 1 ERROR oslo_service.service 
>2018-06-26 04:07:09.358 1 CRITICAL cinder [req-ba29fa75-fa56-4dc5-a7ca-c1bbb1c68419 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 04:07:09.358 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 04:07:09.358 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 04:07:09.358 1 ERROR cinder     sys.exit(main())
>2018-06-26 04:07:09.358 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 04:07:09.358 1 ERROR cinder     service.wait()
>2018-06-26 04:07:09.358 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 04:07:09.358 1 ERROR cinder     _launcher.wait()
>2018-06-26 04:07:09.358 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 04:07:09.358 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 04:07:09.358 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 04:07:09.358 1 ERROR cinder     self.services.wait()
>2018-06-26 04:07:09.358 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 04:07:09.358 1 ERROR cinder     service.wait()
>2018-06-26 04:07:09.358 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 04:07:09.358 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 04:07:09.358 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 04:07:09.358 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 04:07:09.358 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 04:07:09.358 1 ERROR cinder     post_fn = fn()
>2018-06-26 04:07:09.358 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 04:07:09.358 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 04:07:09.358 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 04:07:09.358 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 04:07:09.358 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 04:07:09.358 1 ERROR cinder 
>2018-06-26 04:07:11.998 1 WARNING cinder.scheduler.host_manager [req-00eabf69-18f5-473b-8d98-6af5389923a1 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 04:07:12.004 1 INFO cinder.rpc [req-00eabf69-18f5-473b-8d98-6af5389923a1 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 04:07:12.009 1 INFO cinder.rpc [req-00eabf69-18f5-473b-8d98-6af5389923a1 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 04:07:12.020 1 INFO cinder.rpc [req-00eabf69-18f5-473b-8d98-6af5389923a1 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 04:07:12.027 1 INFO cinder.rpc [req-00eabf69-18f5-473b-8d98-6af5389923a1 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 04:07:12.052 1 WARNING oslo_config.cfg [req-00eabf69-18f5-473b-8d98-6af5389923a1 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 04:07:12.054 1 WARNING oslo_config.cfg [req-00eabf69-18f5-473b-8d98-6af5389923a1 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:07:12.055 1 WARNING oslo_config.cfg [req-00eabf69-18f5-473b-8d98-6af5389923a1 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:07:12.055 1 WARNING oslo_config.cfg [req-00eabf69-18f5-473b-8d98-6af5389923a1 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:07:12.060 1 WARNING oslo_config.cfg [req-00eabf69-18f5-473b-8d98-6af5389923a1 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 04:07:12.061 1 WARNING oslo_config.cfg [req-00eabf69-18f5-473b-8d98-6af5389923a1 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 04:07:12.064 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 04:07:12.071 1 INFO cinder.manager [req-3233c67a-0b92-4b9a-86c9-ac78efe37444 - - - - -] Initiating service 5 cleanup
>2018-06-26 04:07:12.075 1 INFO cinder.manager [req-3233c67a-0b92-4b9a-86c9-ac78efe37444 - - - - -] Service 5 cleanup completed.
>2018-06-26 04:09:16.483 1 ERROR oslo.messaging._drivers.impl_rabbit [req-3233c67a-0b92-4b9a-86c9-ac78efe37444 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:09:16.485 1 ERROR oslo.messaging._drivers.impl_rabbit [req-3233c67a-0b92-4b9a-86c9-ac78efe37444 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:09:16.486 1 ERROR oslo_service.service [req-3233c67a-0b92-4b9a-86c9-ac78efe37444 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:09:16.486 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 04:09:16.486 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 04:09:16.486 1 ERROR oslo_service.service     service.start()
>2018-06-26 04:09:16.486 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 04:09:16.486 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 04:09:16.486 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 04:09:16.486 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 04:09:16.486 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 04:09:16.486 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 04:09:16.486 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 04:09:16.486 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 04:09:16.486 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 04:09:16.486 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 04:09:16.486 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 04:09:16.486 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 04:09:16.486 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 04:09:16.486 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 04:09:16.486 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 04:09:16.486 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 04:09:16.486 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 04:09:16.486 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 04:09:16.486 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 04:09:16.486 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 04:09:16.486 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 04:09:16.486 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 04:09:16.486 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:09:16.486 1 ERROR oslo_service.service 
>2018-06-26 04:09:16.489 1 CRITICAL cinder [req-00eabf69-18f5-473b-8d98-6af5389923a1 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 04:09:16.489 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 04:09:16.489 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 04:09:16.489 1 ERROR cinder     sys.exit(main())
>2018-06-26 04:09:16.489 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 04:09:16.489 1 ERROR cinder     service.wait()
>2018-06-26 04:09:16.489 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 04:09:16.489 1 ERROR cinder     _launcher.wait()
>2018-06-26 04:09:16.489 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 04:09:16.489 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 04:09:16.489 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 04:09:16.489 1 ERROR cinder     self.services.wait()
>2018-06-26 04:09:16.489 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 04:09:16.489 1 ERROR cinder     service.wait()
>2018-06-26 04:09:16.489 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 04:09:16.489 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 04:09:16.489 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 04:09:16.489 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 04:09:16.489 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 04:09:16.489 1 ERROR cinder     post_fn = fn()
>2018-06-26 04:09:16.489 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 04:09:16.489 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 04:09:16.489 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 04:09:16.489 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 04:09:16.489 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 04:09:16.489 1 ERROR cinder 
>2018-06-26 04:09:19.158 1 WARNING cinder.scheduler.host_manager [req-02b944b7-8e26-4188-a392-00093c3299b6 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 04:09:19.169 1 INFO cinder.rpc [req-02b944b7-8e26-4188-a392-00093c3299b6 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 04:09:19.178 1 INFO cinder.rpc [req-02b944b7-8e26-4188-a392-00093c3299b6 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 04:09:19.198 1 INFO cinder.rpc [req-02b944b7-8e26-4188-a392-00093c3299b6 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 04:09:19.208 1 INFO cinder.rpc [req-02b944b7-8e26-4188-a392-00093c3299b6 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 04:09:19.240 1 WARNING oslo_config.cfg [req-02b944b7-8e26-4188-a392-00093c3299b6 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 04:09:19.243 1 WARNING oslo_config.cfg [req-02b944b7-8e26-4188-a392-00093c3299b6 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:09:19.243 1 WARNING oslo_config.cfg [req-02b944b7-8e26-4188-a392-00093c3299b6 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:09:19.244 1 WARNING oslo_config.cfg [req-02b944b7-8e26-4188-a392-00093c3299b6 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:09:19.249 1 WARNING oslo_config.cfg [req-02b944b7-8e26-4188-a392-00093c3299b6 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 04:09:19.251 1 WARNING oslo_config.cfg [req-02b944b7-8e26-4188-a392-00093c3299b6 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 04:09:19.254 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 04:09:19.262 1 INFO cinder.manager [req-10072dc4-909e-4b97-9f12-0302a9d10b2b - - - - -] Initiating service 5 cleanup
>2018-06-26 04:09:19.268 1 INFO cinder.manager [req-10072dc4-909e-4b97-9f12-0302a9d10b2b - - - - -] Service 5 cleanup completed.
>2018-06-26 04:11:25.519 1 ERROR oslo.messaging._drivers.impl_rabbit [req-10072dc4-909e-4b97-9f12-0302a9d10b2b - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:11:25.522 1 ERROR oslo.messaging._drivers.impl_rabbit [req-10072dc4-909e-4b97-9f12-0302a9d10b2b - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:11:25.522 1 ERROR oslo_service.service [req-10072dc4-909e-4b97-9f12-0302a9d10b2b - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:11:25.522 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 04:11:25.522 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 04:11:25.522 1 ERROR oslo_service.service     service.start()
>2018-06-26 04:11:25.522 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 04:11:25.522 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 04:11:25.522 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 04:11:25.522 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 04:11:25.522 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 04:11:25.522 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 04:11:25.522 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 04:11:25.522 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 04:11:25.522 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 04:11:25.522 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 04:11:25.522 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 04:11:25.522 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 04:11:25.522 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 04:11:25.522 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 04:11:25.522 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 04:11:25.522 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 04:11:25.522 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 04:11:25.522 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 04:11:25.522 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 04:11:25.522 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 04:11:25.522 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 04:11:25.522 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 04:11:25.522 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:11:25.522 1 ERROR oslo_service.service 
>2018-06-26 04:11:25.525 1 CRITICAL cinder [req-02b944b7-8e26-4188-a392-00093c3299b6 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 04:11:25.525 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 04:11:25.525 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 04:11:25.525 1 ERROR cinder     sys.exit(main())
>2018-06-26 04:11:25.525 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 04:11:25.525 1 ERROR cinder     service.wait()
>2018-06-26 04:11:25.525 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 04:11:25.525 1 ERROR cinder     _launcher.wait()
>2018-06-26 04:11:25.525 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 04:11:25.525 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 04:11:25.525 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 04:11:25.525 1 ERROR cinder     self.services.wait()
>2018-06-26 04:11:25.525 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 04:11:25.525 1 ERROR cinder     service.wait()
>2018-06-26 04:11:25.525 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 04:11:25.525 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 04:11:25.525 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 04:11:25.525 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 04:11:25.525 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 04:11:25.525 1 ERROR cinder     post_fn = fn()
>2018-06-26 04:11:25.525 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 04:11:25.525 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 04:11:25.525 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 04:11:25.525 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 04:11:25.525 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 04:11:25.525 1 ERROR cinder 
>2018-06-26 04:11:28.225 1 WARNING cinder.scheduler.host_manager [req-54a90590-613d-4db7-9097-4d882a0fcab9 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 04:11:28.231 1 INFO cinder.rpc [req-54a90590-613d-4db7-9097-4d882a0fcab9 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 04:11:28.236 1 INFO cinder.rpc [req-54a90590-613d-4db7-9097-4d882a0fcab9 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 04:11:28.247 1 INFO cinder.rpc [req-54a90590-613d-4db7-9097-4d882a0fcab9 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 04:11:28.253 1 INFO cinder.rpc [req-54a90590-613d-4db7-9097-4d882a0fcab9 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 04:11:28.278 1 WARNING oslo_config.cfg [req-54a90590-613d-4db7-9097-4d882a0fcab9 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 04:11:28.280 1 WARNING oslo_config.cfg [req-54a90590-613d-4db7-9097-4d882a0fcab9 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:11:28.281 1 WARNING oslo_config.cfg [req-54a90590-613d-4db7-9097-4d882a0fcab9 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:11:28.281 1 WARNING oslo_config.cfg [req-54a90590-613d-4db7-9097-4d882a0fcab9 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:11:28.287 1 WARNING oslo_config.cfg [req-54a90590-613d-4db7-9097-4d882a0fcab9 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 04:11:28.288 1 WARNING oslo_config.cfg [req-54a90590-613d-4db7-9097-4d882a0fcab9 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 04:11:28.291 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 04:11:28.297 1 INFO cinder.manager [req-21152b28-5577-4f5f-9a2f-5672775bad24 - - - - -] Initiating service 5 cleanup
>2018-06-26 04:11:28.303 1 INFO cinder.manager [req-21152b28-5577-4f5f-9a2f-5672775bad24 - - - - -] Service 5 cleanup completed.
>2018-06-26 04:13:40.499 1 ERROR oslo.messaging._drivers.impl_rabbit [req-21152b28-5577-4f5f-9a2f-5672775bad24 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:13:40.501 1 ERROR oslo.messaging._drivers.impl_rabbit [req-21152b28-5577-4f5f-9a2f-5672775bad24 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:13:40.501 1 ERROR oslo_service.service [req-21152b28-5577-4f5f-9a2f-5672775bad24 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:13:40.501 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 04:13:40.501 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 04:13:40.501 1 ERROR oslo_service.service     service.start()
>2018-06-26 04:13:40.501 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 04:13:40.501 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 04:13:40.501 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 04:13:40.501 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 04:13:40.501 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 04:13:40.501 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 04:13:40.501 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 04:13:40.501 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 04:13:40.501 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 04:13:40.501 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 04:13:40.501 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 04:13:40.501 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 04:13:40.501 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 04:13:40.501 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 04:13:40.501 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 04:13:40.501 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 04:13:40.501 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 04:13:40.501 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 04:13:40.501 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 04:13:40.501 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 04:13:40.501 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 04:13:40.501 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 04:13:40.501 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:13:40.501 1 ERROR oslo_service.service 
>2018-06-26 04:13:40.505 1 CRITICAL cinder [req-54a90590-613d-4db7-9097-4d882a0fcab9 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 04:13:40.505 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 04:13:40.505 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 04:13:40.505 1 ERROR cinder     sys.exit(main())
>2018-06-26 04:13:40.505 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 04:13:40.505 1 ERROR cinder     service.wait()
>2018-06-26 04:13:40.505 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 04:13:40.505 1 ERROR cinder     _launcher.wait()
>2018-06-26 04:13:40.505 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 04:13:40.505 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 04:13:40.505 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 04:13:40.505 1 ERROR cinder     self.services.wait()
>2018-06-26 04:13:40.505 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 04:13:40.505 1 ERROR cinder     service.wait()
>2018-06-26 04:13:40.505 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 04:13:40.505 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 04:13:40.505 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 04:13:40.505 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 04:13:40.505 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 04:13:40.505 1 ERROR cinder     post_fn = fn()
>2018-06-26 04:13:40.505 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 04:13:40.505 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 04:13:40.505 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 04:13:40.505 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 04:13:40.505 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 04:13:40.505 1 ERROR cinder 
>2018-06-26 04:13:43.247 1 WARNING cinder.scheduler.host_manager [req-7a1927a1-28df-4662-a064-796244d95b5a - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 04:13:43.253 1 INFO cinder.rpc [req-7a1927a1-28df-4662-a064-796244d95b5a - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 04:13:43.259 1 INFO cinder.rpc [req-7a1927a1-28df-4662-a064-796244d95b5a - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 04:13:43.272 1 INFO cinder.rpc [req-7a1927a1-28df-4662-a064-796244d95b5a - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 04:13:43.280 1 INFO cinder.rpc [req-7a1927a1-28df-4662-a064-796244d95b5a - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 04:13:43.314 1 WARNING oslo_config.cfg [req-7a1927a1-28df-4662-a064-796244d95b5a - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 04:13:43.316 1 WARNING oslo_config.cfg [req-7a1927a1-28df-4662-a064-796244d95b5a - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:13:43.317 1 WARNING oslo_config.cfg [req-7a1927a1-28df-4662-a064-796244d95b5a - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:13:43.317 1 WARNING oslo_config.cfg [req-7a1927a1-28df-4662-a064-796244d95b5a - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:13:43.323 1 WARNING oslo_config.cfg [req-7a1927a1-28df-4662-a064-796244d95b5a - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 04:13:43.324 1 WARNING oslo_config.cfg [req-7a1927a1-28df-4662-a064-796244d95b5a - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 04:13:43.327 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 04:13:43.334 1 INFO cinder.manager [req-b252391c-b19a-4f4a-b175-3e118ded6f67 - - - - -] Initiating service 5 cleanup
>2018-06-26 04:13:43.339 1 INFO cinder.manager [req-b252391c-b19a-4f4a-b175-3e118ded6f67 - - - - -] Service 5 cleanup completed.
>2018-06-26 04:15:49.301 1 ERROR oslo.messaging._drivers.impl_rabbit [req-b252391c-b19a-4f4a-b175-3e118ded6f67 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:15:49.303 1 ERROR oslo.messaging._drivers.impl_rabbit [req-b252391c-b19a-4f4a-b175-3e118ded6f67 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:15:49.303 1 ERROR oslo_service.service [req-b252391c-b19a-4f4a-b175-3e118ded6f67 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:15:49.303 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 04:15:49.303 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 04:15:49.303 1 ERROR oslo_service.service     service.start()
>2018-06-26 04:15:49.303 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 04:15:49.303 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 04:15:49.303 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 04:15:49.303 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 04:15:49.303 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 04:15:49.303 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 04:15:49.303 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 04:15:49.303 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 04:15:49.303 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 04:15:49.303 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 04:15:49.303 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 04:15:49.303 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 04:15:49.303 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 04:15:49.303 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 04:15:49.303 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 04:15:49.303 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 04:15:49.303 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 04:15:49.303 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 04:15:49.303 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 04:15:49.303 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 04:15:49.303 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 04:15:49.303 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 04:15:49.303 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:15:49.303 1 ERROR oslo_service.service 
>2018-06-26 04:15:49.306 1 CRITICAL cinder [req-7a1927a1-28df-4662-a064-796244d95b5a - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 04:15:49.306 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 04:15:49.306 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 04:15:49.306 1 ERROR cinder     sys.exit(main())
>2018-06-26 04:15:49.306 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 04:15:49.306 1 ERROR cinder     service.wait()
>2018-06-26 04:15:49.306 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 04:15:49.306 1 ERROR cinder     _launcher.wait()
>2018-06-26 04:15:49.306 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 04:15:49.306 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 04:15:49.306 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 04:15:49.306 1 ERROR cinder     self.services.wait()
>2018-06-26 04:15:49.306 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 04:15:49.306 1 ERROR cinder     service.wait()
>2018-06-26 04:15:49.306 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 04:15:49.306 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 04:15:49.306 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 04:15:49.306 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 04:15:49.306 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 04:15:49.306 1 ERROR cinder     post_fn = fn()
>2018-06-26 04:15:49.306 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 04:15:49.306 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 04:15:49.306 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 04:15:49.306 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 04:15:49.306 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 04:15:49.306 1 ERROR cinder 
>2018-06-26 04:15:52.083 1 WARNING cinder.scheduler.host_manager [req-8b94b95b-5fd9-4a2f-a72f-50c656dda3d2 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 04:15:52.089 1 INFO cinder.rpc [req-8b94b95b-5fd9-4a2f-a72f-50c656dda3d2 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 04:15:52.098 1 INFO cinder.rpc [req-8b94b95b-5fd9-4a2f-a72f-50c656dda3d2 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 04:15:52.109 1 INFO cinder.rpc [req-8b94b95b-5fd9-4a2f-a72f-50c656dda3d2 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 04:15:52.118 1 INFO cinder.rpc [req-8b94b95b-5fd9-4a2f-a72f-50c656dda3d2 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 04:15:52.144 1 WARNING oslo_config.cfg [req-8b94b95b-5fd9-4a2f-a72f-50c656dda3d2 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 04:15:52.147 1 WARNING oslo_config.cfg [req-8b94b95b-5fd9-4a2f-a72f-50c656dda3d2 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:15:52.147 1 WARNING oslo_config.cfg [req-8b94b95b-5fd9-4a2f-a72f-50c656dda3d2 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:15:52.148 1 WARNING oslo_config.cfg [req-8b94b95b-5fd9-4a2f-a72f-50c656dda3d2 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:15:52.153 1 WARNING oslo_config.cfg [req-8b94b95b-5fd9-4a2f-a72f-50c656dda3d2 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 04:15:52.155 1 WARNING oslo_config.cfg [req-8b94b95b-5fd9-4a2f-a72f-50c656dda3d2 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 04:15:52.158 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 04:15:52.166 1 INFO cinder.manager [req-c0f5262a-3859-4f5e-af7b-9a254ab06fcc - - - - -] Initiating service 5 cleanup
>2018-06-26 04:15:52.170 1 INFO cinder.manager [req-c0f5262a-3859-4f5e-af7b-9a254ab06fcc - - - - -] Service 5 cleanup completed.
>2018-06-26 04:17:56.515 1 ERROR oslo.messaging._drivers.impl_rabbit [req-c0f5262a-3859-4f5e-af7b-9a254ab06fcc - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:17:56.518 1 ERROR oslo.messaging._drivers.impl_rabbit [req-c0f5262a-3859-4f5e-af7b-9a254ab06fcc - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:17:56.519 1 ERROR oslo_service.service [req-c0f5262a-3859-4f5e-af7b-9a254ab06fcc - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:17:56.519 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 04:17:56.519 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 04:17:56.519 1 ERROR oslo_service.service     service.start()
>2018-06-26 04:17:56.519 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 04:17:56.519 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 04:17:56.519 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 04:17:56.519 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 04:17:56.519 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 04:17:56.519 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 04:17:56.519 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 04:17:56.519 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 04:17:56.519 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 04:17:56.519 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 04:17:56.519 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 04:17:56.519 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 04:17:56.519 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 04:17:56.519 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 04:17:56.519 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 04:17:56.519 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 04:17:56.519 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 04:17:56.519 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 04:17:56.519 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 04:17:56.519 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 04:17:56.519 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 04:17:56.519 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 04:17:56.519 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:17:56.519 1 ERROR oslo_service.service 
>2018-06-26 04:17:56.523 1 CRITICAL cinder [req-8b94b95b-5fd9-4a2f-a72f-50c656dda3d2 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 04:17:56.523 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 04:17:56.523 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 04:17:56.523 1 ERROR cinder     sys.exit(main())
>2018-06-26 04:17:56.523 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 04:17:56.523 1 ERROR cinder     service.wait()
>2018-06-26 04:17:56.523 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 04:17:56.523 1 ERROR cinder     _launcher.wait()
>2018-06-26 04:17:56.523 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 04:17:56.523 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 04:17:56.523 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 04:17:56.523 1 ERROR cinder     self.services.wait()
>2018-06-26 04:17:56.523 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 04:17:56.523 1 ERROR cinder     service.wait()
>2018-06-26 04:17:56.523 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 04:17:56.523 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 04:17:56.523 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 04:17:56.523 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 04:17:56.523 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 04:17:56.523 1 ERROR cinder     post_fn = fn()
>2018-06-26 04:17:56.523 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 04:17:56.523 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 04:17:56.523 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 04:17:56.523 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 04:17:56.523 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 04:17:56.523 1 ERROR cinder 
>2018-06-26 04:17:59.250 1 WARNING cinder.scheduler.host_manager [req-8943da0e-be10-4d92-87c1-7acbb18fc622 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 04:17:59.256 1 INFO cinder.rpc [req-8943da0e-be10-4d92-87c1-7acbb18fc622 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 04:17:59.261 1 INFO cinder.rpc [req-8943da0e-be10-4d92-87c1-7acbb18fc622 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 04:17:59.273 1 INFO cinder.rpc [req-8943da0e-be10-4d92-87c1-7acbb18fc622 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 04:17:59.280 1 INFO cinder.rpc [req-8943da0e-be10-4d92-87c1-7acbb18fc622 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 04:17:59.305 1 WARNING oslo_config.cfg [req-8943da0e-be10-4d92-87c1-7acbb18fc622 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 04:17:59.307 1 WARNING oslo_config.cfg [req-8943da0e-be10-4d92-87c1-7acbb18fc622 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:17:59.307 1 WARNING oslo_config.cfg [req-8943da0e-be10-4d92-87c1-7acbb18fc622 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:17:59.308 1 WARNING oslo_config.cfg [req-8943da0e-be10-4d92-87c1-7acbb18fc622 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:17:59.313 1 WARNING oslo_config.cfg [req-8943da0e-be10-4d92-87c1-7acbb18fc622 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 04:17:59.314 1 WARNING oslo_config.cfg [req-8943da0e-be10-4d92-87c1-7acbb18fc622 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 04:17:59.317 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 04:17:59.323 1 INFO cinder.manager [req-6a21bd3f-472e-4d7e-bb8e-43119b896fd1 - - - - -] Initiating service 5 cleanup
>2018-06-26 04:17:59.327 1 INFO cinder.manager [req-6a21bd3f-472e-4d7e-bb8e-43119b896fd1 - - - - -] Service 5 cleanup completed.
>2018-06-26 04:20:11.153 1 ERROR oslo.messaging._drivers.impl_rabbit [req-6a21bd3f-472e-4d7e-bb8e-43119b896fd1 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:20:11.158 1 ERROR oslo.messaging._drivers.impl_rabbit [req-6a21bd3f-472e-4d7e-bb8e-43119b896fd1 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:20:11.159 1 ERROR oslo_service.service [req-6a21bd3f-472e-4d7e-bb8e-43119b896fd1 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:20:11.159 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 04:20:11.159 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 04:20:11.159 1 ERROR oslo_service.service     service.start()
>2018-06-26 04:20:11.159 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 04:20:11.159 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 04:20:11.159 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 04:20:11.159 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 04:20:11.159 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 04:20:11.159 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 04:20:11.159 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 04:20:11.159 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 04:20:11.159 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 04:20:11.159 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 04:20:11.159 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 04:20:11.159 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 04:20:11.159 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 04:20:11.159 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 04:20:11.159 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 04:20:11.159 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 04:20:11.159 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 04:20:11.159 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 04:20:11.159 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 04:20:11.159 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 04:20:11.159 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 04:20:11.159 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 04:20:11.159 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:20:11.159 1 ERROR oslo_service.service 
>2018-06-26 04:20:11.163 1 CRITICAL cinder [req-8943da0e-be10-4d92-87c1-7acbb18fc622 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 04:20:11.163 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 04:20:11.163 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 04:20:11.163 1 ERROR cinder     sys.exit(main())
>2018-06-26 04:20:11.163 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 04:20:11.163 1 ERROR cinder     service.wait()
>2018-06-26 04:20:11.163 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 04:20:11.163 1 ERROR cinder     _launcher.wait()
>2018-06-26 04:20:11.163 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 04:20:11.163 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 04:20:11.163 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 04:20:11.163 1 ERROR cinder     self.services.wait()
>2018-06-26 04:20:11.163 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 04:20:11.163 1 ERROR cinder     service.wait()
>2018-06-26 04:20:11.163 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 04:20:11.163 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 04:20:11.163 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 04:20:11.163 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 04:20:11.163 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 04:20:11.163 1 ERROR cinder     post_fn = fn()
>2018-06-26 04:20:11.163 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 04:20:11.163 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 04:20:11.163 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 04:20:11.163 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 04:20:11.163 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 04:20:11.163 1 ERROR cinder 
>2018-06-26 04:20:13.734 1 WARNING cinder.scheduler.host_manager [req-7f357be7-82e4-433e-a07f-36205be62e3a - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 04:20:13.739 1 INFO cinder.rpc [req-7f357be7-82e4-433e-a07f-36205be62e3a - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 04:20:13.745 1 INFO cinder.rpc [req-7f357be7-82e4-433e-a07f-36205be62e3a - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 04:20:13.755 1 INFO cinder.rpc [req-7f357be7-82e4-433e-a07f-36205be62e3a - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 04:20:13.761 1 INFO cinder.rpc [req-7f357be7-82e4-433e-a07f-36205be62e3a - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 04:20:13.786 1 WARNING oslo_config.cfg [req-7f357be7-82e4-433e-a07f-36205be62e3a - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 04:20:13.788 1 WARNING oslo_config.cfg [req-7f357be7-82e4-433e-a07f-36205be62e3a - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:20:13.788 1 WARNING oslo_config.cfg [req-7f357be7-82e4-433e-a07f-36205be62e3a - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:20:13.789 1 WARNING oslo_config.cfg [req-7f357be7-82e4-433e-a07f-36205be62e3a - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:20:13.794 1 WARNING oslo_config.cfg [req-7f357be7-82e4-433e-a07f-36205be62e3a - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 04:20:13.795 1 WARNING oslo_config.cfg [req-7f357be7-82e4-433e-a07f-36205be62e3a - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 04:20:13.797 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 04:20:13.803 1 INFO cinder.manager [req-599da212-73d7-431a-9a2b-f4da58129b21 - - - - -] Initiating service 5 cleanup
>2018-06-26 04:20:13.808 1 INFO cinder.manager [req-599da212-73d7-431a-9a2b-f4da58129b21 - - - - -] Service 5 cleanup completed.
>2018-06-26 04:22:19.807 1 ERROR oslo.messaging._drivers.impl_rabbit [req-599da212-73d7-431a-9a2b-f4da58129b21 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:22:19.809 1 ERROR oslo.messaging._drivers.impl_rabbit [req-599da212-73d7-431a-9a2b-f4da58129b21 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:22:19.810 1 ERROR oslo_service.service [req-599da212-73d7-431a-9a2b-f4da58129b21 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:22:19.810 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 04:22:19.810 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 04:22:19.810 1 ERROR oslo_service.service     service.start()
>2018-06-26 04:22:19.810 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 04:22:19.810 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 04:22:19.810 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 04:22:19.810 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 04:22:19.810 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 04:22:19.810 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 04:22:19.810 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 04:22:19.810 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 04:22:19.810 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 04:22:19.810 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 04:22:19.810 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 04:22:19.810 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 04:22:19.810 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 04:22:19.810 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 04:22:19.810 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 04:22:19.810 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 04:22:19.810 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 04:22:19.810 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 04:22:19.810 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 04:22:19.810 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 04:22:19.810 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 04:22:19.810 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 04:22:19.810 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:22:19.810 1 ERROR oslo_service.service 
>2018-06-26 04:22:19.814 1 CRITICAL cinder [req-7f357be7-82e4-433e-a07f-36205be62e3a - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 04:22:19.814 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 04:22:19.814 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 04:22:19.814 1 ERROR cinder     sys.exit(main())
>2018-06-26 04:22:19.814 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 04:22:19.814 1 ERROR cinder     service.wait()
>2018-06-26 04:22:19.814 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 04:22:19.814 1 ERROR cinder     _launcher.wait()
>2018-06-26 04:22:19.814 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 04:22:19.814 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 04:22:19.814 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 04:22:19.814 1 ERROR cinder     self.services.wait()
>2018-06-26 04:22:19.814 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 04:22:19.814 1 ERROR cinder     service.wait()
>2018-06-26 04:22:19.814 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 04:22:19.814 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 04:22:19.814 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 04:22:19.814 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 04:22:19.814 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 04:22:19.814 1 ERROR cinder     post_fn = fn()
>2018-06-26 04:22:19.814 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 04:22:19.814 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 04:22:19.814 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 04:22:19.814 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 04:22:19.814 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 04:22:19.814 1 ERROR cinder 
>2018-06-26 04:22:22.429 1 WARNING cinder.scheduler.host_manager [req-cf147c46-86d4-46e4-9a2a-f1c8b4854098 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 04:22:22.436 1 INFO cinder.rpc [req-cf147c46-86d4-46e4-9a2a-f1c8b4854098 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 04:22:22.442 1 INFO cinder.rpc [req-cf147c46-86d4-46e4-9a2a-f1c8b4854098 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 04:22:22.457 1 INFO cinder.rpc [req-cf147c46-86d4-46e4-9a2a-f1c8b4854098 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 04:22:22.465 1 INFO cinder.rpc [req-cf147c46-86d4-46e4-9a2a-f1c8b4854098 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 04:22:22.488 1 WARNING oslo_config.cfg [req-cf147c46-86d4-46e4-9a2a-f1c8b4854098 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 04:22:22.490 1 WARNING oslo_config.cfg [req-cf147c46-86d4-46e4-9a2a-f1c8b4854098 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:22:22.491 1 WARNING oslo_config.cfg [req-cf147c46-86d4-46e4-9a2a-f1c8b4854098 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:22:22.491 1 WARNING oslo_config.cfg [req-cf147c46-86d4-46e4-9a2a-f1c8b4854098 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:22:22.496 1 WARNING oslo_config.cfg [req-cf147c46-86d4-46e4-9a2a-f1c8b4854098 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 04:22:22.498 1 WARNING oslo_config.cfg [req-cf147c46-86d4-46e4-9a2a-f1c8b4854098 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 04:22:22.501 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 04:22:22.510 1 INFO cinder.manager [req-8816cb8d-8906-4bfb-b8e8-018be81d7ba4 - - - - -] Initiating service 5 cleanup
>2018-06-26 04:22:22.517 1 INFO cinder.manager [req-8816cb8d-8906-4bfb-b8e8-018be81d7ba4 - - - - -] Service 5 cleanup completed.
>2018-06-26 04:24:28.526 1 ERROR oslo.messaging._drivers.impl_rabbit [req-8816cb8d-8906-4bfb-b8e8-018be81d7ba4 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:24:28.528 1 ERROR oslo.messaging._drivers.impl_rabbit [req-8816cb8d-8906-4bfb-b8e8-018be81d7ba4 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:24:28.529 1 ERROR oslo_service.service [req-8816cb8d-8906-4bfb-b8e8-018be81d7ba4 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:24:28.529 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 04:24:28.529 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 04:24:28.529 1 ERROR oslo_service.service     service.start()
>2018-06-26 04:24:28.529 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 04:24:28.529 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 04:24:28.529 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 04:24:28.529 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 04:24:28.529 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 04:24:28.529 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 04:24:28.529 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 04:24:28.529 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 04:24:28.529 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 04:24:28.529 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 04:24:28.529 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 04:24:28.529 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 04:24:28.529 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 04:24:28.529 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 04:24:28.529 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 04:24:28.529 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 04:24:28.529 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 04:24:28.529 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 04:24:28.529 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 04:24:28.529 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 04:24:28.529 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 04:24:28.529 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 04:24:28.529 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:24:28.529 1 ERROR oslo_service.service 
>2018-06-26 04:24:28.532 1 CRITICAL cinder [req-cf147c46-86d4-46e4-9a2a-f1c8b4854098 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 04:24:28.532 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 04:24:28.532 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 04:24:28.532 1 ERROR cinder     sys.exit(main())
>2018-06-26 04:24:28.532 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 04:24:28.532 1 ERROR cinder     service.wait()
>2018-06-26 04:24:28.532 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 04:24:28.532 1 ERROR cinder     _launcher.wait()
>2018-06-26 04:24:28.532 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 04:24:28.532 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 04:24:28.532 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 04:24:28.532 1 ERROR cinder     self.services.wait()
>2018-06-26 04:24:28.532 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 04:24:28.532 1 ERROR cinder     service.wait()
>2018-06-26 04:24:28.532 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 04:24:28.532 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 04:24:28.532 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 04:24:28.532 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 04:24:28.532 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 04:24:28.532 1 ERROR cinder     post_fn = fn()
>2018-06-26 04:24:28.532 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 04:24:28.532 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 04:24:28.532 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 04:24:28.532 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 04:24:28.532 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 04:24:28.532 1 ERROR cinder 
>2018-06-26 04:24:31.294 1 WARNING cinder.scheduler.host_manager [req-a8348be6-c949-4bcf-805b-7adf410a6d78 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 04:24:31.300 1 INFO cinder.rpc [req-a8348be6-c949-4bcf-805b-7adf410a6d78 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 04:24:31.306 1 INFO cinder.rpc [req-a8348be6-c949-4bcf-805b-7adf410a6d78 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 04:24:31.319 1 INFO cinder.rpc [req-a8348be6-c949-4bcf-805b-7adf410a6d78 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 04:24:31.327 1 INFO cinder.rpc [req-a8348be6-c949-4bcf-805b-7adf410a6d78 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 04:24:31.362 1 WARNING oslo_config.cfg [req-a8348be6-c949-4bcf-805b-7adf410a6d78 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 04:24:31.364 1 WARNING oslo_config.cfg [req-a8348be6-c949-4bcf-805b-7adf410a6d78 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:24:31.364 1 WARNING oslo_config.cfg [req-a8348be6-c949-4bcf-805b-7adf410a6d78 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:24:31.365 1 WARNING oslo_config.cfg [req-a8348be6-c949-4bcf-805b-7adf410a6d78 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:24:31.370 1 WARNING oslo_config.cfg [req-a8348be6-c949-4bcf-805b-7adf410a6d78 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 04:24:31.371 1 WARNING oslo_config.cfg [req-a8348be6-c949-4bcf-805b-7adf410a6d78 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 04:24:31.374 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 04:24:31.381 1 INFO cinder.manager [req-8aea7207-a376-4478-bf3e-acc86ae8105c - - - - -] Initiating service 5 cleanup
>2018-06-26 04:24:31.388 1 INFO cinder.manager [req-8aea7207-a376-4478-bf3e-acc86ae8105c - - - - -] Service 5 cleanup completed.
>2018-06-26 04:26:43.767 1 ERROR oslo.messaging._drivers.impl_rabbit [req-8aea7207-a376-4478-bf3e-acc86ae8105c - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:26:43.770 1 ERROR oslo.messaging._drivers.impl_rabbit [req-8aea7207-a376-4478-bf3e-acc86ae8105c - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:26:43.770 1 ERROR oslo_service.service [req-8aea7207-a376-4478-bf3e-acc86ae8105c - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:26:43.770 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 04:26:43.770 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 04:26:43.770 1 ERROR oslo_service.service     service.start()
>2018-06-26 04:26:43.770 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 04:26:43.770 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 04:26:43.770 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 04:26:43.770 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 04:26:43.770 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 04:26:43.770 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 04:26:43.770 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 04:26:43.770 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 04:26:43.770 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 04:26:43.770 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 04:26:43.770 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 04:26:43.770 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 04:26:43.770 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 04:26:43.770 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 04:26:43.770 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 04:26:43.770 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 04:26:43.770 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 04:26:43.770 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 04:26:43.770 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 04:26:43.770 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 04:26:43.770 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 04:26:43.770 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 04:26:43.770 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:26:43.770 1 ERROR oslo_service.service 
>2018-06-26 04:26:43.773 1 CRITICAL cinder [req-a8348be6-c949-4bcf-805b-7adf410a6d78 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 04:26:43.773 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 04:26:43.773 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 04:26:43.773 1 ERROR cinder     sys.exit(main())
>2018-06-26 04:26:43.773 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 04:26:43.773 1 ERROR cinder     service.wait()
>2018-06-26 04:26:43.773 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 04:26:43.773 1 ERROR cinder     _launcher.wait()
>2018-06-26 04:26:43.773 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 04:26:43.773 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 04:26:43.773 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 04:26:43.773 1 ERROR cinder     self.services.wait()
>2018-06-26 04:26:43.773 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 04:26:43.773 1 ERROR cinder     service.wait()
>2018-06-26 04:26:43.773 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 04:26:43.773 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 04:26:43.773 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 04:26:43.773 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 04:26:43.773 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 04:26:43.773 1 ERROR cinder     post_fn = fn()
>2018-06-26 04:26:43.773 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 04:26:43.773 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 04:26:43.773 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 04:26:43.773 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 04:26:43.773 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 04:26:43.773 1 ERROR cinder 
>2018-06-26 04:26:46.597 1 WARNING cinder.scheduler.host_manager [req-3b2e4707-c19c-4915-9055-45fe1fdac1a1 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 04:26:46.602 1 INFO cinder.rpc [req-3b2e4707-c19c-4915-9055-45fe1fdac1a1 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 04:26:46.607 1 INFO cinder.rpc [req-3b2e4707-c19c-4915-9055-45fe1fdac1a1 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 04:26:46.620 1 INFO cinder.rpc [req-3b2e4707-c19c-4915-9055-45fe1fdac1a1 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 04:26:46.625 1 INFO cinder.rpc [req-3b2e4707-c19c-4915-9055-45fe1fdac1a1 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 04:26:46.653 1 WARNING oslo_config.cfg [req-3b2e4707-c19c-4915-9055-45fe1fdac1a1 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 04:26:46.655 1 WARNING oslo_config.cfg [req-3b2e4707-c19c-4915-9055-45fe1fdac1a1 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:26:46.656 1 WARNING oslo_config.cfg [req-3b2e4707-c19c-4915-9055-45fe1fdac1a1 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:26:46.656 1 WARNING oslo_config.cfg [req-3b2e4707-c19c-4915-9055-45fe1fdac1a1 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:26:46.661 1 WARNING oslo_config.cfg [req-3b2e4707-c19c-4915-9055-45fe1fdac1a1 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 04:26:46.662 1 WARNING oslo_config.cfg [req-3b2e4707-c19c-4915-9055-45fe1fdac1a1 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 04:26:46.665 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 04:26:46.672 1 INFO cinder.manager [req-1514d433-1046-4cd4-b331-03063f3601c2 - - - - -] Initiating service 5 cleanup
>2018-06-26 04:26:46.676 1 INFO cinder.manager [req-1514d433-1046-4cd4-b331-03063f3601c2 - - - - -] Service 5 cleanup completed.
>2018-06-26 04:28:52.579 1 ERROR oslo.messaging._drivers.impl_rabbit [req-1514d433-1046-4cd4-b331-03063f3601c2 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:28:52.581 1 ERROR oslo.messaging._drivers.impl_rabbit [req-1514d433-1046-4cd4-b331-03063f3601c2 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:28:52.582 1 ERROR oslo_service.service [req-1514d433-1046-4cd4-b331-03063f3601c2 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:28:52.582 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 04:28:52.582 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 04:28:52.582 1 ERROR oslo_service.service     service.start()
>2018-06-26 04:28:52.582 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 04:28:52.582 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 04:28:52.582 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 04:28:52.582 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 04:28:52.582 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 04:28:52.582 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 04:28:52.582 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 04:28:52.582 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 04:28:52.582 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 04:28:52.582 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 04:28:52.582 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 04:28:52.582 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 04:28:52.582 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 04:28:52.582 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 04:28:52.582 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 04:28:52.582 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 04:28:52.582 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 04:28:52.582 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 04:28:52.582 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 04:28:52.582 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 04:28:52.582 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 04:28:52.582 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 04:28:52.582 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:28:52.582 1 ERROR oslo_service.service 
>2018-06-26 04:28:52.585 1 CRITICAL cinder [req-3b2e4707-c19c-4915-9055-45fe1fdac1a1 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 04:28:52.585 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 04:28:52.585 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 04:28:52.585 1 ERROR cinder     sys.exit(main())
>2018-06-26 04:28:52.585 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 04:28:52.585 1 ERROR cinder     service.wait()
>2018-06-26 04:28:52.585 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 04:28:52.585 1 ERROR cinder     _launcher.wait()
>2018-06-26 04:28:52.585 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 04:28:52.585 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 04:28:52.585 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 04:28:52.585 1 ERROR cinder     self.services.wait()
>2018-06-26 04:28:52.585 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 04:28:52.585 1 ERROR cinder     service.wait()
>2018-06-26 04:28:52.585 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 04:28:52.585 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 04:28:52.585 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 04:28:52.585 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 04:28:52.585 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 04:28:52.585 1 ERROR cinder     post_fn = fn()
>2018-06-26 04:28:52.585 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 04:28:52.585 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 04:28:52.585 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 04:28:52.585 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 04:28:52.585 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 04:28:52.585 1 ERROR cinder 
>2018-06-26 04:28:55.299 1 WARNING cinder.scheduler.host_manager [req-44264bd7-d9c7-49b9-aec3-4bf8b15494eb - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 04:28:55.305 1 INFO cinder.rpc [req-44264bd7-d9c7-49b9-aec3-4bf8b15494eb - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 04:28:55.311 1 INFO cinder.rpc [req-44264bd7-d9c7-49b9-aec3-4bf8b15494eb - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 04:28:55.326 1 INFO cinder.rpc [req-44264bd7-d9c7-49b9-aec3-4bf8b15494eb - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 04:28:55.333 1 INFO cinder.rpc [req-44264bd7-d9c7-49b9-aec3-4bf8b15494eb - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 04:28:55.362 1 WARNING oslo_config.cfg [req-44264bd7-d9c7-49b9-aec3-4bf8b15494eb - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 04:28:55.366 1 WARNING oslo_config.cfg [req-44264bd7-d9c7-49b9-aec3-4bf8b15494eb - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:28:55.367 1 WARNING oslo_config.cfg [req-44264bd7-d9c7-49b9-aec3-4bf8b15494eb - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:28:55.368 1 WARNING oslo_config.cfg [req-44264bd7-d9c7-49b9-aec3-4bf8b15494eb - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:28:55.378 1 WARNING oslo_config.cfg [req-44264bd7-d9c7-49b9-aec3-4bf8b15494eb - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 04:28:55.380 1 WARNING oslo_config.cfg [req-44264bd7-d9c7-49b9-aec3-4bf8b15494eb - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 04:28:55.383 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 04:28:55.394 1 INFO cinder.manager [req-66c43388-70a2-45ec-8b81-78cccfd84a38 - - - - -] Initiating service 5 cleanup
>2018-06-26 04:28:55.400 1 INFO cinder.manager [req-66c43388-70a2-45ec-8b81-78cccfd84a38 - - - - -] Service 5 cleanup completed.
>2018-06-26 04:30:59.680 1 ERROR oslo.messaging._drivers.impl_rabbit [req-66c43388-70a2-45ec-8b81-78cccfd84a38 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:30:59.682 1 ERROR oslo.messaging._drivers.impl_rabbit [req-66c43388-70a2-45ec-8b81-78cccfd84a38 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:30:59.683 1 ERROR oslo_service.service [req-66c43388-70a2-45ec-8b81-78cccfd84a38 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:30:59.683 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 04:30:59.683 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 04:30:59.683 1 ERROR oslo_service.service     service.start()
>2018-06-26 04:30:59.683 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 04:30:59.683 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 04:30:59.683 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 04:30:59.683 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 04:30:59.683 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 04:30:59.683 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 04:30:59.683 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 04:30:59.683 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 04:30:59.683 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 04:30:59.683 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 04:30:59.683 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 04:30:59.683 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 04:30:59.683 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 04:30:59.683 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 04:30:59.683 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 04:30:59.683 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 04:30:59.683 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 04:30:59.683 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 04:30:59.683 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 04:30:59.683 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 04:30:59.683 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 04:30:59.683 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 04:30:59.683 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:30:59.683 1 ERROR oslo_service.service 
>2018-06-26 04:30:59.686 1 CRITICAL cinder [req-44264bd7-d9c7-49b9-aec3-4bf8b15494eb - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 04:30:59.686 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 04:30:59.686 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 04:30:59.686 1 ERROR cinder     sys.exit(main())
>2018-06-26 04:30:59.686 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 04:30:59.686 1 ERROR cinder     service.wait()
>2018-06-26 04:30:59.686 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 04:30:59.686 1 ERROR cinder     _launcher.wait()
>2018-06-26 04:30:59.686 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 04:30:59.686 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 04:30:59.686 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 04:30:59.686 1 ERROR cinder     self.services.wait()
>2018-06-26 04:30:59.686 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 04:30:59.686 1 ERROR cinder     service.wait()
>2018-06-26 04:30:59.686 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 04:30:59.686 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 04:30:59.686 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 04:30:59.686 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 04:30:59.686 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 04:30:59.686 1 ERROR cinder     post_fn = fn()
>2018-06-26 04:30:59.686 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 04:30:59.686 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 04:30:59.686 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 04:30:59.686 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 04:30:59.686 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 04:30:59.686 1 ERROR cinder 
>2018-06-26 04:31:02.436 1 WARNING cinder.scheduler.host_manager [req-4d874424-a192-43dd-8484-98494dd3d248 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 04:31:02.443 1 INFO cinder.rpc [req-4d874424-a192-43dd-8484-98494dd3d248 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 04:31:02.450 1 INFO cinder.rpc [req-4d874424-a192-43dd-8484-98494dd3d248 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 04:31:02.465 1 INFO cinder.rpc [req-4d874424-a192-43dd-8484-98494dd3d248 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 04:31:02.472 1 INFO cinder.rpc [req-4d874424-a192-43dd-8484-98494dd3d248 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 04:31:02.510 1 WARNING oslo_config.cfg [req-4d874424-a192-43dd-8484-98494dd3d248 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 04:31:02.513 1 WARNING oslo_config.cfg [req-4d874424-a192-43dd-8484-98494dd3d248 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:31:02.513 1 WARNING oslo_config.cfg [req-4d874424-a192-43dd-8484-98494dd3d248 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:31:02.514 1 WARNING oslo_config.cfg [req-4d874424-a192-43dd-8484-98494dd3d248 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:31:02.520 1 WARNING oslo_config.cfg [req-4d874424-a192-43dd-8484-98494dd3d248 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 04:31:02.521 1 WARNING oslo_config.cfg [req-4d874424-a192-43dd-8484-98494dd3d248 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 04:31:02.524 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 04:31:02.531 1 INFO cinder.manager [req-3649de06-7f6d-4aea-bdf3-78bb804fcf33 - - - - -] Initiating service 5 cleanup
>2018-06-26 04:31:02.536 1 INFO cinder.manager [req-3649de06-7f6d-4aea-bdf3-78bb804fcf33 - - - - -] Service 5 cleanup completed.
>2018-06-26 04:33:08.778 1 ERROR oslo.messaging._drivers.impl_rabbit [req-3649de06-7f6d-4aea-bdf3-78bb804fcf33 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:33:08.779 1 ERROR oslo.messaging._drivers.impl_rabbit [req-3649de06-7f6d-4aea-bdf3-78bb804fcf33 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:33:08.780 1 ERROR oslo_service.service [req-3649de06-7f6d-4aea-bdf3-78bb804fcf33 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:33:08.780 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 04:33:08.780 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 04:33:08.780 1 ERROR oslo_service.service     service.start()
>2018-06-26 04:33:08.780 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 04:33:08.780 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 04:33:08.780 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 04:33:08.780 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 04:33:08.780 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 04:33:08.780 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 04:33:08.780 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 04:33:08.780 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 04:33:08.780 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 04:33:08.780 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 04:33:08.780 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 04:33:08.780 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 04:33:08.780 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 04:33:08.780 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 04:33:08.780 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 04:33:08.780 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 04:33:08.780 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 04:33:08.780 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 04:33:08.780 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 04:33:08.780 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 04:33:08.780 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 04:33:08.780 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 04:33:08.780 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:33:08.780 1 ERROR oslo_service.service 
>2018-06-26 04:33:08.783 1 CRITICAL cinder [req-4d874424-a192-43dd-8484-98494dd3d248 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 04:33:08.783 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 04:33:08.783 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 04:33:08.783 1 ERROR cinder     sys.exit(main())
>2018-06-26 04:33:08.783 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 04:33:08.783 1 ERROR cinder     service.wait()
>2018-06-26 04:33:08.783 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 04:33:08.783 1 ERROR cinder     _launcher.wait()
>2018-06-26 04:33:08.783 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 04:33:08.783 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 04:33:08.783 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 04:33:08.783 1 ERROR cinder     self.services.wait()
>2018-06-26 04:33:08.783 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 04:33:08.783 1 ERROR cinder     service.wait()
>2018-06-26 04:33:08.783 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 04:33:08.783 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 04:33:08.783 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 04:33:08.783 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 04:33:08.783 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 04:33:08.783 1 ERROR cinder     post_fn = fn()
>2018-06-26 04:33:08.783 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 04:33:08.783 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 04:33:08.783 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 04:33:08.783 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 04:33:08.783 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 04:33:08.783 1 ERROR cinder 
>2018-06-26 04:33:11.494 1 WARNING cinder.scheduler.host_manager [req-8e754f1c-2134-4c15-8b4b-f8865d17d99f - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 04:33:11.499 1 INFO cinder.rpc [req-8e754f1c-2134-4c15-8b4b-f8865d17d99f - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 04:33:11.504 1 INFO cinder.rpc [req-8e754f1c-2134-4c15-8b4b-f8865d17d99f - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 04:33:11.517 1 INFO cinder.rpc [req-8e754f1c-2134-4c15-8b4b-f8865d17d99f - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 04:33:11.523 1 INFO cinder.rpc [req-8e754f1c-2134-4c15-8b4b-f8865d17d99f - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 04:33:11.548 1 WARNING oslo_config.cfg [req-8e754f1c-2134-4c15-8b4b-f8865d17d99f - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 04:33:11.550 1 WARNING oslo_config.cfg [req-8e754f1c-2134-4c15-8b4b-f8865d17d99f - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:33:11.551 1 WARNING oslo_config.cfg [req-8e754f1c-2134-4c15-8b4b-f8865d17d99f - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:33:11.551 1 WARNING oslo_config.cfg [req-8e754f1c-2134-4c15-8b4b-f8865d17d99f - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:33:11.556 1 WARNING oslo_config.cfg [req-8e754f1c-2134-4c15-8b4b-f8865d17d99f - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 04:33:11.558 1 WARNING oslo_config.cfg [req-8e754f1c-2134-4c15-8b4b-f8865d17d99f - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 04:33:11.561 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 04:33:11.574 1 INFO cinder.manager [req-460827e2-9b2e-46ae-ae79-dc927eceafcb - - - - -] Initiating service 5 cleanup
>2018-06-26 04:33:11.581 1 INFO cinder.manager [req-460827e2-9b2e-46ae-ae79-dc927eceafcb - - - - -] Service 5 cleanup completed.
>2018-06-26 04:35:17.719 1 ERROR oslo.messaging._drivers.impl_rabbit [req-460827e2-9b2e-46ae-ae79-dc927eceafcb - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:35:17.726 1 ERROR oslo.messaging._drivers.impl_rabbit [req-460827e2-9b2e-46ae-ae79-dc927eceafcb - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:35:17.726 1 ERROR oslo_service.service [req-460827e2-9b2e-46ae-ae79-dc927eceafcb - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:35:17.726 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 04:35:17.726 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 04:35:17.726 1 ERROR oslo_service.service     service.start()
>2018-06-26 04:35:17.726 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 04:35:17.726 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 04:35:17.726 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 04:35:17.726 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 04:35:17.726 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 04:35:17.726 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 04:35:17.726 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 04:35:17.726 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 04:35:17.726 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 04:35:17.726 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 04:35:17.726 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 04:35:17.726 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 04:35:17.726 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 04:35:17.726 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 04:35:17.726 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 04:35:17.726 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 04:35:17.726 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 04:35:17.726 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 04:35:17.726 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 04:35:17.726 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 04:35:17.726 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 04:35:17.726 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 04:35:17.726 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:35:17.726 1 ERROR oslo_service.service 
>2018-06-26 04:35:17.729 1 CRITICAL cinder [req-8e754f1c-2134-4c15-8b4b-f8865d17d99f - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 04:35:17.729 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 04:35:17.729 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 04:35:17.729 1 ERROR cinder     sys.exit(main())
>2018-06-26 04:35:17.729 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 04:35:17.729 1 ERROR cinder     service.wait()
>2018-06-26 04:35:17.729 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 04:35:17.729 1 ERROR cinder     _launcher.wait()
>2018-06-26 04:35:17.729 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 04:35:17.729 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 04:35:17.729 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 04:35:17.729 1 ERROR cinder     self.services.wait()
>2018-06-26 04:35:17.729 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 04:35:17.729 1 ERROR cinder     service.wait()
>2018-06-26 04:35:17.729 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 04:35:17.729 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 04:35:17.729 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 04:35:17.729 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 04:35:17.729 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 04:35:17.729 1 ERROR cinder     post_fn = fn()
>2018-06-26 04:35:17.729 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 04:35:17.729 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 04:35:17.729 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 04:35:17.729 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 04:35:17.729 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 04:35:17.729 1 ERROR cinder 
>2018-06-26 04:35:20.546 1 WARNING cinder.scheduler.host_manager [req-a168fec5-3b47-4675-9f89-a41d777a3811 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 04:35:20.554 1 INFO cinder.rpc [req-a168fec5-3b47-4675-9f89-a41d777a3811 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 04:35:20.560 1 INFO cinder.rpc [req-a168fec5-3b47-4675-9f89-a41d777a3811 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 04:35:20.574 1 INFO cinder.rpc [req-a168fec5-3b47-4675-9f89-a41d777a3811 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 04:35:20.583 1 INFO cinder.rpc [req-a168fec5-3b47-4675-9f89-a41d777a3811 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 04:35:20.618 1 WARNING oslo_config.cfg [req-a168fec5-3b47-4675-9f89-a41d777a3811 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 04:35:20.620 1 WARNING oslo_config.cfg [req-a168fec5-3b47-4675-9f89-a41d777a3811 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:35:20.621 1 WARNING oslo_config.cfg [req-a168fec5-3b47-4675-9f89-a41d777a3811 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:35:20.621 1 WARNING oslo_config.cfg [req-a168fec5-3b47-4675-9f89-a41d777a3811 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:35:20.627 1 WARNING oslo_config.cfg [req-a168fec5-3b47-4675-9f89-a41d777a3811 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 04:35:20.628 1 WARNING oslo_config.cfg [req-a168fec5-3b47-4675-9f89-a41d777a3811 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 04:35:20.631 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 04:35:20.652 1 INFO cinder.manager [req-8fad876b-4e3f-4e31-baf3-a649646ab2ab - - - - -] Initiating service 5 cleanup
>2018-06-26 04:35:20.656 1 INFO cinder.manager [req-8fad876b-4e3f-4e31-baf3-a649646ab2ab - - - - -] Service 5 cleanup completed.
>2018-06-26 04:37:26.807 1 ERROR oslo.messaging._drivers.impl_rabbit [req-8fad876b-4e3f-4e31-baf3-a649646ab2ab - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:37:26.810 1 ERROR oslo.messaging._drivers.impl_rabbit [req-8fad876b-4e3f-4e31-baf3-a649646ab2ab - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:37:26.811 1 ERROR oslo_service.service [req-8fad876b-4e3f-4e31-baf3-a649646ab2ab - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:37:26.811 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 04:37:26.811 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 04:37:26.811 1 ERROR oslo_service.service     service.start()
>2018-06-26 04:37:26.811 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 04:37:26.811 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 04:37:26.811 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 04:37:26.811 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 04:37:26.811 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 04:37:26.811 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 04:37:26.811 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 04:37:26.811 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 04:37:26.811 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 04:37:26.811 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 04:37:26.811 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 04:37:26.811 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 04:37:26.811 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 04:37:26.811 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 04:37:26.811 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 04:37:26.811 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 04:37:26.811 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 04:37:26.811 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 04:37:26.811 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 04:37:26.811 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 04:37:26.811 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 04:37:26.811 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 04:37:26.811 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:37:26.811 1 ERROR oslo_service.service 
>2018-06-26 04:37:26.815 1 CRITICAL cinder [req-a168fec5-3b47-4675-9f89-a41d777a3811 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 04:37:26.815 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 04:37:26.815 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 04:37:26.815 1 ERROR cinder     sys.exit(main())
>2018-06-26 04:37:26.815 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 04:37:26.815 1 ERROR cinder     service.wait()
>2018-06-26 04:37:26.815 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 04:37:26.815 1 ERROR cinder     _launcher.wait()
>2018-06-26 04:37:26.815 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 04:37:26.815 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 04:37:26.815 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 04:37:26.815 1 ERROR cinder     self.services.wait()
>2018-06-26 04:37:26.815 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 04:37:26.815 1 ERROR cinder     service.wait()
>2018-06-26 04:37:26.815 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 04:37:26.815 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 04:37:26.815 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 04:37:26.815 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 04:37:26.815 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 04:37:26.815 1 ERROR cinder     post_fn = fn()
>2018-06-26 04:37:26.815 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 04:37:26.815 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 04:37:26.815 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 04:37:26.815 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 04:37:26.815 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 04:37:26.815 1 ERROR cinder 
>2018-06-26 04:37:29.610 1 WARNING cinder.scheduler.host_manager [req-2a30943a-ab44-44d0-8873-3c11711d38f2 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 04:37:29.615 1 INFO cinder.rpc [req-2a30943a-ab44-44d0-8873-3c11711d38f2 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 04:37:29.621 1 INFO cinder.rpc [req-2a30943a-ab44-44d0-8873-3c11711d38f2 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 04:37:29.632 1 INFO cinder.rpc [req-2a30943a-ab44-44d0-8873-3c11711d38f2 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 04:37:29.638 1 INFO cinder.rpc [req-2a30943a-ab44-44d0-8873-3c11711d38f2 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 04:37:29.664 1 WARNING oslo_config.cfg [req-2a30943a-ab44-44d0-8873-3c11711d38f2 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 04:37:29.666 1 WARNING oslo_config.cfg [req-2a30943a-ab44-44d0-8873-3c11711d38f2 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:37:29.667 1 WARNING oslo_config.cfg [req-2a30943a-ab44-44d0-8873-3c11711d38f2 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:37:29.667 1 WARNING oslo_config.cfg [req-2a30943a-ab44-44d0-8873-3c11711d38f2 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:37:29.672 1 WARNING oslo_config.cfg [req-2a30943a-ab44-44d0-8873-3c11711d38f2 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 04:37:29.674 1 WARNING oslo_config.cfg [req-2a30943a-ab44-44d0-8873-3c11711d38f2 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 04:37:29.676 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 04:37:29.683 1 INFO cinder.manager [req-683e143e-8f5c-462c-ba0c-4d8308856c27 - - - - -] Initiating service 5 cleanup
>2018-06-26 04:37:29.688 1 INFO cinder.manager [req-683e143e-8f5c-462c-ba0c-4d8308856c27 - - - - -] Service 5 cleanup completed.
>2018-06-26 04:39:35.849 1 ERROR oslo.messaging._drivers.impl_rabbit [req-683e143e-8f5c-462c-ba0c-4d8308856c27 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:39:35.851 1 ERROR oslo.messaging._drivers.impl_rabbit [req-683e143e-8f5c-462c-ba0c-4d8308856c27 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:39:35.851 1 ERROR oslo_service.service [req-683e143e-8f5c-462c-ba0c-4d8308856c27 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:39:35.851 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 04:39:35.851 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 04:39:35.851 1 ERROR oslo_service.service     service.start()
>2018-06-26 04:39:35.851 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 04:39:35.851 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 04:39:35.851 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 04:39:35.851 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 04:39:35.851 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 04:39:35.851 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 04:39:35.851 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 04:39:35.851 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 04:39:35.851 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 04:39:35.851 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 04:39:35.851 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 04:39:35.851 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 04:39:35.851 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 04:39:35.851 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 04:39:35.851 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 04:39:35.851 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 04:39:35.851 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 04:39:35.851 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 04:39:35.851 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 04:39:35.851 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 04:39:35.851 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 04:39:35.851 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 04:39:35.851 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:39:35.851 1 ERROR oslo_service.service 
>2018-06-26 04:39:35.854 1 CRITICAL cinder [req-2a30943a-ab44-44d0-8873-3c11711d38f2 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 04:39:35.854 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 04:39:35.854 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 04:39:35.854 1 ERROR cinder     sys.exit(main())
>2018-06-26 04:39:35.854 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 04:39:35.854 1 ERROR cinder     service.wait()
>2018-06-26 04:39:35.854 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 04:39:35.854 1 ERROR cinder     _launcher.wait()
>2018-06-26 04:39:35.854 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 04:39:35.854 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 04:39:35.854 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 04:39:35.854 1 ERROR cinder     self.services.wait()
>2018-06-26 04:39:35.854 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 04:39:35.854 1 ERROR cinder     service.wait()
>2018-06-26 04:39:35.854 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 04:39:35.854 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 04:39:35.854 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 04:39:35.854 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 04:39:35.854 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 04:39:35.854 1 ERROR cinder     post_fn = fn()
>2018-06-26 04:39:35.854 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 04:39:35.854 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 04:39:35.854 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 04:39:35.854 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 04:39:35.854 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 04:39:35.854 1 ERROR cinder 
>2018-06-26 04:39:38.474 1 WARNING cinder.scheduler.host_manager [req-882cde0e-c82a-4fb7-9411-98a0868626ee - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 04:39:38.495 1 INFO cinder.rpc [req-882cde0e-c82a-4fb7-9411-98a0868626ee - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 04:39:38.503 1 INFO cinder.rpc [req-882cde0e-c82a-4fb7-9411-98a0868626ee - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 04:39:38.525 1 INFO cinder.rpc [req-882cde0e-c82a-4fb7-9411-98a0868626ee - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 04:39:38.532 1 INFO cinder.rpc [req-882cde0e-c82a-4fb7-9411-98a0868626ee - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 04:39:38.563 1 WARNING oslo_config.cfg [req-882cde0e-c82a-4fb7-9411-98a0868626ee - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 04:39:38.565 1 WARNING oslo_config.cfg [req-882cde0e-c82a-4fb7-9411-98a0868626ee - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:39:38.566 1 WARNING oslo_config.cfg [req-882cde0e-c82a-4fb7-9411-98a0868626ee - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:39:38.566 1 WARNING oslo_config.cfg [req-882cde0e-c82a-4fb7-9411-98a0868626ee - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:39:38.571 1 WARNING oslo_config.cfg [req-882cde0e-c82a-4fb7-9411-98a0868626ee - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 04:39:38.573 1 WARNING oslo_config.cfg [req-882cde0e-c82a-4fb7-9411-98a0868626ee - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 04:39:38.575 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 04:39:38.582 1 INFO cinder.manager [req-d1a0f85b-0dd6-4703-997e-ea3f0e7644be - - - - -] Initiating service 5 cleanup
>2018-06-26 04:39:38.588 1 INFO cinder.manager [req-d1a0f85b-0dd6-4703-997e-ea3f0e7644be - - - - -] Service 5 cleanup completed.
>2018-06-26 04:41:42.992 1 ERROR oslo.messaging._drivers.impl_rabbit [req-d1a0f85b-0dd6-4703-997e-ea3f0e7644be - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:41:42.995 1 ERROR oslo.messaging._drivers.impl_rabbit [req-d1a0f85b-0dd6-4703-997e-ea3f0e7644be - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:41:42.995 1 ERROR oslo_service.service [req-d1a0f85b-0dd6-4703-997e-ea3f0e7644be - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:41:42.995 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 04:41:42.995 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 04:41:42.995 1 ERROR oslo_service.service     service.start()
>2018-06-26 04:41:42.995 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 04:41:42.995 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 04:41:42.995 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 04:41:42.995 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 04:41:42.995 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 04:41:42.995 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 04:41:42.995 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 04:41:42.995 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 04:41:42.995 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 04:41:42.995 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 04:41:42.995 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 04:41:42.995 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 04:41:42.995 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 04:41:42.995 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 04:41:42.995 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 04:41:42.995 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 04:41:42.995 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 04:41:42.995 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 04:41:42.995 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 04:41:42.995 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 04:41:42.995 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 04:41:42.995 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 04:41:42.995 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:41:42.995 1 ERROR oslo_service.service 
>2018-06-26 04:41:42.999 1 CRITICAL cinder [req-882cde0e-c82a-4fb7-9411-98a0868626ee - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 04:41:42.999 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 04:41:42.999 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 04:41:42.999 1 ERROR cinder     sys.exit(main())
>2018-06-26 04:41:42.999 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 04:41:42.999 1 ERROR cinder     service.wait()
>2018-06-26 04:41:42.999 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 04:41:42.999 1 ERROR cinder     _launcher.wait()
>2018-06-26 04:41:42.999 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 04:41:42.999 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 04:41:42.999 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 04:41:42.999 1 ERROR cinder     self.services.wait()
>2018-06-26 04:41:42.999 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 04:41:42.999 1 ERROR cinder     service.wait()
>2018-06-26 04:41:42.999 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 04:41:42.999 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 04:41:42.999 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 04:41:42.999 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 04:41:42.999 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 04:41:42.999 1 ERROR cinder     post_fn = fn()
>2018-06-26 04:41:42.999 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 04:41:42.999 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 04:41:42.999 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 04:41:42.999 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 04:41:42.999 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 04:41:42.999 1 ERROR cinder 
>2018-06-26 04:41:45.645 1 WARNING cinder.scheduler.host_manager [req-ed07ba56-e742-4163-af5f-a10d0f65fc80 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 04:41:45.651 1 INFO cinder.rpc [req-ed07ba56-e742-4163-af5f-a10d0f65fc80 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 04:41:45.656 1 INFO cinder.rpc [req-ed07ba56-e742-4163-af5f-a10d0f65fc80 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 04:41:45.668 1 INFO cinder.rpc [req-ed07ba56-e742-4163-af5f-a10d0f65fc80 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 04:41:45.674 1 INFO cinder.rpc [req-ed07ba56-e742-4163-af5f-a10d0f65fc80 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 04:41:45.697 1 WARNING oslo_config.cfg [req-ed07ba56-e742-4163-af5f-a10d0f65fc80 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 04:41:45.699 1 WARNING oslo_config.cfg [req-ed07ba56-e742-4163-af5f-a10d0f65fc80 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:41:45.700 1 WARNING oslo_config.cfg [req-ed07ba56-e742-4163-af5f-a10d0f65fc80 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:41:45.700 1 WARNING oslo_config.cfg [req-ed07ba56-e742-4163-af5f-a10d0f65fc80 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:41:45.705 1 WARNING oslo_config.cfg [req-ed07ba56-e742-4163-af5f-a10d0f65fc80 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 04:41:45.707 1 WARNING oslo_config.cfg [req-ed07ba56-e742-4163-af5f-a10d0f65fc80 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 04:41:45.709 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 04:41:45.715 1 INFO cinder.manager [req-76369666-b4cb-470b-99dd-2d11e5c0e5b0 - - - - -] Initiating service 5 cleanup
>2018-06-26 04:41:45.721 1 INFO cinder.manager [req-76369666-b4cb-470b-99dd-2d11e5c0e5b0 - - - - -] Service 5 cleanup completed.
>2018-06-26 04:43:51.946 1 ERROR oslo.messaging._drivers.impl_rabbit [req-76369666-b4cb-470b-99dd-2d11e5c0e5b0 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:43:51.948 1 ERROR oslo.messaging._drivers.impl_rabbit [req-76369666-b4cb-470b-99dd-2d11e5c0e5b0 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:43:51.948 1 ERROR oslo_service.service [req-76369666-b4cb-470b-99dd-2d11e5c0e5b0 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:43:51.948 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 04:43:51.948 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 04:43:51.948 1 ERROR oslo_service.service     service.start()
>2018-06-26 04:43:51.948 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 04:43:51.948 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 04:43:51.948 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 04:43:51.948 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 04:43:51.948 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 04:43:51.948 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 04:43:51.948 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 04:43:51.948 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 04:43:51.948 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 04:43:51.948 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 04:43:51.948 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 04:43:51.948 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 04:43:51.948 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 04:43:51.948 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 04:43:51.948 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 04:43:51.948 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 04:43:51.948 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 04:43:51.948 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 04:43:51.948 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 04:43:51.948 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 04:43:51.948 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 04:43:51.948 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 04:43:51.948 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:43:51.948 1 ERROR oslo_service.service 
>2018-06-26 04:43:51.952 1 CRITICAL cinder [req-ed07ba56-e742-4163-af5f-a10d0f65fc80 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 04:43:51.952 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 04:43:51.952 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 04:43:51.952 1 ERROR cinder     sys.exit(main())
>2018-06-26 04:43:51.952 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 04:43:51.952 1 ERROR cinder     service.wait()
>2018-06-26 04:43:51.952 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 04:43:51.952 1 ERROR cinder     _launcher.wait()
>2018-06-26 04:43:51.952 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 04:43:51.952 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 04:43:51.952 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 04:43:51.952 1 ERROR cinder     self.services.wait()
>2018-06-26 04:43:51.952 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 04:43:51.952 1 ERROR cinder     service.wait()
>2018-06-26 04:43:51.952 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 04:43:51.952 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 04:43:51.952 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 04:43:51.952 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 04:43:51.952 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 04:43:51.952 1 ERROR cinder     post_fn = fn()
>2018-06-26 04:43:51.952 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 04:43:51.952 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 04:43:51.952 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 04:43:51.952 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 04:43:51.952 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 04:43:51.952 1 ERROR cinder 
>2018-06-26 04:43:54.650 1 WARNING cinder.scheduler.host_manager [req-c1ca6e0c-b4ca-4673-af63-89352e661b20 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 04:43:54.656 1 INFO cinder.rpc [req-c1ca6e0c-b4ca-4673-af63-89352e661b20 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 04:43:54.663 1 INFO cinder.rpc [req-c1ca6e0c-b4ca-4673-af63-89352e661b20 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 04:43:54.679 1 INFO cinder.rpc [req-c1ca6e0c-b4ca-4673-af63-89352e661b20 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 04:43:54.686 1 INFO cinder.rpc [req-c1ca6e0c-b4ca-4673-af63-89352e661b20 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 04:43:54.717 1 WARNING oslo_config.cfg [req-c1ca6e0c-b4ca-4673-af63-89352e661b20 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 04:43:54.719 1 WARNING oslo_config.cfg [req-c1ca6e0c-b4ca-4673-af63-89352e661b20 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:43:54.720 1 WARNING oslo_config.cfg [req-c1ca6e0c-b4ca-4673-af63-89352e661b20 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:43:54.720 1 WARNING oslo_config.cfg [req-c1ca6e0c-b4ca-4673-af63-89352e661b20 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:43:54.725 1 WARNING oslo_config.cfg [req-c1ca6e0c-b4ca-4673-af63-89352e661b20 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 04:43:54.726 1 WARNING oslo_config.cfg [req-c1ca6e0c-b4ca-4673-af63-89352e661b20 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 04:43:54.729 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 04:43:54.736 1 INFO cinder.manager [req-1952e36b-0262-4203-b439-47e75a141803 - - - - -] Initiating service 5 cleanup
>2018-06-26 04:43:54.741 1 INFO cinder.manager [req-1952e36b-0262-4203-b439-47e75a141803 - - - - -] Service 5 cleanup completed.
>2018-06-26 04:45:59.202 1 ERROR oslo.messaging._drivers.impl_rabbit [req-1952e36b-0262-4203-b439-47e75a141803 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:45:59.204 1 ERROR oslo.messaging._drivers.impl_rabbit [req-1952e36b-0262-4203-b439-47e75a141803 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:45:59.204 1 ERROR oslo_service.service [req-1952e36b-0262-4203-b439-47e75a141803 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:45:59.204 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 04:45:59.204 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 04:45:59.204 1 ERROR oslo_service.service     service.start()
>2018-06-26 04:45:59.204 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 04:45:59.204 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 04:45:59.204 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 04:45:59.204 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 04:45:59.204 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 04:45:59.204 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 04:45:59.204 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 04:45:59.204 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 04:45:59.204 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 04:45:59.204 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 04:45:59.204 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 04:45:59.204 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 04:45:59.204 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 04:45:59.204 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 04:45:59.204 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 04:45:59.204 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 04:45:59.204 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 04:45:59.204 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 04:45:59.204 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 04:45:59.204 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 04:45:59.204 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 04:45:59.204 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 04:45:59.204 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:45:59.204 1 ERROR oslo_service.service 
>2018-06-26 04:45:59.207 1 CRITICAL cinder [req-c1ca6e0c-b4ca-4673-af63-89352e661b20 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 04:45:59.207 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 04:45:59.207 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 04:45:59.207 1 ERROR cinder     sys.exit(main())
>2018-06-26 04:45:59.207 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 04:45:59.207 1 ERROR cinder     service.wait()
>2018-06-26 04:45:59.207 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 04:45:59.207 1 ERROR cinder     _launcher.wait()
>2018-06-26 04:45:59.207 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 04:45:59.207 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 04:45:59.207 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 04:45:59.207 1 ERROR cinder     self.services.wait()
>2018-06-26 04:45:59.207 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 04:45:59.207 1 ERROR cinder     service.wait()
>2018-06-26 04:45:59.207 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 04:45:59.207 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 04:45:59.207 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 04:45:59.207 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 04:45:59.207 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 04:45:59.207 1 ERROR cinder     post_fn = fn()
>2018-06-26 04:45:59.207 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 04:45:59.207 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 04:45:59.207 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 04:45:59.207 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 04:45:59.207 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 04:45:59.207 1 ERROR cinder 
>2018-06-26 04:46:02.037 1 WARNING cinder.scheduler.host_manager [req-c21dcb58-09ba-48dc-b44d-26d70d708a9d - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 04:46:02.045 1 INFO cinder.rpc [req-c21dcb58-09ba-48dc-b44d-26d70d708a9d - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 04:46:02.052 1 INFO cinder.rpc [req-c21dcb58-09ba-48dc-b44d-26d70d708a9d - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 04:46:02.065 1 INFO cinder.rpc [req-c21dcb58-09ba-48dc-b44d-26d70d708a9d - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 04:46:02.074 1 INFO cinder.rpc [req-c21dcb58-09ba-48dc-b44d-26d70d708a9d - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 04:46:02.100 1 WARNING oslo_config.cfg [req-c21dcb58-09ba-48dc-b44d-26d70d708a9d - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 04:46:02.102 1 WARNING oslo_config.cfg [req-c21dcb58-09ba-48dc-b44d-26d70d708a9d - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:46:02.103 1 WARNING oslo_config.cfg [req-c21dcb58-09ba-48dc-b44d-26d70d708a9d - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:46:02.104 1 WARNING oslo_config.cfg [req-c21dcb58-09ba-48dc-b44d-26d70d708a9d - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:46:02.109 1 WARNING oslo_config.cfg [req-c21dcb58-09ba-48dc-b44d-26d70d708a9d - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 04:46:02.111 1 WARNING oslo_config.cfg [req-c21dcb58-09ba-48dc-b44d-26d70d708a9d - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 04:46:02.114 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 04:46:02.121 1 INFO cinder.manager [req-f28ae780-3849-4f96-b169-9389a68310b1 - - - - -] Initiating service 5 cleanup
>2018-06-26 04:46:02.128 1 INFO cinder.manager [req-f28ae780-3849-4f96-b169-9389a68310b1 - - - - -] Service 5 cleanup completed.
>2018-06-26 04:48:06.581 1 ERROR oslo.messaging._drivers.impl_rabbit [req-f28ae780-3849-4f96-b169-9389a68310b1 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:48:06.583 1 ERROR oslo.messaging._drivers.impl_rabbit [req-f28ae780-3849-4f96-b169-9389a68310b1 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:48:06.583 1 ERROR oslo_service.service [req-f28ae780-3849-4f96-b169-9389a68310b1 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:48:06.583 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 04:48:06.583 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 04:48:06.583 1 ERROR oslo_service.service     service.start()
>2018-06-26 04:48:06.583 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 04:48:06.583 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 04:48:06.583 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 04:48:06.583 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 04:48:06.583 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 04:48:06.583 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 04:48:06.583 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 04:48:06.583 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 04:48:06.583 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 04:48:06.583 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 04:48:06.583 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 04:48:06.583 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 04:48:06.583 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 04:48:06.583 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 04:48:06.583 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 04:48:06.583 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 04:48:06.583 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 04:48:06.583 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 04:48:06.583 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 04:48:06.583 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 04:48:06.583 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 04:48:06.583 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 04:48:06.583 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:48:06.583 1 ERROR oslo_service.service 
>2018-06-26 04:48:06.586 1 CRITICAL cinder [req-c21dcb58-09ba-48dc-b44d-26d70d708a9d - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 04:48:06.586 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 04:48:06.586 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 04:48:06.586 1 ERROR cinder     sys.exit(main())
>2018-06-26 04:48:06.586 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 04:48:06.586 1 ERROR cinder     service.wait()
>2018-06-26 04:48:06.586 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 04:48:06.586 1 ERROR cinder     _launcher.wait()
>2018-06-26 04:48:06.586 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 04:48:06.586 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 04:48:06.586 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 04:48:06.586 1 ERROR cinder     self.services.wait()
>2018-06-26 04:48:06.586 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 04:48:06.586 1 ERROR cinder     service.wait()
>2018-06-26 04:48:06.586 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 04:48:06.586 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 04:48:06.586 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 04:48:06.586 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 04:48:06.586 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 04:48:06.586 1 ERROR cinder     post_fn = fn()
>2018-06-26 04:48:06.586 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 04:48:06.586 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 04:48:06.586 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 04:48:06.586 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 04:48:06.586 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 04:48:06.586 1 ERROR cinder 
>2018-06-26 04:48:09.167 1 WARNING cinder.scheduler.host_manager [req-64d8bee6-5fd3-48da-badd-c08195b603c5 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 04:48:09.173 1 INFO cinder.rpc [req-64d8bee6-5fd3-48da-badd-c08195b603c5 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 04:48:09.178 1 INFO cinder.rpc [req-64d8bee6-5fd3-48da-badd-c08195b603c5 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 04:48:09.192 1 INFO cinder.rpc [req-64d8bee6-5fd3-48da-badd-c08195b603c5 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 04:48:09.199 1 INFO cinder.rpc [req-64d8bee6-5fd3-48da-badd-c08195b603c5 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 04:48:09.224 1 WARNING oslo_config.cfg [req-64d8bee6-5fd3-48da-badd-c08195b603c5 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 04:48:09.226 1 WARNING oslo_config.cfg [req-64d8bee6-5fd3-48da-badd-c08195b603c5 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:48:09.226 1 WARNING oslo_config.cfg [req-64d8bee6-5fd3-48da-badd-c08195b603c5 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:48:09.227 1 WARNING oslo_config.cfg [req-64d8bee6-5fd3-48da-badd-c08195b603c5 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:48:09.232 1 WARNING oslo_config.cfg [req-64d8bee6-5fd3-48da-badd-c08195b603c5 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 04:48:09.233 1 WARNING oslo_config.cfg [req-64d8bee6-5fd3-48da-badd-c08195b603c5 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 04:48:09.236 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 04:48:09.242 1 INFO cinder.manager [req-c50e6df6-b67e-4e86-ad28-fe5238b8d689 - - - - -] Initiating service 5 cleanup
>2018-06-26 04:48:09.247 1 INFO cinder.manager [req-c50e6df6-b67e-4e86-ad28-fe5238b8d689 - - - - -] Service 5 cleanup completed.
>2018-06-26 04:50:15.416 1 ERROR oslo.messaging._drivers.impl_rabbit [req-c50e6df6-b67e-4e86-ad28-fe5238b8d689 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:50:15.418 1 ERROR oslo.messaging._drivers.impl_rabbit [req-c50e6df6-b67e-4e86-ad28-fe5238b8d689 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:50:15.418 1 ERROR oslo_service.service [req-c50e6df6-b67e-4e86-ad28-fe5238b8d689 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:50:15.418 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 04:50:15.418 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 04:50:15.418 1 ERROR oslo_service.service     service.start()
>2018-06-26 04:50:15.418 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 04:50:15.418 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 04:50:15.418 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 04:50:15.418 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 04:50:15.418 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 04:50:15.418 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 04:50:15.418 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 04:50:15.418 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 04:50:15.418 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 04:50:15.418 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 04:50:15.418 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 04:50:15.418 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 04:50:15.418 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 04:50:15.418 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 04:50:15.418 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 04:50:15.418 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 04:50:15.418 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 04:50:15.418 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 04:50:15.418 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 04:50:15.418 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 04:50:15.418 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 04:50:15.418 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 04:50:15.418 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:50:15.418 1 ERROR oslo_service.service 
>2018-06-26 04:50:15.421 1 CRITICAL cinder [req-64d8bee6-5fd3-48da-badd-c08195b603c5 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 04:50:15.421 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 04:50:15.421 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 04:50:15.421 1 ERROR cinder     sys.exit(main())
>2018-06-26 04:50:15.421 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 04:50:15.421 1 ERROR cinder     service.wait()
>2018-06-26 04:50:15.421 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 04:50:15.421 1 ERROR cinder     _launcher.wait()
>2018-06-26 04:50:15.421 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 04:50:15.421 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 04:50:15.421 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 04:50:15.421 1 ERROR cinder     self.services.wait()
>2018-06-26 04:50:15.421 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 04:50:15.421 1 ERROR cinder     service.wait()
>2018-06-26 04:50:15.421 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 04:50:15.421 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 04:50:15.421 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 04:50:15.421 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 04:50:15.421 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 04:50:15.421 1 ERROR cinder     post_fn = fn()
>2018-06-26 04:50:15.421 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 04:50:15.421 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 04:50:15.421 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 04:50:15.421 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 04:50:15.421 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 04:50:15.421 1 ERROR cinder 
>2018-06-26 04:50:17.992 1 WARNING cinder.scheduler.host_manager [req-1a70e971-8206-4baa-aa69-5d18231a84ee - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 04:50:17.998 1 INFO cinder.rpc [req-1a70e971-8206-4baa-aa69-5d18231a84ee - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 04:50:18.008 1 INFO cinder.rpc [req-1a70e971-8206-4baa-aa69-5d18231a84ee - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 04:50:18.020 1 INFO cinder.rpc [req-1a70e971-8206-4baa-aa69-5d18231a84ee - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 04:50:18.027 1 INFO cinder.rpc [req-1a70e971-8206-4baa-aa69-5d18231a84ee - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 04:50:18.052 1 WARNING oslo_config.cfg [req-1a70e971-8206-4baa-aa69-5d18231a84ee - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 04:50:18.054 1 WARNING oslo_config.cfg [req-1a70e971-8206-4baa-aa69-5d18231a84ee - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:50:18.054 1 WARNING oslo_config.cfg [req-1a70e971-8206-4baa-aa69-5d18231a84ee - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:50:18.055 1 WARNING oslo_config.cfg [req-1a70e971-8206-4baa-aa69-5d18231a84ee - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:50:18.060 1 WARNING oslo_config.cfg [req-1a70e971-8206-4baa-aa69-5d18231a84ee - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 04:50:18.061 1 WARNING oslo_config.cfg [req-1a70e971-8206-4baa-aa69-5d18231a84ee - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 04:50:18.064 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 04:50:18.072 1 INFO cinder.manager [req-5dc7cb5e-0b30-4fa4-ab0f-d3536130b568 - - - - -] Initiating service 5 cleanup
>2018-06-26 04:50:18.077 1 INFO cinder.manager [req-5dc7cb5e-0b30-4fa4-ab0f-d3536130b568 - - - - -] Service 5 cleanup completed.
>2018-06-26 04:52:29.963 1 ERROR oslo.messaging._drivers.impl_rabbit [req-5dc7cb5e-0b30-4fa4-ab0f-d3536130b568 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:52:29.965 1 ERROR oslo.messaging._drivers.impl_rabbit [req-5dc7cb5e-0b30-4fa4-ab0f-d3536130b568 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:52:29.966 1 ERROR oslo_service.service [req-5dc7cb5e-0b30-4fa4-ab0f-d3536130b568 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:52:29.966 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 04:52:29.966 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 04:52:29.966 1 ERROR oslo_service.service     service.start()
>2018-06-26 04:52:29.966 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 04:52:29.966 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 04:52:29.966 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 04:52:29.966 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 04:52:29.966 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 04:52:29.966 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 04:52:29.966 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 04:52:29.966 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 04:52:29.966 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 04:52:29.966 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 04:52:29.966 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 04:52:29.966 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 04:52:29.966 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 04:52:29.966 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 04:52:29.966 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 04:52:29.966 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 04:52:29.966 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 04:52:29.966 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 04:52:29.966 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 04:52:29.966 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 04:52:29.966 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 04:52:29.966 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 04:52:29.966 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:52:29.966 1 ERROR oslo_service.service 
>2018-06-26 04:52:29.969 1 CRITICAL cinder [req-1a70e971-8206-4baa-aa69-5d18231a84ee - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 04:52:29.969 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 04:52:29.969 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 04:52:29.969 1 ERROR cinder     sys.exit(main())
>2018-06-26 04:52:29.969 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 04:52:29.969 1 ERROR cinder     service.wait()
>2018-06-26 04:52:29.969 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 04:52:29.969 1 ERROR cinder     _launcher.wait()
>2018-06-26 04:52:29.969 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 04:52:29.969 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 04:52:29.969 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 04:52:29.969 1 ERROR cinder     self.services.wait()
>2018-06-26 04:52:29.969 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 04:52:29.969 1 ERROR cinder     service.wait()
>2018-06-26 04:52:29.969 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 04:52:29.969 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 04:52:29.969 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 04:52:29.969 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 04:52:29.969 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 04:52:29.969 1 ERROR cinder     post_fn = fn()
>2018-06-26 04:52:29.969 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 04:52:29.969 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 04:52:29.969 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 04:52:29.969 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 04:52:29.969 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 04:52:29.969 1 ERROR cinder 
>2018-06-26 04:52:32.744 1 WARNING cinder.scheduler.host_manager [req-994a6aa6-363c-4ab8-92cd-307cc3233eb2 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 04:52:32.750 1 INFO cinder.rpc [req-994a6aa6-363c-4ab8-92cd-307cc3233eb2 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 04:52:32.756 1 INFO cinder.rpc [req-994a6aa6-363c-4ab8-92cd-307cc3233eb2 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 04:52:32.770 1 INFO cinder.rpc [req-994a6aa6-363c-4ab8-92cd-307cc3233eb2 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 04:52:32.776 1 INFO cinder.rpc [req-994a6aa6-363c-4ab8-92cd-307cc3233eb2 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 04:52:32.812 1 WARNING oslo_config.cfg [req-994a6aa6-363c-4ab8-92cd-307cc3233eb2 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 04:52:32.814 1 WARNING oslo_config.cfg [req-994a6aa6-363c-4ab8-92cd-307cc3233eb2 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:52:32.815 1 WARNING oslo_config.cfg [req-994a6aa6-363c-4ab8-92cd-307cc3233eb2 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:52:32.815 1 WARNING oslo_config.cfg [req-994a6aa6-363c-4ab8-92cd-307cc3233eb2 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:52:32.821 1 WARNING oslo_config.cfg [req-994a6aa6-363c-4ab8-92cd-307cc3233eb2 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 04:52:32.822 1 WARNING oslo_config.cfg [req-994a6aa6-363c-4ab8-92cd-307cc3233eb2 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 04:52:32.825 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 04:52:32.834 1 INFO cinder.manager [req-f4787957-7459-4c5d-a960-2acd38867196 - - - - -] Initiating service 5 cleanup
>2018-06-26 04:52:32.846 1 INFO cinder.manager [req-f4787957-7459-4c5d-a960-2acd38867196 - - - - -] Service 5 cleanup completed.
>2018-06-26 04:54:38.708 1 ERROR oslo.messaging._drivers.impl_rabbit [req-f4787957-7459-4c5d-a960-2acd38867196 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:54:38.709 1 ERROR oslo.messaging._drivers.impl_rabbit [req-f4787957-7459-4c5d-a960-2acd38867196 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:54:38.710 1 ERROR oslo_service.service [req-f4787957-7459-4c5d-a960-2acd38867196 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:54:38.710 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 04:54:38.710 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 04:54:38.710 1 ERROR oslo_service.service     service.start()
>2018-06-26 04:54:38.710 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 04:54:38.710 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 04:54:38.710 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 04:54:38.710 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 04:54:38.710 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 04:54:38.710 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 04:54:38.710 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 04:54:38.710 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 04:54:38.710 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 04:54:38.710 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 04:54:38.710 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 04:54:38.710 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 04:54:38.710 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 04:54:38.710 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 04:54:38.710 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 04:54:38.710 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 04:54:38.710 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 04:54:38.710 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 04:54:38.710 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 04:54:38.710 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 04:54:38.710 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 04:54:38.710 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 04:54:38.710 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:54:38.710 1 ERROR oslo_service.service 
>2018-06-26 04:54:38.713 1 CRITICAL cinder [req-994a6aa6-363c-4ab8-92cd-307cc3233eb2 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 04:54:38.713 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 04:54:38.713 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 04:54:38.713 1 ERROR cinder     sys.exit(main())
>2018-06-26 04:54:38.713 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 04:54:38.713 1 ERROR cinder     service.wait()
>2018-06-26 04:54:38.713 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 04:54:38.713 1 ERROR cinder     _launcher.wait()
>2018-06-26 04:54:38.713 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 04:54:38.713 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 04:54:38.713 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 04:54:38.713 1 ERROR cinder     self.services.wait()
>2018-06-26 04:54:38.713 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 04:54:38.713 1 ERROR cinder     service.wait()
>2018-06-26 04:54:38.713 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 04:54:38.713 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 04:54:38.713 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 04:54:38.713 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 04:54:38.713 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 04:54:38.713 1 ERROR cinder     post_fn = fn()
>2018-06-26 04:54:38.713 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 04:54:38.713 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 04:54:38.713 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 04:54:38.713 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 04:54:38.713 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 04:54:38.713 1 ERROR cinder 
>2018-06-26 04:54:41.330 1 WARNING cinder.scheduler.host_manager [req-748f9b4c-2043-4935-902c-c63b24a629de - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 04:54:41.336 1 INFO cinder.rpc [req-748f9b4c-2043-4935-902c-c63b24a629de - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 04:54:41.342 1 INFO cinder.rpc [req-748f9b4c-2043-4935-902c-c63b24a629de - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 04:54:41.353 1 INFO cinder.rpc [req-748f9b4c-2043-4935-902c-c63b24a629de - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 04:54:41.359 1 INFO cinder.rpc [req-748f9b4c-2043-4935-902c-c63b24a629de - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 04:54:41.384 1 WARNING oslo_config.cfg [req-748f9b4c-2043-4935-902c-c63b24a629de - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 04:54:41.386 1 WARNING oslo_config.cfg [req-748f9b4c-2043-4935-902c-c63b24a629de - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:54:41.387 1 WARNING oslo_config.cfg [req-748f9b4c-2043-4935-902c-c63b24a629de - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:54:41.387 1 WARNING oslo_config.cfg [req-748f9b4c-2043-4935-902c-c63b24a629de - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:54:41.393 1 WARNING oslo_config.cfg [req-748f9b4c-2043-4935-902c-c63b24a629de - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 04:54:41.394 1 WARNING oslo_config.cfg [req-748f9b4c-2043-4935-902c-c63b24a629de - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 04:54:41.396 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 04:54:41.403 1 INFO cinder.manager [req-8dff018e-59ea-4b94-927b-2b7ab650232f - - - - -] Initiating service 5 cleanup
>2018-06-26 04:54:41.407 1 INFO cinder.manager [req-8dff018e-59ea-4b94-927b-2b7ab650232f - - - - -] Service 5 cleanup completed.
>2018-06-26 04:56:47.351 1 ERROR oslo.messaging._drivers.impl_rabbit [req-8dff018e-59ea-4b94-927b-2b7ab650232f - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:56:47.353 1 ERROR oslo.messaging._drivers.impl_rabbit [req-8dff018e-59ea-4b94-927b-2b7ab650232f - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:56:47.354 1 ERROR oslo_service.service [req-8dff018e-59ea-4b94-927b-2b7ab650232f - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:56:47.354 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 04:56:47.354 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 04:56:47.354 1 ERROR oslo_service.service     service.start()
>2018-06-26 04:56:47.354 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 04:56:47.354 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 04:56:47.354 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 04:56:47.354 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 04:56:47.354 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 04:56:47.354 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 04:56:47.354 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 04:56:47.354 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 04:56:47.354 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 04:56:47.354 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 04:56:47.354 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 04:56:47.354 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 04:56:47.354 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 04:56:47.354 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 04:56:47.354 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 04:56:47.354 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 04:56:47.354 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 04:56:47.354 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 04:56:47.354 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 04:56:47.354 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 04:56:47.354 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 04:56:47.354 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 04:56:47.354 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:56:47.354 1 ERROR oslo_service.service 
>2018-06-26 04:56:47.357 1 CRITICAL cinder [req-748f9b4c-2043-4935-902c-c63b24a629de - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 04:56:47.357 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 04:56:47.357 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 04:56:47.357 1 ERROR cinder     sys.exit(main())
>2018-06-26 04:56:47.357 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 04:56:47.357 1 ERROR cinder     service.wait()
>2018-06-26 04:56:47.357 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 04:56:47.357 1 ERROR cinder     _launcher.wait()
>2018-06-26 04:56:47.357 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 04:56:47.357 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 04:56:47.357 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 04:56:47.357 1 ERROR cinder     self.services.wait()
>2018-06-26 04:56:47.357 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 04:56:47.357 1 ERROR cinder     service.wait()
>2018-06-26 04:56:47.357 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 04:56:47.357 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 04:56:47.357 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 04:56:47.357 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 04:56:47.357 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 04:56:47.357 1 ERROR cinder     post_fn = fn()
>2018-06-26 04:56:47.357 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 04:56:47.357 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 04:56:47.357 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 04:56:47.357 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 04:56:47.357 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 04:56:47.357 1 ERROR cinder 
>2018-06-26 04:56:50.175 1 WARNING cinder.scheduler.host_manager [req-423dde3e-d9ba-4719-ad98-800164883d26 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 04:56:50.187 1 INFO cinder.rpc [req-423dde3e-d9ba-4719-ad98-800164883d26 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 04:56:50.195 1 INFO cinder.rpc [req-423dde3e-d9ba-4719-ad98-800164883d26 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 04:56:50.214 1 INFO cinder.rpc [req-423dde3e-d9ba-4719-ad98-800164883d26 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 04:56:50.231 1 INFO cinder.rpc [req-423dde3e-d9ba-4719-ad98-800164883d26 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 04:56:50.272 1 WARNING oslo_config.cfg [req-423dde3e-d9ba-4719-ad98-800164883d26 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 04:56:50.275 1 WARNING oslo_config.cfg [req-423dde3e-d9ba-4719-ad98-800164883d26 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:56:50.276 1 WARNING oslo_config.cfg [req-423dde3e-d9ba-4719-ad98-800164883d26 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:56:50.277 1 WARNING oslo_config.cfg [req-423dde3e-d9ba-4719-ad98-800164883d26 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:56:50.282 1 WARNING oslo_config.cfg [req-423dde3e-d9ba-4719-ad98-800164883d26 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 04:56:50.285 1 WARNING oslo_config.cfg [req-423dde3e-d9ba-4719-ad98-800164883d26 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 04:56:50.288 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 04:56:50.299 1 INFO cinder.manager [req-af913772-4996-469b-89aa-f1867df6e4d7 - - - - -] Initiating service 5 cleanup
>2018-06-26 04:56:50.305 1 INFO cinder.manager [req-af913772-4996-469b-89aa-f1867df6e4d7 - - - - -] Service 5 cleanup completed.
>2018-06-26 04:58:56.400 1 ERROR oslo.messaging._drivers.impl_rabbit [req-af913772-4996-469b-89aa-f1867df6e4d7 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:58:56.401 1 ERROR oslo.messaging._drivers.impl_rabbit [req-af913772-4996-469b-89aa-f1867df6e4d7 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:58:56.402 1 ERROR oslo_service.service [req-af913772-4996-469b-89aa-f1867df6e4d7 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:58:56.402 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 04:58:56.402 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 04:58:56.402 1 ERROR oslo_service.service     service.start()
>2018-06-26 04:58:56.402 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 04:58:56.402 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 04:58:56.402 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 04:58:56.402 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 04:58:56.402 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 04:58:56.402 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 04:58:56.402 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 04:58:56.402 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 04:58:56.402 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 04:58:56.402 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 04:58:56.402 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 04:58:56.402 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 04:58:56.402 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 04:58:56.402 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 04:58:56.402 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 04:58:56.402 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 04:58:56.402 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 04:58:56.402 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 04:58:56.402 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 04:58:56.402 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 04:58:56.402 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 04:58:56.402 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 04:58:56.402 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 04:58:56.402 1 ERROR oslo_service.service 
>2018-06-26 04:58:56.405 1 CRITICAL cinder [req-423dde3e-d9ba-4719-ad98-800164883d26 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 04:58:56.405 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 04:58:56.405 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 04:58:56.405 1 ERROR cinder     sys.exit(main())
>2018-06-26 04:58:56.405 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 04:58:56.405 1 ERROR cinder     service.wait()
>2018-06-26 04:58:56.405 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 04:58:56.405 1 ERROR cinder     _launcher.wait()
>2018-06-26 04:58:56.405 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 04:58:56.405 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 04:58:56.405 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 04:58:56.405 1 ERROR cinder     self.services.wait()
>2018-06-26 04:58:56.405 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 04:58:56.405 1 ERROR cinder     service.wait()
>2018-06-26 04:58:56.405 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 04:58:56.405 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 04:58:56.405 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 04:58:56.405 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 04:58:56.405 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 04:58:56.405 1 ERROR cinder     post_fn = fn()
>2018-06-26 04:58:56.405 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 04:58:56.405 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 04:58:56.405 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 04:58:56.405 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 04:58:56.405 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 04:58:56.405 1 ERROR cinder 
>2018-06-26 04:58:59.154 1 WARNING cinder.scheduler.host_manager [req-ddb7d348-b2d2-456d-8556-fcb5162af95f - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 04:58:59.160 1 INFO cinder.rpc [req-ddb7d348-b2d2-456d-8556-fcb5162af95f - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 04:58:59.166 1 INFO cinder.rpc [req-ddb7d348-b2d2-456d-8556-fcb5162af95f - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 04:58:59.184 1 INFO cinder.rpc [req-ddb7d348-b2d2-456d-8556-fcb5162af95f - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 04:58:59.192 1 INFO cinder.rpc [req-ddb7d348-b2d2-456d-8556-fcb5162af95f - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 04:58:59.215 1 WARNING oslo_config.cfg [req-ddb7d348-b2d2-456d-8556-fcb5162af95f - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 04:58:59.217 1 WARNING oslo_config.cfg [req-ddb7d348-b2d2-456d-8556-fcb5162af95f - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:58:59.218 1 WARNING oslo_config.cfg [req-ddb7d348-b2d2-456d-8556-fcb5162af95f - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:58:59.218 1 WARNING oslo_config.cfg [req-ddb7d348-b2d2-456d-8556-fcb5162af95f - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 04:58:59.223 1 WARNING oslo_config.cfg [req-ddb7d348-b2d2-456d-8556-fcb5162af95f - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 04:58:59.225 1 WARNING oslo_config.cfg [req-ddb7d348-b2d2-456d-8556-fcb5162af95f - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 04:58:59.227 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 04:58:59.233 1 INFO cinder.manager [req-260830e3-cba7-4add-876f-44a1c05b59c2 - - - - -] Initiating service 5 cleanup
>2018-06-26 04:58:59.237 1 INFO cinder.manager [req-260830e3-cba7-4add-876f-44a1c05b59c2 - - - - -] Service 5 cleanup completed.
>2018-06-26 05:01:11.916 1 ERROR oslo.messaging._drivers.impl_rabbit [req-260830e3-cba7-4add-876f-44a1c05b59c2 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:01:11.918 1 ERROR oslo.messaging._drivers.impl_rabbit [req-260830e3-cba7-4add-876f-44a1c05b59c2 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:01:11.919 1 ERROR oslo_service.service [req-260830e3-cba7-4add-876f-44a1c05b59c2 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:01:11.919 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 05:01:11.919 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 05:01:11.919 1 ERROR oslo_service.service     service.start()
>2018-06-26 05:01:11.919 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 05:01:11.919 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 05:01:11.919 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 05:01:11.919 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 05:01:11.919 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 05:01:11.919 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 05:01:11.919 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 05:01:11.919 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 05:01:11.919 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 05:01:11.919 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 05:01:11.919 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 05:01:11.919 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 05:01:11.919 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 05:01:11.919 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 05:01:11.919 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 05:01:11.919 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 05:01:11.919 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 05:01:11.919 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 05:01:11.919 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 05:01:11.919 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 05:01:11.919 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 05:01:11.919 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 05:01:11.919 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:01:11.919 1 ERROR oslo_service.service 
>2018-06-26 05:01:11.922 1 CRITICAL cinder [req-ddb7d348-b2d2-456d-8556-fcb5162af95f - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 05:01:11.922 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 05:01:11.922 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 05:01:11.922 1 ERROR cinder     sys.exit(main())
>2018-06-26 05:01:11.922 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 05:01:11.922 1 ERROR cinder     service.wait()
>2018-06-26 05:01:11.922 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 05:01:11.922 1 ERROR cinder     _launcher.wait()
>2018-06-26 05:01:11.922 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 05:01:11.922 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 05:01:11.922 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 05:01:11.922 1 ERROR cinder     self.services.wait()
>2018-06-26 05:01:11.922 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 05:01:11.922 1 ERROR cinder     service.wait()
>2018-06-26 05:01:11.922 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 05:01:11.922 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 05:01:11.922 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 05:01:11.922 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 05:01:11.922 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 05:01:11.922 1 ERROR cinder     post_fn = fn()
>2018-06-26 05:01:11.922 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 05:01:11.922 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 05:01:11.922 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 05:01:11.922 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 05:01:11.922 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 05:01:11.922 1 ERROR cinder 
>2018-06-26 05:01:14.608 1 WARNING cinder.scheduler.host_manager [req-4ce6db06-dd98-4528-b781-c0557f8e581d - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 05:01:14.613 1 INFO cinder.rpc [req-4ce6db06-dd98-4528-b781-c0557f8e581d - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 05:01:14.619 1 INFO cinder.rpc [req-4ce6db06-dd98-4528-b781-c0557f8e581d - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 05:01:14.630 1 INFO cinder.rpc [req-4ce6db06-dd98-4528-b781-c0557f8e581d - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 05:01:14.636 1 INFO cinder.rpc [req-4ce6db06-dd98-4528-b781-c0557f8e581d - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 05:01:14.665 1 WARNING oslo_config.cfg [req-4ce6db06-dd98-4528-b781-c0557f8e581d - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 05:01:14.667 1 WARNING oslo_config.cfg [req-4ce6db06-dd98-4528-b781-c0557f8e581d - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:01:14.667 1 WARNING oslo_config.cfg [req-4ce6db06-dd98-4528-b781-c0557f8e581d - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:01:14.668 1 WARNING oslo_config.cfg [req-4ce6db06-dd98-4528-b781-c0557f8e581d - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:01:14.673 1 WARNING oslo_config.cfg [req-4ce6db06-dd98-4528-b781-c0557f8e581d - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 05:01:14.674 1 WARNING oslo_config.cfg [req-4ce6db06-dd98-4528-b781-c0557f8e581d - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 05:01:14.677 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 05:01:14.684 1 INFO cinder.manager [req-e26eece5-2979-41f2-9f60-589fab90fa11 - - - - -] Initiating service 5 cleanup
>2018-06-26 05:01:14.688 1 INFO cinder.manager [req-e26eece5-2979-41f2-9f60-589fab90fa11 - - - - -] Service 5 cleanup completed.
>2018-06-26 05:03:20.678 1 ERROR oslo.messaging._drivers.impl_rabbit [req-e26eece5-2979-41f2-9f60-589fab90fa11 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:03:20.681 1 ERROR oslo.messaging._drivers.impl_rabbit [req-e26eece5-2979-41f2-9f60-589fab90fa11 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:03:20.682 1 ERROR oslo_service.service [req-e26eece5-2979-41f2-9f60-589fab90fa11 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:03:20.682 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 05:03:20.682 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 05:03:20.682 1 ERROR oslo_service.service     service.start()
>2018-06-26 05:03:20.682 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 05:03:20.682 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 05:03:20.682 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 05:03:20.682 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 05:03:20.682 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 05:03:20.682 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 05:03:20.682 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 05:03:20.682 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 05:03:20.682 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 05:03:20.682 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 05:03:20.682 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 05:03:20.682 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 05:03:20.682 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 05:03:20.682 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 05:03:20.682 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 05:03:20.682 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 05:03:20.682 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 05:03:20.682 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 05:03:20.682 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 05:03:20.682 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 05:03:20.682 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 05:03:20.682 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 05:03:20.682 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:03:20.682 1 ERROR oslo_service.service 
>2018-06-26 05:03:20.686 1 CRITICAL cinder [req-4ce6db06-dd98-4528-b781-c0557f8e581d - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 05:03:20.686 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 05:03:20.686 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 05:03:20.686 1 ERROR cinder     sys.exit(main())
>2018-06-26 05:03:20.686 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 05:03:20.686 1 ERROR cinder     service.wait()
>2018-06-26 05:03:20.686 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 05:03:20.686 1 ERROR cinder     _launcher.wait()
>2018-06-26 05:03:20.686 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 05:03:20.686 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 05:03:20.686 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 05:03:20.686 1 ERROR cinder     self.services.wait()
>2018-06-26 05:03:20.686 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 05:03:20.686 1 ERROR cinder     service.wait()
>2018-06-26 05:03:20.686 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 05:03:20.686 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 05:03:20.686 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 05:03:20.686 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 05:03:20.686 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 05:03:20.686 1 ERROR cinder     post_fn = fn()
>2018-06-26 05:03:20.686 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 05:03:20.686 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 05:03:20.686 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 05:03:20.686 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 05:03:20.686 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 05:03:20.686 1 ERROR cinder 
>2018-06-26 05:03:23.363 1 WARNING cinder.scheduler.host_manager [req-aa0a0dae-422c-4f75-9743-8de7e170101f - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 05:03:23.370 1 INFO cinder.rpc [req-aa0a0dae-422c-4f75-9743-8de7e170101f - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 05:03:23.375 1 INFO cinder.rpc [req-aa0a0dae-422c-4f75-9743-8de7e170101f - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 05:03:23.395 1 INFO cinder.rpc [req-aa0a0dae-422c-4f75-9743-8de7e170101f - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 05:03:23.401 1 INFO cinder.rpc [req-aa0a0dae-422c-4f75-9743-8de7e170101f - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 05:03:23.429 1 WARNING oslo_config.cfg [req-aa0a0dae-422c-4f75-9743-8de7e170101f - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 05:03:23.431 1 WARNING oslo_config.cfg [req-aa0a0dae-422c-4f75-9743-8de7e170101f - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:03:23.432 1 WARNING oslo_config.cfg [req-aa0a0dae-422c-4f75-9743-8de7e170101f - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:03:23.432 1 WARNING oslo_config.cfg [req-aa0a0dae-422c-4f75-9743-8de7e170101f - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:03:23.437 1 WARNING oslo_config.cfg [req-aa0a0dae-422c-4f75-9743-8de7e170101f - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 05:03:23.439 1 WARNING oslo_config.cfg [req-aa0a0dae-422c-4f75-9743-8de7e170101f - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 05:03:23.441 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 05:03:23.447 1 INFO cinder.manager [req-fbf09ac5-190f-4791-847f-5df18f46f701 - - - - -] Initiating service 5 cleanup
>2018-06-26 05:03:23.452 1 INFO cinder.manager [req-fbf09ac5-190f-4791-847f-5df18f46f701 - - - - -] Service 5 cleanup completed.
>2018-06-26 05:05:29.519 1 ERROR oslo.messaging._drivers.impl_rabbit [req-fbf09ac5-190f-4791-847f-5df18f46f701 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:05:29.522 1 ERROR oslo.messaging._drivers.impl_rabbit [req-fbf09ac5-190f-4791-847f-5df18f46f701 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:05:29.522 1 ERROR oslo_service.service [req-fbf09ac5-190f-4791-847f-5df18f46f701 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:05:29.522 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 05:05:29.522 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 05:05:29.522 1 ERROR oslo_service.service     service.start()
>2018-06-26 05:05:29.522 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 05:05:29.522 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 05:05:29.522 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 05:05:29.522 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 05:05:29.522 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 05:05:29.522 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 05:05:29.522 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 05:05:29.522 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 05:05:29.522 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 05:05:29.522 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 05:05:29.522 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 05:05:29.522 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 05:05:29.522 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 05:05:29.522 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 05:05:29.522 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 05:05:29.522 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 05:05:29.522 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 05:05:29.522 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 05:05:29.522 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 05:05:29.522 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 05:05:29.522 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 05:05:29.522 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 05:05:29.522 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:05:29.522 1 ERROR oslo_service.service 
>2018-06-26 05:05:29.525 1 CRITICAL cinder [req-aa0a0dae-422c-4f75-9743-8de7e170101f - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 05:05:29.525 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 05:05:29.525 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 05:05:29.525 1 ERROR cinder     sys.exit(main())
>2018-06-26 05:05:29.525 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 05:05:29.525 1 ERROR cinder     service.wait()
>2018-06-26 05:05:29.525 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 05:05:29.525 1 ERROR cinder     _launcher.wait()
>2018-06-26 05:05:29.525 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 05:05:29.525 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 05:05:29.525 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 05:05:29.525 1 ERROR cinder     self.services.wait()
>2018-06-26 05:05:29.525 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 05:05:29.525 1 ERROR cinder     service.wait()
>2018-06-26 05:05:29.525 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 05:05:29.525 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 05:05:29.525 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 05:05:29.525 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 05:05:29.525 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 05:05:29.525 1 ERROR cinder     post_fn = fn()
>2018-06-26 05:05:29.525 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 05:05:29.525 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 05:05:29.525 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 05:05:29.525 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 05:05:29.525 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 05:05:29.525 1 ERROR cinder 
>2018-06-26 05:05:32.073 1 WARNING cinder.scheduler.host_manager [req-e819b467-a7b6-4925-aa84-d2f632490023 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 05:05:32.079 1 INFO cinder.rpc [req-e819b467-a7b6-4925-aa84-d2f632490023 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 05:05:32.084 1 INFO cinder.rpc [req-e819b467-a7b6-4925-aa84-d2f632490023 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 05:05:32.095 1 INFO cinder.rpc [req-e819b467-a7b6-4925-aa84-d2f632490023 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 05:05:32.101 1 INFO cinder.rpc [req-e819b467-a7b6-4925-aa84-d2f632490023 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 05:05:32.122 1 WARNING oslo_config.cfg [req-e819b467-a7b6-4925-aa84-d2f632490023 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 05:05:32.124 1 WARNING oslo_config.cfg [req-e819b467-a7b6-4925-aa84-d2f632490023 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:05:32.124 1 WARNING oslo_config.cfg [req-e819b467-a7b6-4925-aa84-d2f632490023 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:05:32.125 1 WARNING oslo_config.cfg [req-e819b467-a7b6-4925-aa84-d2f632490023 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:05:32.130 1 WARNING oslo_config.cfg [req-e819b467-a7b6-4925-aa84-d2f632490023 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 05:05:32.131 1 WARNING oslo_config.cfg [req-e819b467-a7b6-4925-aa84-d2f632490023 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 05:05:32.133 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 05:05:32.138 1 INFO cinder.manager [req-3220a7fa-85e8-4cfc-bb02-1508b7297eff - - - - -] Initiating service 5 cleanup
>2018-06-26 05:05:32.142 1 INFO cinder.manager [req-3220a7fa-85e8-4cfc-bb02-1508b7297eff - - - - -] Service 5 cleanup completed.
>2018-06-26 05:07:44.917 1 ERROR oslo.messaging._drivers.impl_rabbit [req-3220a7fa-85e8-4cfc-bb02-1508b7297eff - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:07:44.919 1 ERROR oslo.messaging._drivers.impl_rabbit [req-3220a7fa-85e8-4cfc-bb02-1508b7297eff - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:07:44.920 1 ERROR oslo_service.service [req-3220a7fa-85e8-4cfc-bb02-1508b7297eff - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:07:44.920 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 05:07:44.920 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 05:07:44.920 1 ERROR oslo_service.service     service.start()
>2018-06-26 05:07:44.920 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 05:07:44.920 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 05:07:44.920 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 05:07:44.920 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 05:07:44.920 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 05:07:44.920 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 05:07:44.920 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 05:07:44.920 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 05:07:44.920 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 05:07:44.920 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 05:07:44.920 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 05:07:44.920 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 05:07:44.920 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 05:07:44.920 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 05:07:44.920 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 05:07:44.920 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 05:07:44.920 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 05:07:44.920 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 05:07:44.920 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 05:07:44.920 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 05:07:44.920 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 05:07:44.920 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 05:07:44.920 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:07:44.920 1 ERROR oslo_service.service 
>2018-06-26 05:07:44.923 1 CRITICAL cinder [req-e819b467-a7b6-4925-aa84-d2f632490023 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 05:07:44.923 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 05:07:44.923 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 05:07:44.923 1 ERROR cinder     sys.exit(main())
>2018-06-26 05:07:44.923 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 05:07:44.923 1 ERROR cinder     service.wait()
>2018-06-26 05:07:44.923 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 05:07:44.923 1 ERROR cinder     _launcher.wait()
>2018-06-26 05:07:44.923 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 05:07:44.923 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 05:07:44.923 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 05:07:44.923 1 ERROR cinder     self.services.wait()
>2018-06-26 05:07:44.923 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 05:07:44.923 1 ERROR cinder     service.wait()
>2018-06-26 05:07:44.923 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 05:07:44.923 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 05:07:44.923 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 05:07:44.923 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 05:07:44.923 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 05:07:44.923 1 ERROR cinder     post_fn = fn()
>2018-06-26 05:07:44.923 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 05:07:44.923 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 05:07:44.923 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 05:07:44.923 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 05:07:44.923 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 05:07:44.923 1 ERROR cinder 
>2018-06-26 05:07:47.526 1 WARNING cinder.scheduler.host_manager [req-6eef1b02-e257-45f9-8bed-e85ac009b713 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 05:07:47.532 1 INFO cinder.rpc [req-6eef1b02-e257-45f9-8bed-e85ac009b713 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 05:07:47.538 1 INFO cinder.rpc [req-6eef1b02-e257-45f9-8bed-e85ac009b713 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 05:07:47.549 1 INFO cinder.rpc [req-6eef1b02-e257-45f9-8bed-e85ac009b713 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 05:07:47.555 1 INFO cinder.rpc [req-6eef1b02-e257-45f9-8bed-e85ac009b713 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 05:07:47.581 1 WARNING oslo_config.cfg [req-6eef1b02-e257-45f9-8bed-e85ac009b713 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 05:07:47.583 1 WARNING oslo_config.cfg [req-6eef1b02-e257-45f9-8bed-e85ac009b713 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:07:47.584 1 WARNING oslo_config.cfg [req-6eef1b02-e257-45f9-8bed-e85ac009b713 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:07:47.584 1 WARNING oslo_config.cfg [req-6eef1b02-e257-45f9-8bed-e85ac009b713 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:07:47.589 1 WARNING oslo_config.cfg [req-6eef1b02-e257-45f9-8bed-e85ac009b713 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 05:07:47.591 1 WARNING oslo_config.cfg [req-6eef1b02-e257-45f9-8bed-e85ac009b713 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 05:07:47.593 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 05:07:47.600 1 INFO cinder.manager [req-deb73678-b2f5-4613-a494-1eff6669e3c6 - - - - -] Initiating service 5 cleanup
>2018-06-26 05:07:47.609 1 INFO cinder.manager [req-deb73678-b2f5-4613-a494-1eff6669e3c6 - - - - -] Service 5 cleanup completed.
>2018-06-26 05:09:53.683 1 ERROR oslo.messaging._drivers.impl_rabbit [req-deb73678-b2f5-4613-a494-1eff6669e3c6 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:09:53.684 1 ERROR oslo.messaging._drivers.impl_rabbit [req-deb73678-b2f5-4613-a494-1eff6669e3c6 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:09:53.685 1 ERROR oslo_service.service [req-deb73678-b2f5-4613-a494-1eff6669e3c6 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:09:53.685 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 05:09:53.685 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 05:09:53.685 1 ERROR oslo_service.service     service.start()
>2018-06-26 05:09:53.685 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 05:09:53.685 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 05:09:53.685 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 05:09:53.685 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 05:09:53.685 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 05:09:53.685 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 05:09:53.685 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 05:09:53.685 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 05:09:53.685 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 05:09:53.685 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 05:09:53.685 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 05:09:53.685 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 05:09:53.685 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 05:09:53.685 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 05:09:53.685 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 05:09:53.685 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 05:09:53.685 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 05:09:53.685 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 05:09:53.685 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 05:09:53.685 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 05:09:53.685 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 05:09:53.685 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 05:09:53.685 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:09:53.685 1 ERROR oslo_service.service 
>2018-06-26 05:09:53.688 1 CRITICAL cinder [req-6eef1b02-e257-45f9-8bed-e85ac009b713 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 05:09:53.688 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 05:09:53.688 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 05:09:53.688 1 ERROR cinder     sys.exit(main())
>2018-06-26 05:09:53.688 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 05:09:53.688 1 ERROR cinder     service.wait()
>2018-06-26 05:09:53.688 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 05:09:53.688 1 ERROR cinder     _launcher.wait()
>2018-06-26 05:09:53.688 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 05:09:53.688 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 05:09:53.688 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 05:09:53.688 1 ERROR cinder     self.services.wait()
>2018-06-26 05:09:53.688 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 05:09:53.688 1 ERROR cinder     service.wait()
>2018-06-26 05:09:53.688 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 05:09:53.688 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 05:09:53.688 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 05:09:53.688 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 05:09:53.688 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 05:09:53.688 1 ERROR cinder     post_fn = fn()
>2018-06-26 05:09:53.688 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 05:09:53.688 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 05:09:53.688 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 05:09:53.688 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 05:09:53.688 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 05:09:53.688 1 ERROR cinder 
>2018-06-26 05:09:56.293 1 WARNING cinder.scheduler.host_manager [req-7becd88f-297b-498b-8e0c-ccfa20d7a29d - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 05:09:56.301 1 INFO cinder.rpc [req-7becd88f-297b-498b-8e0c-ccfa20d7a29d - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 05:09:56.308 1 INFO cinder.rpc [req-7becd88f-297b-498b-8e0c-ccfa20d7a29d - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 05:09:56.319 1 INFO cinder.rpc [req-7becd88f-297b-498b-8e0c-ccfa20d7a29d - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 05:09:56.327 1 INFO cinder.rpc [req-7becd88f-297b-498b-8e0c-ccfa20d7a29d - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 05:09:56.349 1 WARNING oslo_config.cfg [req-7becd88f-297b-498b-8e0c-ccfa20d7a29d - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 05:09:56.352 1 WARNING oslo_config.cfg [req-7becd88f-297b-498b-8e0c-ccfa20d7a29d - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:09:56.352 1 WARNING oslo_config.cfg [req-7becd88f-297b-498b-8e0c-ccfa20d7a29d - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:09:56.353 1 WARNING oslo_config.cfg [req-7becd88f-297b-498b-8e0c-ccfa20d7a29d - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:09:56.358 1 WARNING oslo_config.cfg [req-7becd88f-297b-498b-8e0c-ccfa20d7a29d - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 05:09:56.359 1 WARNING oslo_config.cfg [req-7becd88f-297b-498b-8e0c-ccfa20d7a29d - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 05:09:56.362 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 05:09:56.368 1 INFO cinder.manager [req-e13a900c-5f3f-46c9-845e-a47ca4dc80d9 - - - - -] Initiating service 5 cleanup
>2018-06-26 05:09:56.372 1 INFO cinder.manager [req-e13a900c-5f3f-46c9-845e-a47ca4dc80d9 - - - - -] Service 5 cleanup completed.
>2018-06-26 05:12:08.849 1 ERROR oslo.messaging._drivers.impl_rabbit [req-e13a900c-5f3f-46c9-845e-a47ca4dc80d9 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:12:08.851 1 ERROR oslo.messaging._drivers.impl_rabbit [req-e13a900c-5f3f-46c9-845e-a47ca4dc80d9 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:12:08.851 1 ERROR oslo_service.service [req-e13a900c-5f3f-46c9-845e-a47ca4dc80d9 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:12:08.851 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 05:12:08.851 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 05:12:08.851 1 ERROR oslo_service.service     service.start()
>2018-06-26 05:12:08.851 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 05:12:08.851 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 05:12:08.851 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 05:12:08.851 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 05:12:08.851 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 05:12:08.851 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 05:12:08.851 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 05:12:08.851 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 05:12:08.851 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 05:12:08.851 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 05:12:08.851 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 05:12:08.851 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 05:12:08.851 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 05:12:08.851 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 05:12:08.851 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 05:12:08.851 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 05:12:08.851 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 05:12:08.851 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 05:12:08.851 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 05:12:08.851 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 05:12:08.851 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 05:12:08.851 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 05:12:08.851 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:12:08.851 1 ERROR oslo_service.service 
>2018-06-26 05:12:08.854 1 CRITICAL cinder [req-7becd88f-297b-498b-8e0c-ccfa20d7a29d - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 05:12:08.854 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 05:12:08.854 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 05:12:08.854 1 ERROR cinder     sys.exit(main())
>2018-06-26 05:12:08.854 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 05:12:08.854 1 ERROR cinder     service.wait()
>2018-06-26 05:12:08.854 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 05:12:08.854 1 ERROR cinder     _launcher.wait()
>2018-06-26 05:12:08.854 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 05:12:08.854 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 05:12:08.854 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 05:12:08.854 1 ERROR cinder     self.services.wait()
>2018-06-26 05:12:08.854 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 05:12:08.854 1 ERROR cinder     service.wait()
>2018-06-26 05:12:08.854 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 05:12:08.854 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 05:12:08.854 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 05:12:08.854 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 05:12:08.854 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 05:12:08.854 1 ERROR cinder     post_fn = fn()
>2018-06-26 05:12:08.854 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 05:12:08.854 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 05:12:08.854 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 05:12:08.854 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 05:12:08.854 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 05:12:08.854 1 ERROR cinder 
>2018-06-26 05:12:11.558 1 WARNING cinder.scheduler.host_manager [req-0534c3d6-2a4f-4dbb-9a36-a28e320ce370 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 05:12:11.564 1 INFO cinder.rpc [req-0534c3d6-2a4f-4dbb-9a36-a28e320ce370 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 05:12:11.570 1 INFO cinder.rpc [req-0534c3d6-2a4f-4dbb-9a36-a28e320ce370 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 05:12:11.582 1 INFO cinder.rpc [req-0534c3d6-2a4f-4dbb-9a36-a28e320ce370 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 05:12:11.587 1 INFO cinder.rpc [req-0534c3d6-2a4f-4dbb-9a36-a28e320ce370 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 05:12:11.610 1 WARNING oslo_config.cfg [req-0534c3d6-2a4f-4dbb-9a36-a28e320ce370 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 05:12:11.611 1 WARNING oslo_config.cfg [req-0534c3d6-2a4f-4dbb-9a36-a28e320ce370 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:12:11.612 1 WARNING oslo_config.cfg [req-0534c3d6-2a4f-4dbb-9a36-a28e320ce370 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:12:11.612 1 WARNING oslo_config.cfg [req-0534c3d6-2a4f-4dbb-9a36-a28e320ce370 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:12:11.617 1 WARNING oslo_config.cfg [req-0534c3d6-2a4f-4dbb-9a36-a28e320ce370 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 05:12:11.618 1 WARNING oslo_config.cfg [req-0534c3d6-2a4f-4dbb-9a36-a28e320ce370 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 05:12:11.621 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 05:12:11.626 1 INFO cinder.manager [req-70ca0af2-7aee-4e08-bf21-3dbd3068180f - - - - -] Initiating service 5 cleanup
>2018-06-26 05:12:11.630 1 INFO cinder.manager [req-70ca0af2-7aee-4e08-bf21-3dbd3068180f - - - - -] Service 5 cleanup completed.
>2018-06-26 05:14:18.226 1 ERROR oslo.messaging._drivers.impl_rabbit [req-70ca0af2-7aee-4e08-bf21-3dbd3068180f - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:14:18.228 1 ERROR oslo.messaging._drivers.impl_rabbit [req-70ca0af2-7aee-4e08-bf21-3dbd3068180f - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:14:18.228 1 ERROR oslo_service.service [req-70ca0af2-7aee-4e08-bf21-3dbd3068180f - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:14:18.228 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 05:14:18.228 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 05:14:18.228 1 ERROR oslo_service.service     service.start()
>2018-06-26 05:14:18.228 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 05:14:18.228 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 05:14:18.228 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 05:14:18.228 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 05:14:18.228 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 05:14:18.228 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 05:14:18.228 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 05:14:18.228 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 05:14:18.228 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 05:14:18.228 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 05:14:18.228 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 05:14:18.228 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 05:14:18.228 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 05:14:18.228 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 05:14:18.228 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 05:14:18.228 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 05:14:18.228 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 05:14:18.228 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 05:14:18.228 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 05:14:18.228 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 05:14:18.228 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 05:14:18.228 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 05:14:18.228 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:14:18.228 1 ERROR oslo_service.service 
>2018-06-26 05:14:18.231 1 CRITICAL cinder [req-0534c3d6-2a4f-4dbb-9a36-a28e320ce370 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 05:14:18.231 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 05:14:18.231 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 05:14:18.231 1 ERROR cinder     sys.exit(main())
>2018-06-26 05:14:18.231 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 05:14:18.231 1 ERROR cinder     service.wait()
>2018-06-26 05:14:18.231 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 05:14:18.231 1 ERROR cinder     _launcher.wait()
>2018-06-26 05:14:18.231 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 05:14:18.231 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 05:14:18.231 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 05:14:18.231 1 ERROR cinder     self.services.wait()
>2018-06-26 05:14:18.231 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 05:14:18.231 1 ERROR cinder     service.wait()
>2018-06-26 05:14:18.231 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 05:14:18.231 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 05:14:18.231 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 05:14:18.231 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 05:14:18.231 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 05:14:18.231 1 ERROR cinder     post_fn = fn()
>2018-06-26 05:14:18.231 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 05:14:18.231 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 05:14:18.231 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 05:14:18.231 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 05:14:18.231 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 05:14:18.231 1 ERROR cinder 
>2018-06-26 05:14:20.836 1 WARNING cinder.scheduler.host_manager [req-ce9ce559-6934-48d6-bbae-1c8e6c90b9ca - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 05:14:20.842 1 INFO cinder.rpc [req-ce9ce559-6934-48d6-bbae-1c8e6c90b9ca - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 05:14:20.847 1 INFO cinder.rpc [req-ce9ce559-6934-48d6-bbae-1c8e6c90b9ca - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 05:14:20.862 1 INFO cinder.rpc [req-ce9ce559-6934-48d6-bbae-1c8e6c90b9ca - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 05:14:20.868 1 INFO cinder.rpc [req-ce9ce559-6934-48d6-bbae-1c8e6c90b9ca - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 05:14:20.897 1 WARNING oslo_config.cfg [req-ce9ce559-6934-48d6-bbae-1c8e6c90b9ca - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 05:14:20.899 1 WARNING oslo_config.cfg [req-ce9ce559-6934-48d6-bbae-1c8e6c90b9ca - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:14:20.899 1 WARNING oslo_config.cfg [req-ce9ce559-6934-48d6-bbae-1c8e6c90b9ca - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:14:20.900 1 WARNING oslo_config.cfg [req-ce9ce559-6934-48d6-bbae-1c8e6c90b9ca - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:14:20.905 1 WARNING oslo_config.cfg [req-ce9ce559-6934-48d6-bbae-1c8e6c90b9ca - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 05:14:20.906 1 WARNING oslo_config.cfg [req-ce9ce559-6934-48d6-bbae-1c8e6c90b9ca - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 05:14:20.909 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 05:14:20.919 1 INFO cinder.manager [req-0e7af298-c952-43eb-a611-f7c8bdb52677 - - - - -] Initiating service 5 cleanup
>2018-06-26 05:14:20.925 1 INFO cinder.manager [req-0e7af298-c952-43eb-a611-f7c8bdb52677 - - - - -] Service 5 cleanup completed.
>2018-06-26 05:16:25.389 1 ERROR oslo.messaging._drivers.impl_rabbit [req-0e7af298-c952-43eb-a611-f7c8bdb52677 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:16:25.392 1 ERROR oslo.messaging._drivers.impl_rabbit [req-0e7af298-c952-43eb-a611-f7c8bdb52677 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:16:25.392 1 ERROR oslo_service.service [req-0e7af298-c952-43eb-a611-f7c8bdb52677 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:16:25.392 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 05:16:25.392 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 05:16:25.392 1 ERROR oslo_service.service     service.start()
>2018-06-26 05:16:25.392 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 05:16:25.392 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 05:16:25.392 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 05:16:25.392 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 05:16:25.392 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 05:16:25.392 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 05:16:25.392 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 05:16:25.392 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 05:16:25.392 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 05:16:25.392 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 05:16:25.392 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 05:16:25.392 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 05:16:25.392 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 05:16:25.392 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 05:16:25.392 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 05:16:25.392 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 05:16:25.392 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 05:16:25.392 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 05:16:25.392 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 05:16:25.392 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 05:16:25.392 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 05:16:25.392 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 05:16:25.392 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:16:25.392 1 ERROR oslo_service.service 
>2018-06-26 05:16:25.395 1 CRITICAL cinder [req-ce9ce559-6934-48d6-bbae-1c8e6c90b9ca - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 05:16:25.395 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 05:16:25.395 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 05:16:25.395 1 ERROR cinder     sys.exit(main())
>2018-06-26 05:16:25.395 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 05:16:25.395 1 ERROR cinder     service.wait()
>2018-06-26 05:16:25.395 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 05:16:25.395 1 ERROR cinder     _launcher.wait()
>2018-06-26 05:16:25.395 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 05:16:25.395 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 05:16:25.395 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 05:16:25.395 1 ERROR cinder     self.services.wait()
>2018-06-26 05:16:25.395 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 05:16:25.395 1 ERROR cinder     service.wait()
>2018-06-26 05:16:25.395 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 05:16:25.395 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 05:16:25.395 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 05:16:25.395 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 05:16:25.395 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 05:16:25.395 1 ERROR cinder     post_fn = fn()
>2018-06-26 05:16:25.395 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 05:16:25.395 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 05:16:25.395 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 05:16:25.395 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 05:16:25.395 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 05:16:25.395 1 ERROR cinder 
>2018-06-26 05:16:28.036 1 WARNING cinder.scheduler.host_manager [req-27153467-df7f-4117-b380-3236a9937f5f - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 05:16:28.042 1 INFO cinder.rpc [req-27153467-df7f-4117-b380-3236a9937f5f - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 05:16:28.048 1 INFO cinder.rpc [req-27153467-df7f-4117-b380-3236a9937f5f - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 05:16:28.060 1 INFO cinder.rpc [req-27153467-df7f-4117-b380-3236a9937f5f - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 05:16:28.066 1 INFO cinder.rpc [req-27153467-df7f-4117-b380-3236a9937f5f - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 05:16:28.092 1 WARNING oslo_config.cfg [req-27153467-df7f-4117-b380-3236a9937f5f - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 05:16:28.094 1 WARNING oslo_config.cfg [req-27153467-df7f-4117-b380-3236a9937f5f - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:16:28.094 1 WARNING oslo_config.cfg [req-27153467-df7f-4117-b380-3236a9937f5f - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:16:28.095 1 WARNING oslo_config.cfg [req-27153467-df7f-4117-b380-3236a9937f5f - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:16:28.100 1 WARNING oslo_config.cfg [req-27153467-df7f-4117-b380-3236a9937f5f - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 05:16:28.101 1 WARNING oslo_config.cfg [req-27153467-df7f-4117-b380-3236a9937f5f - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 05:16:28.104 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 05:16:28.111 1 INFO cinder.manager [req-81be4e8a-1b3e-40d7-b749-3683457e6be2 - - - - -] Initiating service 5 cleanup
>2018-06-26 05:16:28.115 1 INFO cinder.manager [req-81be4e8a-1b3e-40d7-b749-3683457e6be2 - - - - -] Service 5 cleanup completed.
>2018-06-26 05:18:32.497 1 ERROR oslo.messaging._drivers.impl_rabbit [req-81be4e8a-1b3e-40d7-b749-3683457e6be2 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:18:32.500 1 ERROR oslo.messaging._drivers.impl_rabbit [req-81be4e8a-1b3e-40d7-b749-3683457e6be2 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:18:32.500 1 ERROR oslo_service.service [req-81be4e8a-1b3e-40d7-b749-3683457e6be2 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:18:32.500 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 05:18:32.500 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 05:18:32.500 1 ERROR oslo_service.service     service.start()
>2018-06-26 05:18:32.500 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 05:18:32.500 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 05:18:32.500 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 05:18:32.500 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 05:18:32.500 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 05:18:32.500 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 05:18:32.500 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 05:18:32.500 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 05:18:32.500 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 05:18:32.500 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 05:18:32.500 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 05:18:32.500 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 05:18:32.500 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 05:18:32.500 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 05:18:32.500 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 05:18:32.500 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 05:18:32.500 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 05:18:32.500 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 05:18:32.500 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 05:18:32.500 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 05:18:32.500 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 05:18:32.500 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 05:18:32.500 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:18:32.500 1 ERROR oslo_service.service 
>2018-06-26 05:18:32.503 1 CRITICAL cinder [req-27153467-df7f-4117-b380-3236a9937f5f - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 05:18:32.503 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 05:18:32.503 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 05:18:32.503 1 ERROR cinder     sys.exit(main())
>2018-06-26 05:18:32.503 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 05:18:32.503 1 ERROR cinder     service.wait()
>2018-06-26 05:18:32.503 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 05:18:32.503 1 ERROR cinder     _launcher.wait()
>2018-06-26 05:18:32.503 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 05:18:32.503 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 05:18:32.503 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 05:18:32.503 1 ERROR cinder     self.services.wait()
>2018-06-26 05:18:32.503 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 05:18:32.503 1 ERROR cinder     service.wait()
>2018-06-26 05:18:32.503 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 05:18:32.503 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 05:18:32.503 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 05:18:32.503 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 05:18:32.503 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 05:18:32.503 1 ERROR cinder     post_fn = fn()
>2018-06-26 05:18:32.503 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 05:18:32.503 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 05:18:32.503 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 05:18:32.503 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 05:18:32.503 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 05:18:32.503 1 ERROR cinder 
>2018-06-26 05:18:35.099 1 WARNING cinder.scheduler.host_manager [req-baa1d88a-bd15-4e4f-915b-75e24e6a5329 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 05:18:35.105 1 INFO cinder.rpc [req-baa1d88a-bd15-4e4f-915b-75e24e6a5329 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 05:18:35.110 1 INFO cinder.rpc [req-baa1d88a-bd15-4e4f-915b-75e24e6a5329 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 05:18:35.121 1 INFO cinder.rpc [req-baa1d88a-bd15-4e4f-915b-75e24e6a5329 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 05:18:35.127 1 INFO cinder.rpc [req-baa1d88a-bd15-4e4f-915b-75e24e6a5329 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 05:18:35.151 1 WARNING oslo_config.cfg [req-baa1d88a-bd15-4e4f-915b-75e24e6a5329 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 05:18:35.153 1 WARNING oslo_config.cfg [req-baa1d88a-bd15-4e4f-915b-75e24e6a5329 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:18:35.153 1 WARNING oslo_config.cfg [req-baa1d88a-bd15-4e4f-915b-75e24e6a5329 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:18:35.154 1 WARNING oslo_config.cfg [req-baa1d88a-bd15-4e4f-915b-75e24e6a5329 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:18:35.159 1 WARNING oslo_config.cfg [req-baa1d88a-bd15-4e4f-915b-75e24e6a5329 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 05:18:35.160 1 WARNING oslo_config.cfg [req-baa1d88a-bd15-4e4f-915b-75e24e6a5329 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 05:18:35.165 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 05:18:35.175 1 INFO cinder.manager [req-f675caca-afe8-46cc-ae8a-ea4a35db12a8 - - - - -] Initiating service 5 cleanup
>2018-06-26 05:18:35.181 1 INFO cinder.manager [req-f675caca-afe8-46cc-ae8a-ea4a35db12a8 - - - - -] Service 5 cleanup completed.
>2018-06-26 05:20:39.704 1 ERROR oslo.messaging._drivers.impl_rabbit [req-f675caca-afe8-46cc-ae8a-ea4a35db12a8 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:20:39.707 1 ERROR oslo.messaging._drivers.impl_rabbit [req-f675caca-afe8-46cc-ae8a-ea4a35db12a8 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:20:39.708 1 ERROR oslo_service.service [req-f675caca-afe8-46cc-ae8a-ea4a35db12a8 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:20:39.708 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 05:20:39.708 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 05:20:39.708 1 ERROR oslo_service.service     service.start()
>2018-06-26 05:20:39.708 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 05:20:39.708 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 05:20:39.708 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 05:20:39.708 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 05:20:39.708 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 05:20:39.708 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 05:20:39.708 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 05:20:39.708 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 05:20:39.708 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 05:20:39.708 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 05:20:39.708 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 05:20:39.708 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 05:20:39.708 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 05:20:39.708 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 05:20:39.708 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 05:20:39.708 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 05:20:39.708 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 05:20:39.708 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 05:20:39.708 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 05:20:39.708 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 05:20:39.708 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 05:20:39.708 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 05:20:39.708 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:20:39.708 1 ERROR oslo_service.service 
>2018-06-26 05:20:39.712 1 CRITICAL cinder [req-baa1d88a-bd15-4e4f-915b-75e24e6a5329 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 05:20:39.712 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 05:20:39.712 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 05:20:39.712 1 ERROR cinder     sys.exit(main())
>2018-06-26 05:20:39.712 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 05:20:39.712 1 ERROR cinder     service.wait()
>2018-06-26 05:20:39.712 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 05:20:39.712 1 ERROR cinder     _launcher.wait()
>2018-06-26 05:20:39.712 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 05:20:39.712 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 05:20:39.712 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 05:20:39.712 1 ERROR cinder     self.services.wait()
>2018-06-26 05:20:39.712 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 05:20:39.712 1 ERROR cinder     service.wait()
>2018-06-26 05:20:39.712 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 05:20:39.712 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 05:20:39.712 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 05:20:39.712 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 05:20:39.712 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 05:20:39.712 1 ERROR cinder     post_fn = fn()
>2018-06-26 05:20:39.712 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 05:20:39.712 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 05:20:39.712 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 05:20:39.712 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 05:20:39.712 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 05:20:39.712 1 ERROR cinder 
>2018-06-26 05:20:42.440 1 WARNING cinder.scheduler.host_manager [req-ff8dd7b1-6298-490f-9401-571384100ac7 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 05:20:42.447 1 INFO cinder.rpc [req-ff8dd7b1-6298-490f-9401-571384100ac7 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 05:20:42.454 1 INFO cinder.rpc [req-ff8dd7b1-6298-490f-9401-571384100ac7 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 05:20:42.474 1 INFO cinder.rpc [req-ff8dd7b1-6298-490f-9401-571384100ac7 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 05:20:42.481 1 INFO cinder.rpc [req-ff8dd7b1-6298-490f-9401-571384100ac7 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 05:20:42.516 1 WARNING oslo_config.cfg [req-ff8dd7b1-6298-490f-9401-571384100ac7 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 05:20:42.518 1 WARNING oslo_config.cfg [req-ff8dd7b1-6298-490f-9401-571384100ac7 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:20:42.518 1 WARNING oslo_config.cfg [req-ff8dd7b1-6298-490f-9401-571384100ac7 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:20:42.519 1 WARNING oslo_config.cfg [req-ff8dd7b1-6298-490f-9401-571384100ac7 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:20:42.524 1 WARNING oslo_config.cfg [req-ff8dd7b1-6298-490f-9401-571384100ac7 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 05:20:42.525 1 WARNING oslo_config.cfg [req-ff8dd7b1-6298-490f-9401-571384100ac7 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 05:20:42.528 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 05:20:42.533 1 INFO cinder.manager [req-a2694174-79f4-41c0-a683-79d7e1182026 - - - - -] Initiating service 5 cleanup
>2018-06-26 05:20:42.538 1 INFO cinder.manager [req-a2694174-79f4-41c0-a683-79d7e1182026 - - - - -] Service 5 cleanup completed.
>2018-06-26 05:22:48.692 1 ERROR oslo.messaging._drivers.impl_rabbit [req-a2694174-79f4-41c0-a683-79d7e1182026 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:22:48.694 1 ERROR oslo.messaging._drivers.impl_rabbit [req-a2694174-79f4-41c0-a683-79d7e1182026 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:22:48.695 1 ERROR oslo_service.service [req-a2694174-79f4-41c0-a683-79d7e1182026 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:22:48.695 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 05:22:48.695 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 05:22:48.695 1 ERROR oslo_service.service     service.start()
>2018-06-26 05:22:48.695 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 05:22:48.695 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 05:22:48.695 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 05:22:48.695 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 05:22:48.695 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 05:22:48.695 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 05:22:48.695 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 05:22:48.695 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 05:22:48.695 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 05:22:48.695 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 05:22:48.695 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 05:22:48.695 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 05:22:48.695 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 05:22:48.695 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 05:22:48.695 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 05:22:48.695 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 05:22:48.695 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 05:22:48.695 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 05:22:48.695 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 05:22:48.695 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 05:22:48.695 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 05:22:48.695 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 05:22:48.695 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:22:48.695 1 ERROR oslo_service.service 
>2018-06-26 05:22:48.698 1 CRITICAL cinder [req-ff8dd7b1-6298-490f-9401-571384100ac7 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 05:22:48.698 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 05:22:48.698 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 05:22:48.698 1 ERROR cinder     sys.exit(main())
>2018-06-26 05:22:48.698 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 05:22:48.698 1 ERROR cinder     service.wait()
>2018-06-26 05:22:48.698 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 05:22:48.698 1 ERROR cinder     _launcher.wait()
>2018-06-26 05:22:48.698 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 05:22:48.698 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 05:22:48.698 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 05:22:48.698 1 ERROR cinder     self.services.wait()
>2018-06-26 05:22:48.698 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 05:22:48.698 1 ERROR cinder     service.wait()
>2018-06-26 05:22:48.698 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 05:22:48.698 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 05:22:48.698 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 05:22:48.698 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 05:22:48.698 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 05:22:48.698 1 ERROR cinder     post_fn = fn()
>2018-06-26 05:22:48.698 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 05:22:48.698 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 05:22:48.698 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 05:22:48.698 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 05:22:48.698 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 05:22:48.698 1 ERROR cinder 
>2018-06-26 05:22:51.397 1 WARNING cinder.scheduler.host_manager [req-bc6ce65d-ca59-4c89-896e-4f97e724a7aa - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 05:22:51.404 1 INFO cinder.rpc [req-bc6ce65d-ca59-4c89-896e-4f97e724a7aa - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 05:22:51.410 1 INFO cinder.rpc [req-bc6ce65d-ca59-4c89-896e-4f97e724a7aa - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 05:22:51.420 1 INFO cinder.rpc [req-bc6ce65d-ca59-4c89-896e-4f97e724a7aa - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 05:22:51.426 1 INFO cinder.rpc [req-bc6ce65d-ca59-4c89-896e-4f97e724a7aa - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 05:22:51.447 1 WARNING oslo_config.cfg [req-bc6ce65d-ca59-4c89-896e-4f97e724a7aa - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 05:22:51.449 1 WARNING oslo_config.cfg [req-bc6ce65d-ca59-4c89-896e-4f97e724a7aa - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:22:51.450 1 WARNING oslo_config.cfg [req-bc6ce65d-ca59-4c89-896e-4f97e724a7aa - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:22:51.450 1 WARNING oslo_config.cfg [req-bc6ce65d-ca59-4c89-896e-4f97e724a7aa - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:22:51.455 1 WARNING oslo_config.cfg [req-bc6ce65d-ca59-4c89-896e-4f97e724a7aa - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 05:22:51.456 1 WARNING oslo_config.cfg [req-bc6ce65d-ca59-4c89-896e-4f97e724a7aa - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 05:22:51.459 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 05:22:51.464 1 INFO cinder.manager [req-3e7684e2-d769-4595-8633-6cb3f5840455 - - - - -] Initiating service 5 cleanup
>2018-06-26 05:22:51.469 1 INFO cinder.manager [req-3e7684e2-d769-4595-8633-6cb3f5840455 - - - - -] Service 5 cleanup completed.
>2018-06-26 05:25:02.857 1 ERROR oslo.messaging._drivers.impl_rabbit [req-3e7684e2-d769-4595-8633-6cb3f5840455 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:25:02.860 1 ERROR oslo.messaging._drivers.impl_rabbit [req-3e7684e2-d769-4595-8633-6cb3f5840455 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:25:02.861 1 ERROR oslo_service.service [req-3e7684e2-d769-4595-8633-6cb3f5840455 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:25:02.861 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 05:25:02.861 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 05:25:02.861 1 ERROR oslo_service.service     service.start()
>2018-06-26 05:25:02.861 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 05:25:02.861 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 05:25:02.861 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 05:25:02.861 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 05:25:02.861 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 05:25:02.861 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 05:25:02.861 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 05:25:02.861 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 05:25:02.861 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 05:25:02.861 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 05:25:02.861 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 05:25:02.861 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 05:25:02.861 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 05:25:02.861 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 05:25:02.861 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 05:25:02.861 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 05:25:02.861 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 05:25:02.861 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 05:25:02.861 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 05:25:02.861 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 05:25:02.861 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 05:25:02.861 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 05:25:02.861 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:25:02.861 1 ERROR oslo_service.service 
>2018-06-26 05:25:02.864 1 CRITICAL cinder [req-bc6ce65d-ca59-4c89-896e-4f97e724a7aa - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 05:25:02.864 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 05:25:02.864 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 05:25:02.864 1 ERROR cinder     sys.exit(main())
>2018-06-26 05:25:02.864 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 05:25:02.864 1 ERROR cinder     service.wait()
>2018-06-26 05:25:02.864 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 05:25:02.864 1 ERROR cinder     _launcher.wait()
>2018-06-26 05:25:02.864 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 05:25:02.864 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 05:25:02.864 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 05:25:02.864 1 ERROR cinder     self.services.wait()
>2018-06-26 05:25:02.864 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 05:25:02.864 1 ERROR cinder     service.wait()
>2018-06-26 05:25:02.864 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 05:25:02.864 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 05:25:02.864 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 05:25:02.864 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 05:25:02.864 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 05:25:02.864 1 ERROR cinder     post_fn = fn()
>2018-06-26 05:25:02.864 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 05:25:02.864 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 05:25:02.864 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 05:25:02.864 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 05:25:02.864 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 05:25:02.864 1 ERROR cinder 
>2018-06-26 05:25:05.526 1 WARNING cinder.scheduler.host_manager [req-c0e53050-239c-494d-a137-d0239d69a48a - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 05:25:05.532 1 INFO cinder.rpc [req-c0e53050-239c-494d-a137-d0239d69a48a - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 05:25:05.539 1 INFO cinder.rpc [req-c0e53050-239c-494d-a137-d0239d69a48a - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 05:25:05.555 1 INFO cinder.rpc [req-c0e53050-239c-494d-a137-d0239d69a48a - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 05:25:05.562 1 INFO cinder.rpc [req-c0e53050-239c-494d-a137-d0239d69a48a - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 05:25:05.586 1 WARNING oslo_config.cfg [req-c0e53050-239c-494d-a137-d0239d69a48a - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 05:25:05.589 1 WARNING oslo_config.cfg [req-c0e53050-239c-494d-a137-d0239d69a48a - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:25:05.589 1 WARNING oslo_config.cfg [req-c0e53050-239c-494d-a137-d0239d69a48a - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:25:05.590 1 WARNING oslo_config.cfg [req-c0e53050-239c-494d-a137-d0239d69a48a - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:25:05.595 1 WARNING oslo_config.cfg [req-c0e53050-239c-494d-a137-d0239d69a48a - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 05:25:05.596 1 WARNING oslo_config.cfg [req-c0e53050-239c-494d-a137-d0239d69a48a - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 05:25:05.599 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 05:25:05.605 1 INFO cinder.manager [req-9cb9c671-7ae9-4654-8281-d9fc77e4df1e - - - - -] Initiating service 5 cleanup
>2018-06-26 05:25:05.610 1 INFO cinder.manager [req-9cb9c671-7ae9-4654-8281-d9fc77e4df1e - - - - -] Service 5 cleanup completed.
>2018-06-26 05:27:09.884 1 ERROR oslo.messaging._drivers.impl_rabbit [req-9cb9c671-7ae9-4654-8281-d9fc77e4df1e - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:27:09.886 1 ERROR oslo.messaging._drivers.impl_rabbit [req-9cb9c671-7ae9-4654-8281-d9fc77e4df1e - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:27:09.886 1 ERROR oslo_service.service [req-9cb9c671-7ae9-4654-8281-d9fc77e4df1e - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:27:09.886 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 05:27:09.886 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 05:27:09.886 1 ERROR oslo_service.service     service.start()
>2018-06-26 05:27:09.886 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 05:27:09.886 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 05:27:09.886 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 05:27:09.886 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 05:27:09.886 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 05:27:09.886 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 05:27:09.886 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 05:27:09.886 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 05:27:09.886 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 05:27:09.886 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 05:27:09.886 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 05:27:09.886 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 05:27:09.886 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 05:27:09.886 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 05:27:09.886 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 05:27:09.886 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 05:27:09.886 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 05:27:09.886 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 05:27:09.886 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 05:27:09.886 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 05:27:09.886 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 05:27:09.886 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 05:27:09.886 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:27:09.886 1 ERROR oslo_service.service 
>2018-06-26 05:27:09.889 1 CRITICAL cinder [req-c0e53050-239c-494d-a137-d0239d69a48a - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 05:27:09.889 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 05:27:09.889 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 05:27:09.889 1 ERROR cinder     sys.exit(main())
>2018-06-26 05:27:09.889 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 05:27:09.889 1 ERROR cinder     service.wait()
>2018-06-26 05:27:09.889 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 05:27:09.889 1 ERROR cinder     _launcher.wait()
>2018-06-26 05:27:09.889 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 05:27:09.889 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 05:27:09.889 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 05:27:09.889 1 ERROR cinder     self.services.wait()
>2018-06-26 05:27:09.889 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 05:27:09.889 1 ERROR cinder     service.wait()
>2018-06-26 05:27:09.889 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 05:27:09.889 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 05:27:09.889 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 05:27:09.889 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 05:27:09.889 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 05:27:09.889 1 ERROR cinder     post_fn = fn()
>2018-06-26 05:27:09.889 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 05:27:09.889 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 05:27:09.889 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 05:27:09.889 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 05:27:09.889 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 05:27:09.889 1 ERROR cinder 
>2018-06-26 05:27:12.465 1 WARNING cinder.scheduler.host_manager [req-b5d173cf-f8a0-45ed-8b1c-a4d0f64a9e7b - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 05:27:12.472 1 INFO cinder.rpc [req-b5d173cf-f8a0-45ed-8b1c-a4d0f64a9e7b - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 05:27:12.478 1 INFO cinder.rpc [req-b5d173cf-f8a0-45ed-8b1c-a4d0f64a9e7b - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 05:27:12.493 1 INFO cinder.rpc [req-b5d173cf-f8a0-45ed-8b1c-a4d0f64a9e7b - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 05:27:12.500 1 INFO cinder.rpc [req-b5d173cf-f8a0-45ed-8b1c-a4d0f64a9e7b - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 05:27:12.533 1 WARNING oslo_config.cfg [req-b5d173cf-f8a0-45ed-8b1c-a4d0f64a9e7b - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 05:27:12.535 1 WARNING oslo_config.cfg [req-b5d173cf-f8a0-45ed-8b1c-a4d0f64a9e7b - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:27:12.536 1 WARNING oslo_config.cfg [req-b5d173cf-f8a0-45ed-8b1c-a4d0f64a9e7b - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:27:12.536 1 WARNING oslo_config.cfg [req-b5d173cf-f8a0-45ed-8b1c-a4d0f64a9e7b - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:27:12.542 1 WARNING oslo_config.cfg [req-b5d173cf-f8a0-45ed-8b1c-a4d0f64a9e7b - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 05:27:12.544 1 WARNING oslo_config.cfg [req-b5d173cf-f8a0-45ed-8b1c-a4d0f64a9e7b - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 05:27:12.546 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 05:27:12.553 1 INFO cinder.manager [req-578d8f75-e90b-4a98-babf-57bc8853dba8 - - - - -] Initiating service 5 cleanup
>2018-06-26 05:27:12.560 1 INFO cinder.manager [req-578d8f75-e90b-4a98-babf-57bc8853dba8 - - - - -] Service 5 cleanup completed.
>2018-06-26 05:29:17.135 1 ERROR oslo.messaging._drivers.impl_rabbit [req-578d8f75-e90b-4a98-babf-57bc8853dba8 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:29:17.137 1 ERROR oslo.messaging._drivers.impl_rabbit [req-578d8f75-e90b-4a98-babf-57bc8853dba8 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:29:17.137 1 ERROR oslo_service.service [req-578d8f75-e90b-4a98-babf-57bc8853dba8 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:29:17.137 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 05:29:17.137 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 05:29:17.137 1 ERROR oslo_service.service     service.start()
>2018-06-26 05:29:17.137 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 05:29:17.137 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 05:29:17.137 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 05:29:17.137 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 05:29:17.137 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 05:29:17.137 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 05:29:17.137 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 05:29:17.137 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 05:29:17.137 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 05:29:17.137 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 05:29:17.137 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 05:29:17.137 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 05:29:17.137 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 05:29:17.137 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 05:29:17.137 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 05:29:17.137 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 05:29:17.137 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 05:29:17.137 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 05:29:17.137 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 05:29:17.137 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 05:29:17.137 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 05:29:17.137 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 05:29:17.137 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:29:17.137 1 ERROR oslo_service.service 
>2018-06-26 05:29:17.140 1 CRITICAL cinder [req-b5d173cf-f8a0-45ed-8b1c-a4d0f64a9e7b - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 05:29:17.140 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 05:29:17.140 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 05:29:17.140 1 ERROR cinder     sys.exit(main())
>2018-06-26 05:29:17.140 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 05:29:17.140 1 ERROR cinder     service.wait()
>2018-06-26 05:29:17.140 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 05:29:17.140 1 ERROR cinder     _launcher.wait()
>2018-06-26 05:29:17.140 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 05:29:17.140 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 05:29:17.140 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 05:29:17.140 1 ERROR cinder     self.services.wait()
>2018-06-26 05:29:17.140 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 05:29:17.140 1 ERROR cinder     service.wait()
>2018-06-26 05:29:17.140 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 05:29:17.140 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 05:29:17.140 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 05:29:17.140 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 05:29:17.140 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 05:29:17.140 1 ERROR cinder     post_fn = fn()
>2018-06-26 05:29:17.140 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 05:29:17.140 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 05:29:17.140 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 05:29:17.140 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 05:29:17.140 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 05:29:17.140 1 ERROR cinder 
>2018-06-26 05:29:19.819 1 WARNING cinder.scheduler.host_manager [req-abebbde3-7bb5-4bd7-b5f2-94536980a968 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 05:29:19.826 1 INFO cinder.rpc [req-abebbde3-7bb5-4bd7-b5f2-94536980a968 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 05:29:19.839 1 INFO cinder.rpc [req-abebbde3-7bb5-4bd7-b5f2-94536980a968 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 05:29:19.854 1 INFO cinder.rpc [req-abebbde3-7bb5-4bd7-b5f2-94536980a968 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 05:29:19.861 1 INFO cinder.rpc [req-abebbde3-7bb5-4bd7-b5f2-94536980a968 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 05:29:19.896 1 WARNING oslo_config.cfg [req-abebbde3-7bb5-4bd7-b5f2-94536980a968 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 05:29:19.899 1 WARNING oslo_config.cfg [req-abebbde3-7bb5-4bd7-b5f2-94536980a968 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:29:19.899 1 WARNING oslo_config.cfg [req-abebbde3-7bb5-4bd7-b5f2-94536980a968 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:29:19.900 1 WARNING oslo_config.cfg [req-abebbde3-7bb5-4bd7-b5f2-94536980a968 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:29:19.905 1 WARNING oslo_config.cfg [req-abebbde3-7bb5-4bd7-b5f2-94536980a968 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 05:29:19.906 1 WARNING oslo_config.cfg [req-abebbde3-7bb5-4bd7-b5f2-94536980a968 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 05:29:19.909 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 05:29:19.917 1 INFO cinder.manager [req-15dc7dea-05ba-42d5-a2e8-3a4c6642884d - - - - -] Initiating service 5 cleanup
>2018-06-26 05:29:19.924 1 INFO cinder.manager [req-15dc7dea-05ba-42d5-a2e8-3a4c6642884d - - - - -] Service 5 cleanup completed.
>2018-06-26 05:31:24.266 1 ERROR oslo.messaging._drivers.impl_rabbit [req-15dc7dea-05ba-42d5-a2e8-3a4c6642884d - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:31:24.268 1 ERROR oslo.messaging._drivers.impl_rabbit [req-15dc7dea-05ba-42d5-a2e8-3a4c6642884d - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:31:24.269 1 ERROR oslo_service.service [req-15dc7dea-05ba-42d5-a2e8-3a4c6642884d - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:31:24.269 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 05:31:24.269 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 05:31:24.269 1 ERROR oslo_service.service     service.start()
>2018-06-26 05:31:24.269 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 05:31:24.269 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 05:31:24.269 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 05:31:24.269 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 05:31:24.269 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 05:31:24.269 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 05:31:24.269 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 05:31:24.269 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 05:31:24.269 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 05:31:24.269 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 05:31:24.269 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 05:31:24.269 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 05:31:24.269 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 05:31:24.269 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 05:31:24.269 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 05:31:24.269 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 05:31:24.269 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 05:31:24.269 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 05:31:24.269 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 05:31:24.269 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 05:31:24.269 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 05:31:24.269 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 05:31:24.269 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:31:24.269 1 ERROR oslo_service.service 
>2018-06-26 05:31:24.271 1 CRITICAL cinder [req-abebbde3-7bb5-4bd7-b5f2-94536980a968 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 05:31:24.271 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 05:31:24.271 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 05:31:24.271 1 ERROR cinder     sys.exit(main())
>2018-06-26 05:31:24.271 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 05:31:24.271 1 ERROR cinder     service.wait()
>2018-06-26 05:31:24.271 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 05:31:24.271 1 ERROR cinder     _launcher.wait()
>2018-06-26 05:31:24.271 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 05:31:24.271 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 05:31:24.271 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 05:31:24.271 1 ERROR cinder     self.services.wait()
>2018-06-26 05:31:24.271 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 05:31:24.271 1 ERROR cinder     service.wait()
>2018-06-26 05:31:24.271 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 05:31:24.271 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 05:31:24.271 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 05:31:24.271 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 05:31:24.271 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 05:31:24.271 1 ERROR cinder     post_fn = fn()
>2018-06-26 05:31:24.271 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 05:31:24.271 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 05:31:24.271 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 05:31:24.271 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 05:31:24.271 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 05:31:24.271 1 ERROR cinder 
>2018-06-26 05:31:26.961 1 WARNING cinder.scheduler.host_manager [req-13c81a79-a222-4ec8-81a6-3a52ef5784ed - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 05:31:26.967 1 INFO cinder.rpc [req-13c81a79-a222-4ec8-81a6-3a52ef5784ed - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 05:31:26.972 1 INFO cinder.rpc [req-13c81a79-a222-4ec8-81a6-3a52ef5784ed - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 05:31:26.988 1 INFO cinder.rpc [req-13c81a79-a222-4ec8-81a6-3a52ef5784ed - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 05:31:26.993 1 INFO cinder.rpc [req-13c81a79-a222-4ec8-81a6-3a52ef5784ed - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 05:31:27.020 1 WARNING oslo_config.cfg [req-13c81a79-a222-4ec8-81a6-3a52ef5784ed - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 05:31:27.022 1 WARNING oslo_config.cfg [req-13c81a79-a222-4ec8-81a6-3a52ef5784ed - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:31:27.023 1 WARNING oslo_config.cfg [req-13c81a79-a222-4ec8-81a6-3a52ef5784ed - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:31:27.023 1 WARNING oslo_config.cfg [req-13c81a79-a222-4ec8-81a6-3a52ef5784ed - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:31:27.028 1 WARNING oslo_config.cfg [req-13c81a79-a222-4ec8-81a6-3a52ef5784ed - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 05:31:27.029 1 WARNING oslo_config.cfg [req-13c81a79-a222-4ec8-81a6-3a52ef5784ed - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 05:31:27.032 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 05:31:27.038 1 INFO cinder.manager [req-b736822e-a45f-4da4-aa68-b7c6876cd6b4 - - - - -] Initiating service 5 cleanup
>2018-06-26 05:31:27.042 1 INFO cinder.manager [req-b736822e-a45f-4da4-aa68-b7c6876cd6b4 - - - - -] Service 5 cleanup completed.
>2018-06-26 05:33:38.727 1 ERROR oslo.messaging._drivers.impl_rabbit [req-b736822e-a45f-4da4-aa68-b7c6876cd6b4 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:33:38.729 1 ERROR oslo.messaging._drivers.impl_rabbit [req-b736822e-a45f-4da4-aa68-b7c6876cd6b4 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:33:38.729 1 ERROR oslo_service.service [req-b736822e-a45f-4da4-aa68-b7c6876cd6b4 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:33:38.729 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 05:33:38.729 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 05:33:38.729 1 ERROR oslo_service.service     service.start()
>2018-06-26 05:33:38.729 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 05:33:38.729 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 05:33:38.729 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 05:33:38.729 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 05:33:38.729 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 05:33:38.729 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 05:33:38.729 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 05:33:38.729 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 05:33:38.729 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 05:33:38.729 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 05:33:38.729 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 05:33:38.729 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 05:33:38.729 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 05:33:38.729 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 05:33:38.729 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 05:33:38.729 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 05:33:38.729 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 05:33:38.729 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 05:33:38.729 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 05:33:38.729 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 05:33:38.729 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 05:33:38.729 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 05:33:38.729 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:33:38.729 1 ERROR oslo_service.service 
>2018-06-26 05:33:38.732 1 CRITICAL cinder [req-13c81a79-a222-4ec8-81a6-3a52ef5784ed - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 05:33:38.732 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 05:33:38.732 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 05:33:38.732 1 ERROR cinder     sys.exit(main())
>2018-06-26 05:33:38.732 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 05:33:38.732 1 ERROR cinder     service.wait()
>2018-06-26 05:33:38.732 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 05:33:38.732 1 ERROR cinder     _launcher.wait()
>2018-06-26 05:33:38.732 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 05:33:38.732 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 05:33:38.732 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 05:33:38.732 1 ERROR cinder     self.services.wait()
>2018-06-26 05:33:38.732 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 05:33:38.732 1 ERROR cinder     service.wait()
>2018-06-26 05:33:38.732 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 05:33:38.732 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 05:33:38.732 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 05:33:38.732 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 05:33:38.732 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 05:33:38.732 1 ERROR cinder     post_fn = fn()
>2018-06-26 05:33:38.732 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 05:33:38.732 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 05:33:38.732 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 05:33:38.732 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 05:33:38.732 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 05:33:38.732 1 ERROR cinder 
>2018-06-26 05:33:41.333 1 WARNING cinder.scheduler.host_manager [req-70b17632-fd3e-4f71-a3ab-3e2d1e56ee3c - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 05:33:41.339 1 INFO cinder.rpc [req-70b17632-fd3e-4f71-a3ab-3e2d1e56ee3c - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 05:33:41.345 1 INFO cinder.rpc [req-70b17632-fd3e-4f71-a3ab-3e2d1e56ee3c - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 05:33:41.357 1 INFO cinder.rpc [req-70b17632-fd3e-4f71-a3ab-3e2d1e56ee3c - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 05:33:41.362 1 INFO cinder.rpc [req-70b17632-fd3e-4f71-a3ab-3e2d1e56ee3c - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 05:33:41.383 1 WARNING oslo_config.cfg [req-70b17632-fd3e-4f71-a3ab-3e2d1e56ee3c - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 05:33:41.385 1 WARNING oslo_config.cfg [req-70b17632-fd3e-4f71-a3ab-3e2d1e56ee3c - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:33:41.386 1 WARNING oslo_config.cfg [req-70b17632-fd3e-4f71-a3ab-3e2d1e56ee3c - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:33:41.386 1 WARNING oslo_config.cfg [req-70b17632-fd3e-4f71-a3ab-3e2d1e56ee3c - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:33:41.391 1 WARNING oslo_config.cfg [req-70b17632-fd3e-4f71-a3ab-3e2d1e56ee3c - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 05:33:41.392 1 WARNING oslo_config.cfg [req-70b17632-fd3e-4f71-a3ab-3e2d1e56ee3c - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 05:33:41.395 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 05:33:41.402 1 INFO cinder.manager [req-941c6d2f-ebf9-4dae-bc8b-03d722739480 - - - - -] Initiating service 5 cleanup
>2018-06-26 05:33:41.407 1 INFO cinder.manager [req-941c6d2f-ebf9-4dae-bc8b-03d722739480 - - - - -] Service 5 cleanup completed.
>2018-06-26 05:35:52.870 1 ERROR oslo.messaging._drivers.impl_rabbit [req-941c6d2f-ebf9-4dae-bc8b-03d722739480 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:35:52.874 1 ERROR oslo.messaging._drivers.impl_rabbit [req-941c6d2f-ebf9-4dae-bc8b-03d722739480 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:35:52.875 1 ERROR oslo_service.service [req-941c6d2f-ebf9-4dae-bc8b-03d722739480 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:35:52.875 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 05:35:52.875 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 05:35:52.875 1 ERROR oslo_service.service     service.start()
>2018-06-26 05:35:52.875 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 05:35:52.875 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 05:35:52.875 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 05:35:52.875 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 05:35:52.875 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 05:35:52.875 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 05:35:52.875 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 05:35:52.875 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 05:35:52.875 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 05:35:52.875 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 05:35:52.875 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 05:35:52.875 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 05:35:52.875 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 05:35:52.875 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 05:35:52.875 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 05:35:52.875 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 05:35:52.875 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 05:35:52.875 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 05:35:52.875 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 05:35:52.875 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 05:35:52.875 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 05:35:52.875 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 05:35:52.875 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:35:52.875 1 ERROR oslo_service.service 
>2018-06-26 05:35:52.878 1 CRITICAL cinder [req-70b17632-fd3e-4f71-a3ab-3e2d1e56ee3c - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 05:35:52.878 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 05:35:52.878 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 05:35:52.878 1 ERROR cinder     sys.exit(main())
>2018-06-26 05:35:52.878 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 05:35:52.878 1 ERROR cinder     service.wait()
>2018-06-26 05:35:52.878 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 05:35:52.878 1 ERROR cinder     _launcher.wait()
>2018-06-26 05:35:52.878 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 05:35:52.878 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 05:35:52.878 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 05:35:52.878 1 ERROR cinder     self.services.wait()
>2018-06-26 05:35:52.878 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 05:35:52.878 1 ERROR cinder     service.wait()
>2018-06-26 05:35:52.878 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 05:35:52.878 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 05:35:52.878 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 05:35:52.878 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 05:35:52.878 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 05:35:52.878 1 ERROR cinder     post_fn = fn()
>2018-06-26 05:35:52.878 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 05:35:52.878 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 05:35:52.878 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 05:35:52.878 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 05:35:52.878 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 05:35:52.878 1 ERROR cinder 
>2018-06-26 05:35:55.562 1 WARNING cinder.scheduler.host_manager [req-8307993a-e542-489e-a743-d7add0e6a87e - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 05:35:55.570 1 INFO cinder.rpc [req-8307993a-e542-489e-a743-d7add0e6a87e - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 05:35:55.576 1 INFO cinder.rpc [req-8307993a-e542-489e-a743-d7add0e6a87e - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 05:35:55.589 1 INFO cinder.rpc [req-8307993a-e542-489e-a743-d7add0e6a87e - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 05:35:55.606 1 INFO cinder.rpc [req-8307993a-e542-489e-a743-d7add0e6a87e - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 05:35:55.632 1 WARNING oslo_config.cfg [req-8307993a-e542-489e-a743-d7add0e6a87e - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 05:35:55.634 1 WARNING oslo_config.cfg [req-8307993a-e542-489e-a743-d7add0e6a87e - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:35:55.635 1 WARNING oslo_config.cfg [req-8307993a-e542-489e-a743-d7add0e6a87e - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:35:55.636 1 WARNING oslo_config.cfg [req-8307993a-e542-489e-a743-d7add0e6a87e - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:35:55.640 1 WARNING oslo_config.cfg [req-8307993a-e542-489e-a743-d7add0e6a87e - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 05:35:55.641 1 WARNING oslo_config.cfg [req-8307993a-e542-489e-a743-d7add0e6a87e - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 05:35:55.644 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 05:35:55.652 1 INFO cinder.manager [req-fc5a6e55-96ec-4f85-831b-98b60c3f6818 - - - - -] Initiating service 5 cleanup
>2018-06-26 05:35:55.658 1 INFO cinder.manager [req-fc5a6e55-96ec-4f85-831b-98b60c3f6818 - - - - -] Service 5 cleanup completed.
>2018-06-26 05:38:07.197 1 ERROR oslo.messaging._drivers.impl_rabbit [req-fc5a6e55-96ec-4f85-831b-98b60c3f6818 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:38:07.199 1 ERROR oslo.messaging._drivers.impl_rabbit [req-fc5a6e55-96ec-4f85-831b-98b60c3f6818 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:38:07.199 1 ERROR oslo_service.service [req-fc5a6e55-96ec-4f85-831b-98b60c3f6818 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:38:07.199 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 05:38:07.199 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 05:38:07.199 1 ERROR oslo_service.service     service.start()
>2018-06-26 05:38:07.199 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 05:38:07.199 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 05:38:07.199 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 05:38:07.199 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 05:38:07.199 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 05:38:07.199 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 05:38:07.199 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 05:38:07.199 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 05:38:07.199 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 05:38:07.199 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 05:38:07.199 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 05:38:07.199 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 05:38:07.199 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 05:38:07.199 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 05:38:07.199 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 05:38:07.199 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 05:38:07.199 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 05:38:07.199 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 05:38:07.199 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 05:38:07.199 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 05:38:07.199 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 05:38:07.199 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 05:38:07.199 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:38:07.199 1 ERROR oslo_service.service 
>2018-06-26 05:38:07.202 1 CRITICAL cinder [req-8307993a-e542-489e-a743-d7add0e6a87e - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 05:38:07.202 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 05:38:07.202 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 05:38:07.202 1 ERROR cinder     sys.exit(main())
>2018-06-26 05:38:07.202 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 05:38:07.202 1 ERROR cinder     service.wait()
>2018-06-26 05:38:07.202 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 05:38:07.202 1 ERROR cinder     _launcher.wait()
>2018-06-26 05:38:07.202 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 05:38:07.202 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 05:38:07.202 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 05:38:07.202 1 ERROR cinder     self.services.wait()
>2018-06-26 05:38:07.202 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 05:38:07.202 1 ERROR cinder     service.wait()
>2018-06-26 05:38:07.202 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 05:38:07.202 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 05:38:07.202 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 05:38:07.202 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 05:38:07.202 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 05:38:07.202 1 ERROR cinder     post_fn = fn()
>2018-06-26 05:38:07.202 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 05:38:07.202 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 05:38:07.202 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 05:38:07.202 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 05:38:07.202 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 05:38:07.202 1 ERROR cinder 
>2018-06-26 05:38:09.751 1 WARNING cinder.scheduler.host_manager [req-0976e45b-365e-48d2-b0ec-445ef80fe684 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 05:38:09.757 1 INFO cinder.rpc [req-0976e45b-365e-48d2-b0ec-445ef80fe684 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 05:38:09.762 1 INFO cinder.rpc [req-0976e45b-365e-48d2-b0ec-445ef80fe684 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 05:38:09.773 1 INFO cinder.rpc [req-0976e45b-365e-48d2-b0ec-445ef80fe684 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 05:38:09.779 1 INFO cinder.rpc [req-0976e45b-365e-48d2-b0ec-445ef80fe684 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 05:38:09.800 1 WARNING oslo_config.cfg [req-0976e45b-365e-48d2-b0ec-445ef80fe684 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 05:38:09.802 1 WARNING oslo_config.cfg [req-0976e45b-365e-48d2-b0ec-445ef80fe684 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:38:09.803 1 WARNING oslo_config.cfg [req-0976e45b-365e-48d2-b0ec-445ef80fe684 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:38:09.804 1 WARNING oslo_config.cfg [req-0976e45b-365e-48d2-b0ec-445ef80fe684 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:38:09.809 1 WARNING oslo_config.cfg [req-0976e45b-365e-48d2-b0ec-445ef80fe684 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 05:38:09.810 1 WARNING oslo_config.cfg [req-0976e45b-365e-48d2-b0ec-445ef80fe684 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 05:38:09.812 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 05:38:09.818 1 INFO cinder.manager [req-8277acab-e3b0-4f7a-8724-ea67c4937c3e - - - - -] Initiating service 5 cleanup
>2018-06-26 05:38:09.823 1 INFO cinder.manager [req-8277acab-e3b0-4f7a-8724-ea67c4937c3e - - - - -] Service 5 cleanup completed.
>2018-06-26 05:40:21.586 1 ERROR oslo.messaging._drivers.impl_rabbit [req-8277acab-e3b0-4f7a-8724-ea67c4937c3e - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:40:21.587 1 ERROR oslo.messaging._drivers.impl_rabbit [req-8277acab-e3b0-4f7a-8724-ea67c4937c3e - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:40:21.588 1 ERROR oslo_service.service [req-8277acab-e3b0-4f7a-8724-ea67c4937c3e - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:40:21.588 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 05:40:21.588 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 05:40:21.588 1 ERROR oslo_service.service     service.start()
>2018-06-26 05:40:21.588 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 05:40:21.588 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 05:40:21.588 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 05:40:21.588 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 05:40:21.588 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 05:40:21.588 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 05:40:21.588 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 05:40:21.588 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 05:40:21.588 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 05:40:21.588 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 05:40:21.588 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 05:40:21.588 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 05:40:21.588 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 05:40:21.588 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 05:40:21.588 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 05:40:21.588 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 05:40:21.588 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 05:40:21.588 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 05:40:21.588 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 05:40:21.588 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 05:40:21.588 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 05:40:21.588 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 05:40:21.588 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:40:21.588 1 ERROR oslo_service.service 
>2018-06-26 05:40:21.591 1 CRITICAL cinder [req-0976e45b-365e-48d2-b0ec-445ef80fe684 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 05:40:21.591 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 05:40:21.591 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 05:40:21.591 1 ERROR cinder     sys.exit(main())
>2018-06-26 05:40:21.591 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 05:40:21.591 1 ERROR cinder     service.wait()
>2018-06-26 05:40:21.591 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 05:40:21.591 1 ERROR cinder     _launcher.wait()
>2018-06-26 05:40:21.591 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 05:40:21.591 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 05:40:21.591 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 05:40:21.591 1 ERROR cinder     self.services.wait()
>2018-06-26 05:40:21.591 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 05:40:21.591 1 ERROR cinder     service.wait()
>2018-06-26 05:40:21.591 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 05:40:21.591 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 05:40:21.591 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 05:40:21.591 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 05:40:21.591 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 05:40:21.591 1 ERROR cinder     post_fn = fn()
>2018-06-26 05:40:21.591 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 05:40:21.591 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 05:40:21.591 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 05:40:21.591 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 05:40:21.591 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 05:40:21.591 1 ERROR cinder 
>2018-06-26 05:40:24.178 1 WARNING cinder.scheduler.host_manager [req-85be9a0c-0808-4141-8494-2f4985cf914c - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 05:40:24.184 1 INFO cinder.rpc [req-85be9a0c-0808-4141-8494-2f4985cf914c - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 05:40:24.189 1 INFO cinder.rpc [req-85be9a0c-0808-4141-8494-2f4985cf914c - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 05:40:24.204 1 INFO cinder.rpc [req-85be9a0c-0808-4141-8494-2f4985cf914c - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 05:40:24.209 1 INFO cinder.rpc [req-85be9a0c-0808-4141-8494-2f4985cf914c - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 05:40:24.232 1 WARNING oslo_config.cfg [req-85be9a0c-0808-4141-8494-2f4985cf914c - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 05:40:24.234 1 WARNING oslo_config.cfg [req-85be9a0c-0808-4141-8494-2f4985cf914c - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:40:24.235 1 WARNING oslo_config.cfg [req-85be9a0c-0808-4141-8494-2f4985cf914c - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:40:24.236 1 WARNING oslo_config.cfg [req-85be9a0c-0808-4141-8494-2f4985cf914c - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:40:24.241 1 WARNING oslo_config.cfg [req-85be9a0c-0808-4141-8494-2f4985cf914c - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 05:40:24.242 1 WARNING oslo_config.cfg [req-85be9a0c-0808-4141-8494-2f4985cf914c - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 05:40:24.244 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 05:40:24.252 1 INFO cinder.manager [req-d31d6fdd-f9c6-437c-8145-43950b1a21f3 - - - - -] Initiating service 5 cleanup
>2018-06-26 05:40:24.257 1 INFO cinder.manager [req-d31d6fdd-f9c6-437c-8145-43950b1a21f3 - - - - -] Service 5 cleanup completed.
>2018-06-26 05:42:30.393 1 ERROR oslo.messaging._drivers.impl_rabbit [req-d31d6fdd-f9c6-437c-8145-43950b1a21f3 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:42:30.395 1 ERROR oslo.messaging._drivers.impl_rabbit [req-d31d6fdd-f9c6-437c-8145-43950b1a21f3 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:42:30.395 1 ERROR oslo_service.service [req-d31d6fdd-f9c6-437c-8145-43950b1a21f3 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:42:30.395 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 05:42:30.395 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 05:42:30.395 1 ERROR oslo_service.service     service.start()
>2018-06-26 05:42:30.395 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 05:42:30.395 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 05:42:30.395 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 05:42:30.395 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 05:42:30.395 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 05:42:30.395 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 05:42:30.395 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 05:42:30.395 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 05:42:30.395 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 05:42:30.395 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 05:42:30.395 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 05:42:30.395 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 05:42:30.395 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 05:42:30.395 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 05:42:30.395 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 05:42:30.395 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 05:42:30.395 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 05:42:30.395 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 05:42:30.395 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 05:42:30.395 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 05:42:30.395 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 05:42:30.395 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 05:42:30.395 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:42:30.395 1 ERROR oslo_service.service 
>2018-06-26 05:42:30.398 1 CRITICAL cinder [req-85be9a0c-0808-4141-8494-2f4985cf914c - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 05:42:30.398 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 05:42:30.398 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 05:42:30.398 1 ERROR cinder     sys.exit(main())
>2018-06-26 05:42:30.398 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 05:42:30.398 1 ERROR cinder     service.wait()
>2018-06-26 05:42:30.398 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 05:42:30.398 1 ERROR cinder     _launcher.wait()
>2018-06-26 05:42:30.398 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 05:42:30.398 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 05:42:30.398 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 05:42:30.398 1 ERROR cinder     self.services.wait()
>2018-06-26 05:42:30.398 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 05:42:30.398 1 ERROR cinder     service.wait()
>2018-06-26 05:42:30.398 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 05:42:30.398 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 05:42:30.398 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 05:42:30.398 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 05:42:30.398 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 05:42:30.398 1 ERROR cinder     post_fn = fn()
>2018-06-26 05:42:30.398 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 05:42:30.398 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 05:42:30.398 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 05:42:30.398 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 05:42:30.398 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 05:42:30.398 1 ERROR cinder 
>2018-06-26 05:42:33.102 1 WARNING cinder.scheduler.host_manager [req-0e4e6e35-75f6-40a9-9c30-a4e0d1a45881 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 05:42:33.110 1 INFO cinder.rpc [req-0e4e6e35-75f6-40a9-9c30-a4e0d1a45881 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 05:42:33.119 1 INFO cinder.rpc [req-0e4e6e35-75f6-40a9-9c30-a4e0d1a45881 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 05:42:33.138 1 INFO cinder.rpc [req-0e4e6e35-75f6-40a9-9c30-a4e0d1a45881 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 05:42:33.144 1 INFO cinder.rpc [req-0e4e6e35-75f6-40a9-9c30-a4e0d1a45881 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 05:42:33.185 1 WARNING oslo_config.cfg [req-0e4e6e35-75f6-40a9-9c30-a4e0d1a45881 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 05:42:33.190 1 WARNING oslo_config.cfg [req-0e4e6e35-75f6-40a9-9c30-a4e0d1a45881 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:42:33.190 1 WARNING oslo_config.cfg [req-0e4e6e35-75f6-40a9-9c30-a4e0d1a45881 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:42:33.191 1 WARNING oslo_config.cfg [req-0e4e6e35-75f6-40a9-9c30-a4e0d1a45881 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:42:33.197 1 WARNING oslo_config.cfg [req-0e4e6e35-75f6-40a9-9c30-a4e0d1a45881 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 05:42:33.198 1 WARNING oslo_config.cfg [req-0e4e6e35-75f6-40a9-9c30-a4e0d1a45881 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 05:42:33.201 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 05:42:33.211 1 INFO cinder.manager [req-d2b24158-32e1-448b-8925-cc4773372433 - - - - -] Initiating service 5 cleanup
>2018-06-26 05:42:33.217 1 INFO cinder.manager [req-d2b24158-32e1-448b-8925-cc4773372433 - - - - -] Service 5 cleanup completed.
>2018-06-26 05:44:37.593 1 ERROR oslo.messaging._drivers.impl_rabbit [req-d2b24158-32e1-448b-8925-cc4773372433 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:44:37.596 1 ERROR oslo.messaging._drivers.impl_rabbit [req-d2b24158-32e1-448b-8925-cc4773372433 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:44:37.596 1 ERROR oslo_service.service [req-d2b24158-32e1-448b-8925-cc4773372433 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:44:37.596 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 05:44:37.596 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 05:44:37.596 1 ERROR oslo_service.service     service.start()
>2018-06-26 05:44:37.596 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 05:44:37.596 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 05:44:37.596 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 05:44:37.596 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 05:44:37.596 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 05:44:37.596 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 05:44:37.596 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 05:44:37.596 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 05:44:37.596 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 05:44:37.596 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 05:44:37.596 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 05:44:37.596 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 05:44:37.596 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 05:44:37.596 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 05:44:37.596 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 05:44:37.596 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 05:44:37.596 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 05:44:37.596 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 05:44:37.596 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 05:44:37.596 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 05:44:37.596 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 05:44:37.596 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 05:44:37.596 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:44:37.596 1 ERROR oslo_service.service 
>2018-06-26 05:44:37.600 1 CRITICAL cinder [req-0e4e6e35-75f6-40a9-9c30-a4e0d1a45881 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 05:44:37.600 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 05:44:37.600 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 05:44:37.600 1 ERROR cinder     sys.exit(main())
>2018-06-26 05:44:37.600 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 05:44:37.600 1 ERROR cinder     service.wait()
>2018-06-26 05:44:37.600 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 05:44:37.600 1 ERROR cinder     _launcher.wait()
>2018-06-26 05:44:37.600 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 05:44:37.600 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 05:44:37.600 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 05:44:37.600 1 ERROR cinder     self.services.wait()
>2018-06-26 05:44:37.600 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 05:44:37.600 1 ERROR cinder     service.wait()
>2018-06-26 05:44:37.600 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 05:44:37.600 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 05:44:37.600 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 05:44:37.600 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 05:44:37.600 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 05:44:37.600 1 ERROR cinder     post_fn = fn()
>2018-06-26 05:44:37.600 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 05:44:37.600 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 05:44:37.600 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 05:44:37.600 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 05:44:37.600 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 05:44:37.600 1 ERROR cinder 
>2018-06-26 05:44:40.321 1 WARNING cinder.scheduler.host_manager [req-6744d77b-0336-4ad6-ba09-d6821d347aff - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 05:44:40.327 1 INFO cinder.rpc [req-6744d77b-0336-4ad6-ba09-d6821d347aff - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 05:44:40.332 1 INFO cinder.rpc [req-6744d77b-0336-4ad6-ba09-d6821d347aff - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 05:44:40.344 1 INFO cinder.rpc [req-6744d77b-0336-4ad6-ba09-d6821d347aff - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 05:44:40.349 1 INFO cinder.rpc [req-6744d77b-0336-4ad6-ba09-d6821d347aff - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 05:44:40.375 1 WARNING oslo_config.cfg [req-6744d77b-0336-4ad6-ba09-d6821d347aff - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 05:44:40.378 1 WARNING oslo_config.cfg [req-6744d77b-0336-4ad6-ba09-d6821d347aff - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:44:40.378 1 WARNING oslo_config.cfg [req-6744d77b-0336-4ad6-ba09-d6821d347aff - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:44:40.379 1 WARNING oslo_config.cfg [req-6744d77b-0336-4ad6-ba09-d6821d347aff - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:44:40.384 1 WARNING oslo_config.cfg [req-6744d77b-0336-4ad6-ba09-d6821d347aff - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 05:44:40.386 1 WARNING oslo_config.cfg [req-6744d77b-0336-4ad6-ba09-d6821d347aff - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 05:44:40.389 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 05:44:40.395 1 INFO cinder.manager [req-4140b3ac-b240-4b1d-b288-1c12a7dc10e7 - - - - -] Initiating service 5 cleanup
>2018-06-26 05:44:40.399 1 INFO cinder.manager [req-4140b3ac-b240-4b1d-b288-1c12a7dc10e7 - - - - -] Service 5 cleanup completed.
>2018-06-26 05:46:44.800 1 ERROR oslo.messaging._drivers.impl_rabbit [req-4140b3ac-b240-4b1d-b288-1c12a7dc10e7 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:46:44.802 1 ERROR oslo.messaging._drivers.impl_rabbit [req-4140b3ac-b240-4b1d-b288-1c12a7dc10e7 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:46:44.803 1 ERROR oslo_service.service [req-4140b3ac-b240-4b1d-b288-1c12a7dc10e7 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:46:44.803 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 05:46:44.803 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 05:46:44.803 1 ERROR oslo_service.service     service.start()
>2018-06-26 05:46:44.803 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 05:46:44.803 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 05:46:44.803 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 05:46:44.803 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 05:46:44.803 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 05:46:44.803 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 05:46:44.803 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 05:46:44.803 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 05:46:44.803 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 05:46:44.803 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 05:46:44.803 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 05:46:44.803 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 05:46:44.803 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 05:46:44.803 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 05:46:44.803 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 05:46:44.803 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 05:46:44.803 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 05:46:44.803 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 05:46:44.803 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 05:46:44.803 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 05:46:44.803 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 05:46:44.803 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 05:46:44.803 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:46:44.803 1 ERROR oslo_service.service 
>2018-06-26 05:46:44.805 1 CRITICAL cinder [req-6744d77b-0336-4ad6-ba09-d6821d347aff - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 05:46:44.805 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 05:46:44.805 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 05:46:44.805 1 ERROR cinder     sys.exit(main())
>2018-06-26 05:46:44.805 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 05:46:44.805 1 ERROR cinder     service.wait()
>2018-06-26 05:46:44.805 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 05:46:44.805 1 ERROR cinder     _launcher.wait()
>2018-06-26 05:46:44.805 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 05:46:44.805 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 05:46:44.805 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 05:46:44.805 1 ERROR cinder     self.services.wait()
>2018-06-26 05:46:44.805 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 05:46:44.805 1 ERROR cinder     service.wait()
>2018-06-26 05:46:44.805 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 05:46:44.805 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 05:46:44.805 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 05:46:44.805 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 05:46:44.805 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 05:46:44.805 1 ERROR cinder     post_fn = fn()
>2018-06-26 05:46:44.805 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 05:46:44.805 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 05:46:44.805 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 05:46:44.805 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 05:46:44.805 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 05:46:44.805 1 ERROR cinder 
>2018-06-26 05:46:47.534 1 WARNING cinder.scheduler.host_manager [req-fd5c4505-17c8-44e5-8aed-cb228f856672 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 05:46:47.540 1 INFO cinder.rpc [req-fd5c4505-17c8-44e5-8aed-cb228f856672 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 05:46:47.546 1 INFO cinder.rpc [req-fd5c4505-17c8-44e5-8aed-cb228f856672 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 05:46:47.558 1 INFO cinder.rpc [req-fd5c4505-17c8-44e5-8aed-cb228f856672 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 05:46:47.563 1 INFO cinder.rpc [req-fd5c4505-17c8-44e5-8aed-cb228f856672 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 05:46:47.587 1 WARNING oslo_config.cfg [req-fd5c4505-17c8-44e5-8aed-cb228f856672 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 05:46:47.589 1 WARNING oslo_config.cfg [req-fd5c4505-17c8-44e5-8aed-cb228f856672 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:46:47.590 1 WARNING oslo_config.cfg [req-fd5c4505-17c8-44e5-8aed-cb228f856672 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:46:47.591 1 WARNING oslo_config.cfg [req-fd5c4505-17c8-44e5-8aed-cb228f856672 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:46:47.596 1 WARNING oslo_config.cfg [req-fd5c4505-17c8-44e5-8aed-cb228f856672 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 05:46:47.597 1 WARNING oslo_config.cfg [req-fd5c4505-17c8-44e5-8aed-cb228f856672 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 05:46:47.599 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 05:46:47.606 1 INFO cinder.manager [req-5f252c54-6c09-42d9-9c6a-5bba6ab3b50c - - - - -] Initiating service 5 cleanup
>2018-06-26 05:46:47.612 1 INFO cinder.manager [req-5f252c54-6c09-42d9-9c6a-5bba6ab3b50c - - - - -] Service 5 cleanup completed.
>2018-06-26 05:48:51.986 1 ERROR oslo.messaging._drivers.impl_rabbit [req-5f252c54-6c09-42d9-9c6a-5bba6ab3b50c - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:48:51.988 1 ERROR oslo.messaging._drivers.impl_rabbit [req-5f252c54-6c09-42d9-9c6a-5bba6ab3b50c - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:48:51.989 1 ERROR oslo_service.service [req-5f252c54-6c09-42d9-9c6a-5bba6ab3b50c - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:48:51.989 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 05:48:51.989 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 05:48:51.989 1 ERROR oslo_service.service     service.start()
>2018-06-26 05:48:51.989 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 05:48:51.989 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 05:48:51.989 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 05:48:51.989 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 05:48:51.989 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 05:48:51.989 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 05:48:51.989 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 05:48:51.989 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 05:48:51.989 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 05:48:51.989 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 05:48:51.989 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 05:48:51.989 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 05:48:51.989 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 05:48:51.989 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 05:48:51.989 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 05:48:51.989 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 05:48:51.989 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 05:48:51.989 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 05:48:51.989 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 05:48:51.989 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 05:48:51.989 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 05:48:51.989 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 05:48:51.989 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:48:51.989 1 ERROR oslo_service.service 
>2018-06-26 05:48:51.992 1 CRITICAL cinder [req-fd5c4505-17c8-44e5-8aed-cb228f856672 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 05:48:51.992 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 05:48:51.992 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 05:48:51.992 1 ERROR cinder     sys.exit(main())
>2018-06-26 05:48:51.992 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 05:48:51.992 1 ERROR cinder     service.wait()
>2018-06-26 05:48:51.992 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 05:48:51.992 1 ERROR cinder     _launcher.wait()
>2018-06-26 05:48:51.992 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 05:48:51.992 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 05:48:51.992 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 05:48:51.992 1 ERROR cinder     self.services.wait()
>2018-06-26 05:48:51.992 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 05:48:51.992 1 ERROR cinder     service.wait()
>2018-06-26 05:48:51.992 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 05:48:51.992 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 05:48:51.992 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 05:48:51.992 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 05:48:51.992 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 05:48:51.992 1 ERROR cinder     post_fn = fn()
>2018-06-26 05:48:51.992 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 05:48:51.992 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 05:48:51.992 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 05:48:51.992 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 05:48:51.992 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 05:48:51.992 1 ERROR cinder 
>2018-06-26 05:48:54.657 1 WARNING cinder.scheduler.host_manager [req-9cc5460a-9d1e-421e-89dc-66685acd5d53 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 05:48:54.665 1 INFO cinder.rpc [req-9cc5460a-9d1e-421e-89dc-66685acd5d53 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 05:48:54.672 1 INFO cinder.rpc [req-9cc5460a-9d1e-421e-89dc-66685acd5d53 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 05:48:54.687 1 INFO cinder.rpc [req-9cc5460a-9d1e-421e-89dc-66685acd5d53 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 05:48:54.697 1 INFO cinder.rpc [req-9cc5460a-9d1e-421e-89dc-66685acd5d53 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 05:48:54.723 1 WARNING oslo_config.cfg [req-9cc5460a-9d1e-421e-89dc-66685acd5d53 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 05:48:54.725 1 WARNING oslo_config.cfg [req-9cc5460a-9d1e-421e-89dc-66685acd5d53 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:48:54.726 1 WARNING oslo_config.cfg [req-9cc5460a-9d1e-421e-89dc-66685acd5d53 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:48:54.726 1 WARNING oslo_config.cfg [req-9cc5460a-9d1e-421e-89dc-66685acd5d53 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:48:54.731 1 WARNING oslo_config.cfg [req-9cc5460a-9d1e-421e-89dc-66685acd5d53 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 05:48:54.732 1 WARNING oslo_config.cfg [req-9cc5460a-9d1e-421e-89dc-66685acd5d53 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 05:48:54.735 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 05:48:54.741 1 INFO cinder.manager [req-023c1631-1006-4410-818b-9b2fb5416320 - - - - -] Initiating service 5 cleanup
>2018-06-26 05:48:54.746 1 INFO cinder.manager [req-023c1631-1006-4410-818b-9b2fb5416320 - - - - -] Service 5 cleanup completed.
>2018-06-26 05:50:59.104 1 ERROR oslo.messaging._drivers.impl_rabbit [req-023c1631-1006-4410-818b-9b2fb5416320 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:50:59.106 1 ERROR oslo.messaging._drivers.impl_rabbit [req-023c1631-1006-4410-818b-9b2fb5416320 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:50:59.107 1 ERROR oslo_service.service [req-023c1631-1006-4410-818b-9b2fb5416320 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:50:59.107 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 05:50:59.107 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 05:50:59.107 1 ERROR oslo_service.service     service.start()
>2018-06-26 05:50:59.107 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 05:50:59.107 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 05:50:59.107 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 05:50:59.107 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 05:50:59.107 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 05:50:59.107 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 05:50:59.107 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 05:50:59.107 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 05:50:59.107 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 05:50:59.107 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 05:50:59.107 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 05:50:59.107 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 05:50:59.107 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 05:50:59.107 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 05:50:59.107 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 05:50:59.107 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 05:50:59.107 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 05:50:59.107 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 05:50:59.107 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 05:50:59.107 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 05:50:59.107 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 05:50:59.107 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 05:50:59.107 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:50:59.107 1 ERROR oslo_service.service 
>2018-06-26 05:50:59.110 1 CRITICAL cinder [req-9cc5460a-9d1e-421e-89dc-66685acd5d53 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 05:50:59.110 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 05:50:59.110 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 05:50:59.110 1 ERROR cinder     sys.exit(main())
>2018-06-26 05:50:59.110 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 05:50:59.110 1 ERROR cinder     service.wait()
>2018-06-26 05:50:59.110 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 05:50:59.110 1 ERROR cinder     _launcher.wait()
>2018-06-26 05:50:59.110 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 05:50:59.110 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 05:50:59.110 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 05:50:59.110 1 ERROR cinder     self.services.wait()
>2018-06-26 05:50:59.110 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 05:50:59.110 1 ERROR cinder     service.wait()
>2018-06-26 05:50:59.110 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 05:50:59.110 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 05:50:59.110 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 05:50:59.110 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 05:50:59.110 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 05:50:59.110 1 ERROR cinder     post_fn = fn()
>2018-06-26 05:50:59.110 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 05:50:59.110 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 05:50:59.110 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 05:50:59.110 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 05:50:59.110 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 05:50:59.110 1 ERROR cinder 
>2018-06-26 05:51:01.805 1 WARNING cinder.scheduler.host_manager [req-b3a1328f-c8cc-4767-a3db-31be0192ab57 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 05:51:01.811 1 INFO cinder.rpc [req-b3a1328f-c8cc-4767-a3db-31be0192ab57 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 05:51:01.816 1 INFO cinder.rpc [req-b3a1328f-c8cc-4767-a3db-31be0192ab57 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 05:51:01.827 1 INFO cinder.rpc [req-b3a1328f-c8cc-4767-a3db-31be0192ab57 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 05:51:01.833 1 INFO cinder.rpc [req-b3a1328f-c8cc-4767-a3db-31be0192ab57 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 05:51:01.854 1 WARNING oslo_config.cfg [req-b3a1328f-c8cc-4767-a3db-31be0192ab57 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 05:51:01.857 1 WARNING oslo_config.cfg [req-b3a1328f-c8cc-4767-a3db-31be0192ab57 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:51:01.857 1 WARNING oslo_config.cfg [req-b3a1328f-c8cc-4767-a3db-31be0192ab57 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:51:01.858 1 WARNING oslo_config.cfg [req-b3a1328f-c8cc-4767-a3db-31be0192ab57 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:51:01.863 1 WARNING oslo_config.cfg [req-b3a1328f-c8cc-4767-a3db-31be0192ab57 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 05:51:01.864 1 WARNING oslo_config.cfg [req-b3a1328f-c8cc-4767-a3db-31be0192ab57 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 05:51:01.866 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 05:51:01.872 1 INFO cinder.manager [req-64bf5d38-3dbe-40ad-8f2c-da81f7edf9c0 - - - - -] Initiating service 5 cleanup
>2018-06-26 05:51:01.877 1 INFO cinder.manager [req-64bf5d38-3dbe-40ad-8f2c-da81f7edf9c0 - - - - -] Service 5 cleanup completed.
>2018-06-26 05:53:06.233 1 ERROR oslo.messaging._drivers.impl_rabbit [req-64bf5d38-3dbe-40ad-8f2c-da81f7edf9c0 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:53:06.235 1 ERROR oslo.messaging._drivers.impl_rabbit [req-64bf5d38-3dbe-40ad-8f2c-da81f7edf9c0 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:53:06.235 1 ERROR oslo_service.service [req-64bf5d38-3dbe-40ad-8f2c-da81f7edf9c0 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:53:06.235 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 05:53:06.235 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 05:53:06.235 1 ERROR oslo_service.service     service.start()
>2018-06-26 05:53:06.235 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 05:53:06.235 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 05:53:06.235 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 05:53:06.235 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 05:53:06.235 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 05:53:06.235 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 05:53:06.235 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 05:53:06.235 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 05:53:06.235 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 05:53:06.235 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 05:53:06.235 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 05:53:06.235 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 05:53:06.235 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 05:53:06.235 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 05:53:06.235 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 05:53:06.235 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 05:53:06.235 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 05:53:06.235 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 05:53:06.235 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 05:53:06.235 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 05:53:06.235 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 05:53:06.235 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 05:53:06.235 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:53:06.235 1 ERROR oslo_service.service 
>2018-06-26 05:53:06.238 1 CRITICAL cinder [req-b3a1328f-c8cc-4767-a3db-31be0192ab57 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 05:53:06.238 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 05:53:06.238 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 05:53:06.238 1 ERROR cinder     sys.exit(main())
>2018-06-26 05:53:06.238 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 05:53:06.238 1 ERROR cinder     service.wait()
>2018-06-26 05:53:06.238 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 05:53:06.238 1 ERROR cinder     _launcher.wait()
>2018-06-26 05:53:06.238 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 05:53:06.238 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 05:53:06.238 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 05:53:06.238 1 ERROR cinder     self.services.wait()
>2018-06-26 05:53:06.238 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 05:53:06.238 1 ERROR cinder     service.wait()
>2018-06-26 05:53:06.238 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 05:53:06.238 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 05:53:06.238 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 05:53:06.238 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 05:53:06.238 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 05:53:06.238 1 ERROR cinder     post_fn = fn()
>2018-06-26 05:53:06.238 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 05:53:06.238 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 05:53:06.238 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 05:53:06.238 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 05:53:06.238 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 05:53:06.238 1 ERROR cinder 
>2018-06-26 05:53:08.780 1 WARNING cinder.scheduler.host_manager [req-12e44979-6768-4093-a623-669b171e504f - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 05:53:08.790 1 INFO cinder.rpc [req-12e44979-6768-4093-a623-669b171e504f - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 05:53:08.802 1 INFO cinder.rpc [req-12e44979-6768-4093-a623-669b171e504f - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 05:53:08.817 1 INFO cinder.rpc [req-12e44979-6768-4093-a623-669b171e504f - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 05:53:08.824 1 INFO cinder.rpc [req-12e44979-6768-4093-a623-669b171e504f - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 05:53:08.860 1 WARNING oslo_config.cfg [req-12e44979-6768-4093-a623-669b171e504f - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 05:53:08.862 1 WARNING oslo_config.cfg [req-12e44979-6768-4093-a623-669b171e504f - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:53:08.862 1 WARNING oslo_config.cfg [req-12e44979-6768-4093-a623-669b171e504f - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:53:08.863 1 WARNING oslo_config.cfg [req-12e44979-6768-4093-a623-669b171e504f - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:53:08.869 1 WARNING oslo_config.cfg [req-12e44979-6768-4093-a623-669b171e504f - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 05:53:08.870 1 WARNING oslo_config.cfg [req-12e44979-6768-4093-a623-669b171e504f - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 05:53:08.873 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 05:53:08.882 1 INFO cinder.manager [req-02218eeb-40e5-44f0-aba0-3e99147fb792 - - - - -] Initiating service 5 cleanup
>2018-06-26 05:53:08.886 1 INFO cinder.manager [req-02218eeb-40e5-44f0-aba0-3e99147fb792 - - - - -] Service 5 cleanup completed.
>2018-06-26 05:55:20.341 1 ERROR oslo.messaging._drivers.impl_rabbit [req-02218eeb-40e5-44f0-aba0-3e99147fb792 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:55:20.343 1 ERROR oslo.messaging._drivers.impl_rabbit [req-02218eeb-40e5-44f0-aba0-3e99147fb792 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:55:20.343 1 ERROR oslo_service.service [req-02218eeb-40e5-44f0-aba0-3e99147fb792 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:55:20.343 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 05:55:20.343 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 05:55:20.343 1 ERROR oslo_service.service     service.start()
>2018-06-26 05:55:20.343 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 05:55:20.343 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 05:55:20.343 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 05:55:20.343 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 05:55:20.343 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 05:55:20.343 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 05:55:20.343 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 05:55:20.343 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 05:55:20.343 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 05:55:20.343 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 05:55:20.343 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 05:55:20.343 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 05:55:20.343 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 05:55:20.343 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 05:55:20.343 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 05:55:20.343 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 05:55:20.343 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 05:55:20.343 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 05:55:20.343 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 05:55:20.343 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 05:55:20.343 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 05:55:20.343 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 05:55:20.343 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:55:20.343 1 ERROR oslo_service.service 
>2018-06-26 05:55:20.346 1 CRITICAL cinder [req-12e44979-6768-4093-a623-669b171e504f - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 05:55:20.346 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 05:55:20.346 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 05:55:20.346 1 ERROR cinder     sys.exit(main())
>2018-06-26 05:55:20.346 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 05:55:20.346 1 ERROR cinder     service.wait()
>2018-06-26 05:55:20.346 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 05:55:20.346 1 ERROR cinder     _launcher.wait()
>2018-06-26 05:55:20.346 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 05:55:20.346 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 05:55:20.346 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 05:55:20.346 1 ERROR cinder     self.services.wait()
>2018-06-26 05:55:20.346 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 05:55:20.346 1 ERROR cinder     service.wait()
>2018-06-26 05:55:20.346 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 05:55:20.346 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 05:55:20.346 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 05:55:20.346 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 05:55:20.346 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 05:55:20.346 1 ERROR cinder     post_fn = fn()
>2018-06-26 05:55:20.346 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 05:55:20.346 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 05:55:20.346 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 05:55:20.346 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 05:55:20.346 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 05:55:20.346 1 ERROR cinder 
>2018-06-26 05:55:23.026 1 WARNING cinder.scheduler.host_manager [req-fc08ef0c-39c3-4329-8f23-d59ea649a0dd - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 05:55:23.032 1 INFO cinder.rpc [req-fc08ef0c-39c3-4329-8f23-d59ea649a0dd - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 05:55:23.038 1 INFO cinder.rpc [req-fc08ef0c-39c3-4329-8f23-d59ea649a0dd - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 05:55:23.049 1 INFO cinder.rpc [req-fc08ef0c-39c3-4329-8f23-d59ea649a0dd - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 05:55:23.056 1 INFO cinder.rpc [req-fc08ef0c-39c3-4329-8f23-d59ea649a0dd - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 05:55:23.081 1 WARNING oslo_config.cfg [req-fc08ef0c-39c3-4329-8f23-d59ea649a0dd - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 05:55:23.083 1 WARNING oslo_config.cfg [req-fc08ef0c-39c3-4329-8f23-d59ea649a0dd - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:55:23.084 1 WARNING oslo_config.cfg [req-fc08ef0c-39c3-4329-8f23-d59ea649a0dd - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:55:23.084 1 WARNING oslo_config.cfg [req-fc08ef0c-39c3-4329-8f23-d59ea649a0dd - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:55:23.090 1 WARNING oslo_config.cfg [req-fc08ef0c-39c3-4329-8f23-d59ea649a0dd - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 05:55:23.091 1 WARNING oslo_config.cfg [req-fc08ef0c-39c3-4329-8f23-d59ea649a0dd - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 05:55:23.094 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 05:55:23.101 1 INFO cinder.manager [req-2d909ce1-a77c-4fdb-a32d-aa2c26f3fa9f - - - - -] Initiating service 5 cleanup
>2018-06-26 05:55:23.106 1 INFO cinder.manager [req-2d909ce1-a77c-4fdb-a32d-aa2c26f3fa9f - - - - -] Service 5 cleanup completed.
>2018-06-26 05:57:35.983 1 ERROR oslo.messaging._drivers.impl_rabbit [req-2d909ce1-a77c-4fdb-a32d-aa2c26f3fa9f - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:57:35.986 1 ERROR oslo.messaging._drivers.impl_rabbit [req-2d909ce1-a77c-4fdb-a32d-aa2c26f3fa9f - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:57:35.987 1 ERROR oslo_service.service [req-2d909ce1-a77c-4fdb-a32d-aa2c26f3fa9f - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:57:35.987 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 05:57:35.987 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 05:57:35.987 1 ERROR oslo_service.service     service.start()
>2018-06-26 05:57:35.987 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 05:57:35.987 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 05:57:35.987 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 05:57:35.987 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 05:57:35.987 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 05:57:35.987 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 05:57:35.987 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 05:57:35.987 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 05:57:35.987 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 05:57:35.987 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 05:57:35.987 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 05:57:35.987 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 05:57:35.987 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 05:57:35.987 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 05:57:35.987 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 05:57:35.987 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 05:57:35.987 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 05:57:35.987 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 05:57:35.987 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 05:57:35.987 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 05:57:35.987 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 05:57:35.987 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 05:57:35.987 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:57:35.987 1 ERROR oslo_service.service 
>2018-06-26 05:57:35.989 1 CRITICAL cinder [req-fc08ef0c-39c3-4329-8f23-d59ea649a0dd - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 05:57:35.989 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 05:57:35.989 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 05:57:35.989 1 ERROR cinder     sys.exit(main())
>2018-06-26 05:57:35.989 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 05:57:35.989 1 ERROR cinder     service.wait()
>2018-06-26 05:57:35.989 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 05:57:35.989 1 ERROR cinder     _launcher.wait()
>2018-06-26 05:57:35.989 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 05:57:35.989 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 05:57:35.989 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 05:57:35.989 1 ERROR cinder     self.services.wait()
>2018-06-26 05:57:35.989 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 05:57:35.989 1 ERROR cinder     service.wait()
>2018-06-26 05:57:35.989 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 05:57:35.989 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 05:57:35.989 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 05:57:35.989 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 05:57:35.989 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 05:57:35.989 1 ERROR cinder     post_fn = fn()
>2018-06-26 05:57:35.989 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 05:57:35.989 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 05:57:35.989 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 05:57:35.989 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 05:57:35.989 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 05:57:35.989 1 ERROR cinder 
>2018-06-26 05:57:38.712 1 WARNING cinder.scheduler.host_manager [req-d49f904b-5480-4aaf-bbca-aad8befe5302 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 05:57:38.719 1 INFO cinder.rpc [req-d49f904b-5480-4aaf-bbca-aad8befe5302 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 05:57:38.724 1 INFO cinder.rpc [req-d49f904b-5480-4aaf-bbca-aad8befe5302 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 05:57:38.736 1 INFO cinder.rpc [req-d49f904b-5480-4aaf-bbca-aad8befe5302 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 05:57:38.742 1 INFO cinder.rpc [req-d49f904b-5480-4aaf-bbca-aad8befe5302 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 05:57:38.766 1 WARNING oslo_config.cfg [req-d49f904b-5480-4aaf-bbca-aad8befe5302 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 05:57:38.769 1 WARNING oslo_config.cfg [req-d49f904b-5480-4aaf-bbca-aad8befe5302 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:57:38.769 1 WARNING oslo_config.cfg [req-d49f904b-5480-4aaf-bbca-aad8befe5302 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:57:38.770 1 WARNING oslo_config.cfg [req-d49f904b-5480-4aaf-bbca-aad8befe5302 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:57:38.775 1 WARNING oslo_config.cfg [req-d49f904b-5480-4aaf-bbca-aad8befe5302 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 05:57:38.776 1 WARNING oslo_config.cfg [req-d49f904b-5480-4aaf-bbca-aad8befe5302 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 05:57:38.779 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 05:57:38.785 1 INFO cinder.manager [req-4c340e2c-0b96-4972-b1cd-a4d5b194a981 - - - - -] Initiating service 5 cleanup
>2018-06-26 05:57:38.790 1 INFO cinder.manager [req-4c340e2c-0b96-4972-b1cd-a4d5b194a981 - - - - -] Service 5 cleanup completed.
>2018-06-26 05:59:43.187 1 ERROR oslo.messaging._drivers.impl_rabbit [req-4c340e2c-0b96-4972-b1cd-a4d5b194a981 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:59:43.189 1 ERROR oslo.messaging._drivers.impl_rabbit [req-4c340e2c-0b96-4972-b1cd-a4d5b194a981 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:59:43.189 1 ERROR oslo_service.service [req-4c340e2c-0b96-4972-b1cd-a4d5b194a981 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:59:43.189 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 05:59:43.189 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 05:59:43.189 1 ERROR oslo_service.service     service.start()
>2018-06-26 05:59:43.189 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 05:59:43.189 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 05:59:43.189 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 05:59:43.189 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 05:59:43.189 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 05:59:43.189 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 05:59:43.189 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 05:59:43.189 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 05:59:43.189 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 05:59:43.189 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 05:59:43.189 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 05:59:43.189 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 05:59:43.189 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 05:59:43.189 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 05:59:43.189 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 05:59:43.189 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 05:59:43.189 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 05:59:43.189 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 05:59:43.189 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 05:59:43.189 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 05:59:43.189 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 05:59:43.189 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 05:59:43.189 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 05:59:43.189 1 ERROR oslo_service.service 
>2018-06-26 05:59:43.192 1 CRITICAL cinder [req-d49f904b-5480-4aaf-bbca-aad8befe5302 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 05:59:43.192 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 05:59:43.192 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 05:59:43.192 1 ERROR cinder     sys.exit(main())
>2018-06-26 05:59:43.192 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 05:59:43.192 1 ERROR cinder     service.wait()
>2018-06-26 05:59:43.192 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 05:59:43.192 1 ERROR cinder     _launcher.wait()
>2018-06-26 05:59:43.192 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 05:59:43.192 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 05:59:43.192 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 05:59:43.192 1 ERROR cinder     self.services.wait()
>2018-06-26 05:59:43.192 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 05:59:43.192 1 ERROR cinder     service.wait()
>2018-06-26 05:59:43.192 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 05:59:43.192 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 05:59:43.192 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 05:59:43.192 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 05:59:43.192 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 05:59:43.192 1 ERROR cinder     post_fn = fn()
>2018-06-26 05:59:43.192 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 05:59:43.192 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 05:59:43.192 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 05:59:43.192 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 05:59:43.192 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 05:59:43.192 1 ERROR cinder 
>2018-06-26 05:59:45.872 1 WARNING cinder.scheduler.host_manager [req-506edb4b-fe97-4126-a34e-80f5c414c912 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 05:59:45.878 1 INFO cinder.rpc [req-506edb4b-fe97-4126-a34e-80f5c414c912 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 05:59:45.884 1 INFO cinder.rpc [req-506edb4b-fe97-4126-a34e-80f5c414c912 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 05:59:45.895 1 INFO cinder.rpc [req-506edb4b-fe97-4126-a34e-80f5c414c912 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 05:59:45.901 1 INFO cinder.rpc [req-506edb4b-fe97-4126-a34e-80f5c414c912 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 05:59:45.925 1 WARNING oslo_config.cfg [req-506edb4b-fe97-4126-a34e-80f5c414c912 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 05:59:45.927 1 WARNING oslo_config.cfg [req-506edb4b-fe97-4126-a34e-80f5c414c912 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:59:45.927 1 WARNING oslo_config.cfg [req-506edb4b-fe97-4126-a34e-80f5c414c912 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:59:45.928 1 WARNING oslo_config.cfg [req-506edb4b-fe97-4126-a34e-80f5c414c912 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 05:59:45.933 1 WARNING oslo_config.cfg [req-506edb4b-fe97-4126-a34e-80f5c414c912 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 05:59:45.934 1 WARNING oslo_config.cfg [req-506edb4b-fe97-4126-a34e-80f5c414c912 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 05:59:45.937 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 05:59:45.943 1 INFO cinder.manager [req-b19a2397-5596-408f-8f07-8cc5e709a7cc - - - - -] Initiating service 5 cleanup
>2018-06-26 05:59:45.949 1 INFO cinder.manager [req-b19a2397-5596-408f-8f07-8cc5e709a7cc - - - - -] Service 5 cleanup completed.
>2018-06-26 06:01:52.401 1 ERROR oslo.messaging._drivers.impl_rabbit [req-b19a2397-5596-408f-8f07-8cc5e709a7cc - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:01:52.403 1 ERROR oslo.messaging._drivers.impl_rabbit [req-b19a2397-5596-408f-8f07-8cc5e709a7cc - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:01:52.404 1 ERROR oslo_service.service [req-b19a2397-5596-408f-8f07-8cc5e709a7cc - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:01:52.404 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 06:01:52.404 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 06:01:52.404 1 ERROR oslo_service.service     service.start()
>2018-06-26 06:01:52.404 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 06:01:52.404 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 06:01:52.404 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 06:01:52.404 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 06:01:52.404 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 06:01:52.404 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 06:01:52.404 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 06:01:52.404 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 06:01:52.404 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 06:01:52.404 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 06:01:52.404 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 06:01:52.404 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 06:01:52.404 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 06:01:52.404 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 06:01:52.404 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 06:01:52.404 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 06:01:52.404 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 06:01:52.404 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 06:01:52.404 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 06:01:52.404 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 06:01:52.404 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 06:01:52.404 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 06:01:52.404 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:01:52.404 1 ERROR oslo_service.service 
>2018-06-26 06:01:52.407 1 CRITICAL cinder [req-506edb4b-fe97-4126-a34e-80f5c414c912 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 06:01:52.407 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 06:01:52.407 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 06:01:52.407 1 ERROR cinder     sys.exit(main())
>2018-06-26 06:01:52.407 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 06:01:52.407 1 ERROR cinder     service.wait()
>2018-06-26 06:01:52.407 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 06:01:52.407 1 ERROR cinder     _launcher.wait()
>2018-06-26 06:01:52.407 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 06:01:52.407 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 06:01:52.407 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 06:01:52.407 1 ERROR cinder     self.services.wait()
>2018-06-26 06:01:52.407 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 06:01:52.407 1 ERROR cinder     service.wait()
>2018-06-26 06:01:52.407 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 06:01:52.407 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 06:01:52.407 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 06:01:52.407 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 06:01:52.407 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 06:01:52.407 1 ERROR cinder     post_fn = fn()
>2018-06-26 06:01:52.407 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 06:01:52.407 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 06:01:52.407 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 06:01:52.407 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 06:01:52.407 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 06:01:52.407 1 ERROR cinder 
>2018-06-26 06:01:55.011 1 WARNING cinder.scheduler.host_manager [req-94fa0d76-c2bf-46dd-8823-24ce62935122 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 06:01:55.018 1 INFO cinder.rpc [req-94fa0d76-c2bf-46dd-8823-24ce62935122 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 06:01:55.023 1 INFO cinder.rpc [req-94fa0d76-c2bf-46dd-8823-24ce62935122 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 06:01:55.036 1 INFO cinder.rpc [req-94fa0d76-c2bf-46dd-8823-24ce62935122 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 06:01:55.043 1 INFO cinder.rpc [req-94fa0d76-c2bf-46dd-8823-24ce62935122 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 06:01:55.080 1 WARNING oslo_config.cfg [req-94fa0d76-c2bf-46dd-8823-24ce62935122 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 06:01:55.083 1 WARNING oslo_config.cfg [req-94fa0d76-c2bf-46dd-8823-24ce62935122 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:01:55.084 1 WARNING oslo_config.cfg [req-94fa0d76-c2bf-46dd-8823-24ce62935122 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:01:55.084 1 WARNING oslo_config.cfg [req-94fa0d76-c2bf-46dd-8823-24ce62935122 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:01:55.090 1 WARNING oslo_config.cfg [req-94fa0d76-c2bf-46dd-8823-24ce62935122 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 06:01:55.092 1 WARNING oslo_config.cfg [req-94fa0d76-c2bf-46dd-8823-24ce62935122 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 06:01:55.095 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 06:01:55.107 1 INFO cinder.manager [req-453ebbd7-fae2-4f97-8bbf-d18b67e2cc92 - - - - -] Initiating service 5 cleanup
>2018-06-26 06:01:55.115 1 INFO cinder.manager [req-453ebbd7-fae2-4f97-8bbf-d18b67e2cc92 - - - - -] Service 5 cleanup completed.
>2018-06-26 06:03:59.373 1 ERROR oslo.messaging._drivers.impl_rabbit [req-453ebbd7-fae2-4f97-8bbf-d18b67e2cc92 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:03:59.375 1 ERROR oslo.messaging._drivers.impl_rabbit [req-453ebbd7-fae2-4f97-8bbf-d18b67e2cc92 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:03:59.376 1 ERROR oslo_service.service [req-453ebbd7-fae2-4f97-8bbf-d18b67e2cc92 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:03:59.376 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 06:03:59.376 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 06:03:59.376 1 ERROR oslo_service.service     service.start()
>2018-06-26 06:03:59.376 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 06:03:59.376 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 06:03:59.376 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 06:03:59.376 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 06:03:59.376 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 06:03:59.376 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 06:03:59.376 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 06:03:59.376 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 06:03:59.376 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 06:03:59.376 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 06:03:59.376 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 06:03:59.376 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 06:03:59.376 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 06:03:59.376 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 06:03:59.376 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 06:03:59.376 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 06:03:59.376 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 06:03:59.376 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 06:03:59.376 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 06:03:59.376 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 06:03:59.376 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 06:03:59.376 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 06:03:59.376 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:03:59.376 1 ERROR oslo_service.service 
>2018-06-26 06:03:59.379 1 CRITICAL cinder [req-94fa0d76-c2bf-46dd-8823-24ce62935122 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 06:03:59.379 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 06:03:59.379 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 06:03:59.379 1 ERROR cinder     sys.exit(main())
>2018-06-26 06:03:59.379 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 06:03:59.379 1 ERROR cinder     service.wait()
>2018-06-26 06:03:59.379 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 06:03:59.379 1 ERROR cinder     _launcher.wait()
>2018-06-26 06:03:59.379 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 06:03:59.379 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 06:03:59.379 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 06:03:59.379 1 ERROR cinder     self.services.wait()
>2018-06-26 06:03:59.379 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 06:03:59.379 1 ERROR cinder     service.wait()
>2018-06-26 06:03:59.379 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 06:03:59.379 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 06:03:59.379 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 06:03:59.379 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 06:03:59.379 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 06:03:59.379 1 ERROR cinder     post_fn = fn()
>2018-06-26 06:03:59.379 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 06:03:59.379 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 06:03:59.379 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 06:03:59.379 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 06:03:59.379 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 06:03:59.379 1 ERROR cinder 
>2018-06-26 06:04:02.253 1 WARNING cinder.scheduler.host_manager [req-db5bdeb9-1511-4321-ae7b-a4abe084633e - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 06:04:02.259 1 INFO cinder.rpc [req-db5bdeb9-1511-4321-ae7b-a4abe084633e - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 06:04:02.266 1 INFO cinder.rpc [req-db5bdeb9-1511-4321-ae7b-a4abe084633e - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 06:04:02.293 1 INFO cinder.rpc [req-db5bdeb9-1511-4321-ae7b-a4abe084633e - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 06:04:02.300 1 INFO cinder.rpc [req-db5bdeb9-1511-4321-ae7b-a4abe084633e - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 06:04:02.330 1 WARNING oslo_config.cfg [req-db5bdeb9-1511-4321-ae7b-a4abe084633e - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 06:04:02.333 1 WARNING oslo_config.cfg [req-db5bdeb9-1511-4321-ae7b-a4abe084633e - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:04:02.333 1 WARNING oslo_config.cfg [req-db5bdeb9-1511-4321-ae7b-a4abe084633e - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:04:02.334 1 WARNING oslo_config.cfg [req-db5bdeb9-1511-4321-ae7b-a4abe084633e - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:04:02.339 1 WARNING oslo_config.cfg [req-db5bdeb9-1511-4321-ae7b-a4abe084633e - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 06:04:02.340 1 WARNING oslo_config.cfg [req-db5bdeb9-1511-4321-ae7b-a4abe084633e - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 06:04:02.343 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 06:04:02.354 1 INFO cinder.manager [req-d6113b0f-2db7-408c-9728-306ac91bb90a - - - - -] Initiating service 5 cleanup
>2018-06-26 06:04:02.361 1 INFO cinder.manager [req-d6113b0f-2db7-408c-9728-306ac91bb90a - - - - -] Service 5 cleanup completed.
>2018-06-26 06:06:06.686 1 ERROR oslo.messaging._drivers.impl_rabbit [req-d6113b0f-2db7-408c-9728-306ac91bb90a - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:06:06.688 1 ERROR oslo.messaging._drivers.impl_rabbit [req-d6113b0f-2db7-408c-9728-306ac91bb90a - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:06:06.688 1 ERROR oslo_service.service [req-d6113b0f-2db7-408c-9728-306ac91bb90a - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:06:06.688 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 06:06:06.688 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 06:06:06.688 1 ERROR oslo_service.service     service.start()
>2018-06-26 06:06:06.688 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 06:06:06.688 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 06:06:06.688 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 06:06:06.688 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 06:06:06.688 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 06:06:06.688 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 06:06:06.688 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 06:06:06.688 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 06:06:06.688 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 06:06:06.688 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 06:06:06.688 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 06:06:06.688 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 06:06:06.688 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 06:06:06.688 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 06:06:06.688 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 06:06:06.688 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 06:06:06.688 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 06:06:06.688 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 06:06:06.688 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 06:06:06.688 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 06:06:06.688 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 06:06:06.688 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 06:06:06.688 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:06:06.688 1 ERROR oslo_service.service 
>2018-06-26 06:06:06.691 1 CRITICAL cinder [req-db5bdeb9-1511-4321-ae7b-a4abe084633e - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 06:06:06.691 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 06:06:06.691 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 06:06:06.691 1 ERROR cinder     sys.exit(main())
>2018-06-26 06:06:06.691 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 06:06:06.691 1 ERROR cinder     service.wait()
>2018-06-26 06:06:06.691 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 06:06:06.691 1 ERROR cinder     _launcher.wait()
>2018-06-26 06:06:06.691 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 06:06:06.691 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 06:06:06.691 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 06:06:06.691 1 ERROR cinder     self.services.wait()
>2018-06-26 06:06:06.691 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 06:06:06.691 1 ERROR cinder     service.wait()
>2018-06-26 06:06:06.691 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 06:06:06.691 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 06:06:06.691 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 06:06:06.691 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 06:06:06.691 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 06:06:06.691 1 ERROR cinder     post_fn = fn()
>2018-06-26 06:06:06.691 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 06:06:06.691 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 06:06:06.691 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 06:06:06.691 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 06:06:06.691 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 06:06:06.691 1 ERROR cinder 
>2018-06-26 06:06:09.532 1 WARNING cinder.scheduler.host_manager [req-749079ce-be5c-4d18-98c1-31f0c4728758 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 06:06:09.543 1 INFO cinder.rpc [req-749079ce-be5c-4d18-98c1-31f0c4728758 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 06:06:09.554 1 INFO cinder.rpc [req-749079ce-be5c-4d18-98c1-31f0c4728758 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 06:06:09.570 1 INFO cinder.rpc [req-749079ce-be5c-4d18-98c1-31f0c4728758 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 06:06:09.579 1 INFO cinder.rpc [req-749079ce-be5c-4d18-98c1-31f0c4728758 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 06:06:09.612 1 WARNING oslo_config.cfg [req-749079ce-be5c-4d18-98c1-31f0c4728758 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 06:06:09.617 1 WARNING oslo_config.cfg [req-749079ce-be5c-4d18-98c1-31f0c4728758 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:06:09.618 1 WARNING oslo_config.cfg [req-749079ce-be5c-4d18-98c1-31f0c4728758 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:06:09.619 1 WARNING oslo_config.cfg [req-749079ce-be5c-4d18-98c1-31f0c4728758 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:06:09.624 1 WARNING oslo_config.cfg [req-749079ce-be5c-4d18-98c1-31f0c4728758 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 06:06:09.626 1 WARNING oslo_config.cfg [req-749079ce-be5c-4d18-98c1-31f0c4728758 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 06:06:09.629 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 06:06:09.638 1 INFO cinder.manager [req-adf618f9-53d1-4d94-8e6d-6f07960001a8 - - - - -] Initiating service 5 cleanup
>2018-06-26 06:06:09.644 1 INFO cinder.manager [req-adf618f9-53d1-4d94-8e6d-6f07960001a8 - - - - -] Service 5 cleanup completed.
>2018-06-26 06:08:15.750 1 ERROR oslo.messaging._drivers.impl_rabbit [req-adf618f9-53d1-4d94-8e6d-6f07960001a8 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:08:15.753 1 ERROR oslo.messaging._drivers.impl_rabbit [req-adf618f9-53d1-4d94-8e6d-6f07960001a8 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:08:15.753 1 ERROR oslo_service.service [req-adf618f9-53d1-4d94-8e6d-6f07960001a8 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:08:15.753 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 06:08:15.753 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 06:08:15.753 1 ERROR oslo_service.service     service.start()
>2018-06-26 06:08:15.753 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 06:08:15.753 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 06:08:15.753 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 06:08:15.753 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 06:08:15.753 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 06:08:15.753 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 06:08:15.753 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 06:08:15.753 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 06:08:15.753 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 06:08:15.753 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 06:08:15.753 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 06:08:15.753 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 06:08:15.753 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 06:08:15.753 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 06:08:15.753 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 06:08:15.753 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 06:08:15.753 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 06:08:15.753 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 06:08:15.753 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 06:08:15.753 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 06:08:15.753 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 06:08:15.753 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 06:08:15.753 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:08:15.753 1 ERROR oslo_service.service 
>2018-06-26 06:08:15.756 1 CRITICAL cinder [req-749079ce-be5c-4d18-98c1-31f0c4728758 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 06:08:15.756 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 06:08:15.756 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 06:08:15.756 1 ERROR cinder     sys.exit(main())
>2018-06-26 06:08:15.756 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 06:08:15.756 1 ERROR cinder     service.wait()
>2018-06-26 06:08:15.756 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 06:08:15.756 1 ERROR cinder     _launcher.wait()
>2018-06-26 06:08:15.756 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 06:08:15.756 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 06:08:15.756 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 06:08:15.756 1 ERROR cinder     self.services.wait()
>2018-06-26 06:08:15.756 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 06:08:15.756 1 ERROR cinder     service.wait()
>2018-06-26 06:08:15.756 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 06:08:15.756 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 06:08:15.756 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 06:08:15.756 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 06:08:15.756 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 06:08:15.756 1 ERROR cinder     post_fn = fn()
>2018-06-26 06:08:15.756 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 06:08:15.756 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 06:08:15.756 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 06:08:15.756 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 06:08:15.756 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 06:08:15.756 1 ERROR cinder 
>2018-06-26 06:08:18.498 1 WARNING cinder.scheduler.host_manager [req-b9bc3997-a685-4424-a560-c32fe041553e - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 06:08:18.504 1 INFO cinder.rpc [req-b9bc3997-a685-4424-a560-c32fe041553e - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 06:08:18.511 1 INFO cinder.rpc [req-b9bc3997-a685-4424-a560-c32fe041553e - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 06:08:18.527 1 INFO cinder.rpc [req-b9bc3997-a685-4424-a560-c32fe041553e - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 06:08:18.533 1 INFO cinder.rpc [req-b9bc3997-a685-4424-a560-c32fe041553e - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 06:08:18.561 1 WARNING oslo_config.cfg [req-b9bc3997-a685-4424-a560-c32fe041553e - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 06:08:18.564 1 WARNING oslo_config.cfg [req-b9bc3997-a685-4424-a560-c32fe041553e - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:08:18.564 1 WARNING oslo_config.cfg [req-b9bc3997-a685-4424-a560-c32fe041553e - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:08:18.565 1 WARNING oslo_config.cfg [req-b9bc3997-a685-4424-a560-c32fe041553e - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:08:18.571 1 WARNING oslo_config.cfg [req-b9bc3997-a685-4424-a560-c32fe041553e - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 06:08:18.573 1 WARNING oslo_config.cfg [req-b9bc3997-a685-4424-a560-c32fe041553e - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 06:08:18.575 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 06:08:18.586 1 INFO cinder.manager [req-6a2f3aec-3d69-43cb-9785-daa4d325e6ee - - - - -] Initiating service 5 cleanup
>2018-06-26 06:08:18.597 1 INFO cinder.manager [req-6a2f3aec-3d69-43cb-9785-daa4d325e6ee - - - - -] Service 5 cleanup completed.
>2018-06-26 06:10:29.999 1 ERROR oslo.messaging._drivers.impl_rabbit [req-6a2f3aec-3d69-43cb-9785-daa4d325e6ee - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:10:30.001 1 ERROR oslo.messaging._drivers.impl_rabbit [req-6a2f3aec-3d69-43cb-9785-daa4d325e6ee - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:10:30.002 1 ERROR oslo_service.service [req-6a2f3aec-3d69-43cb-9785-daa4d325e6ee - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:10:30.002 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 06:10:30.002 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 06:10:30.002 1 ERROR oslo_service.service     service.start()
>2018-06-26 06:10:30.002 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 06:10:30.002 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 06:10:30.002 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 06:10:30.002 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 06:10:30.002 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 06:10:30.002 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 06:10:30.002 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 06:10:30.002 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 06:10:30.002 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 06:10:30.002 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 06:10:30.002 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 06:10:30.002 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 06:10:30.002 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 06:10:30.002 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 06:10:30.002 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 06:10:30.002 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 06:10:30.002 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 06:10:30.002 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 06:10:30.002 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 06:10:30.002 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 06:10:30.002 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 06:10:30.002 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 06:10:30.002 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:10:30.002 1 ERROR oslo_service.service 
>2018-06-26 06:10:30.006 1 CRITICAL cinder [req-b9bc3997-a685-4424-a560-c32fe041553e - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 06:10:30.006 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 06:10:30.006 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 06:10:30.006 1 ERROR cinder     sys.exit(main())
>2018-06-26 06:10:30.006 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 06:10:30.006 1 ERROR cinder     service.wait()
>2018-06-26 06:10:30.006 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 06:10:30.006 1 ERROR cinder     _launcher.wait()
>2018-06-26 06:10:30.006 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 06:10:30.006 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 06:10:30.006 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 06:10:30.006 1 ERROR cinder     self.services.wait()
>2018-06-26 06:10:30.006 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 06:10:30.006 1 ERROR cinder     service.wait()
>2018-06-26 06:10:30.006 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 06:10:30.006 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 06:10:30.006 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 06:10:30.006 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 06:10:30.006 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 06:10:30.006 1 ERROR cinder     post_fn = fn()
>2018-06-26 06:10:30.006 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 06:10:30.006 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 06:10:30.006 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 06:10:30.006 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 06:10:30.006 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 06:10:30.006 1 ERROR cinder 
>2018-06-26 06:10:32.750 1 WARNING cinder.scheduler.host_manager [req-6140452f-01a3-4631-8296-3e4389f9751b - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 06:10:32.758 1 INFO cinder.rpc [req-6140452f-01a3-4631-8296-3e4389f9751b - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 06:10:32.764 1 INFO cinder.rpc [req-6140452f-01a3-4631-8296-3e4389f9751b - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 06:10:32.776 1 INFO cinder.rpc [req-6140452f-01a3-4631-8296-3e4389f9751b - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 06:10:32.782 1 INFO cinder.rpc [req-6140452f-01a3-4631-8296-3e4389f9751b - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 06:10:32.804 1 WARNING oslo_config.cfg [req-6140452f-01a3-4631-8296-3e4389f9751b - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 06:10:32.807 1 WARNING oslo_config.cfg [req-6140452f-01a3-4631-8296-3e4389f9751b - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:10:32.808 1 WARNING oslo_config.cfg [req-6140452f-01a3-4631-8296-3e4389f9751b - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:10:32.808 1 WARNING oslo_config.cfg [req-6140452f-01a3-4631-8296-3e4389f9751b - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:10:32.814 1 WARNING oslo_config.cfg [req-6140452f-01a3-4631-8296-3e4389f9751b - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 06:10:32.815 1 WARNING oslo_config.cfg [req-6140452f-01a3-4631-8296-3e4389f9751b - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 06:10:32.818 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 06:10:32.824 1 INFO cinder.manager [req-36b196ea-f769-4193-b5aa-82a204097a5f - - - - -] Initiating service 5 cleanup
>2018-06-26 06:10:32.829 1 INFO cinder.manager [req-36b196ea-f769-4193-b5aa-82a204097a5f - - - - -] Service 5 cleanup completed.
>2018-06-26 06:12:37.154 1 ERROR oslo.messaging._drivers.impl_rabbit [req-36b196ea-f769-4193-b5aa-82a204097a5f - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:12:37.156 1 ERROR oslo.messaging._drivers.impl_rabbit [req-36b196ea-f769-4193-b5aa-82a204097a5f - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:12:37.157 1 ERROR oslo_service.service [req-36b196ea-f769-4193-b5aa-82a204097a5f - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:12:37.157 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 06:12:37.157 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 06:12:37.157 1 ERROR oslo_service.service     service.start()
>2018-06-26 06:12:37.157 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 06:12:37.157 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 06:12:37.157 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 06:12:37.157 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 06:12:37.157 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 06:12:37.157 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 06:12:37.157 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 06:12:37.157 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 06:12:37.157 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 06:12:37.157 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 06:12:37.157 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 06:12:37.157 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 06:12:37.157 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 06:12:37.157 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 06:12:37.157 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 06:12:37.157 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 06:12:37.157 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 06:12:37.157 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 06:12:37.157 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 06:12:37.157 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 06:12:37.157 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 06:12:37.157 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 06:12:37.157 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:12:37.157 1 ERROR oslo_service.service 
>2018-06-26 06:12:37.160 1 CRITICAL cinder [req-6140452f-01a3-4631-8296-3e4389f9751b - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 06:12:37.160 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 06:12:37.160 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 06:12:37.160 1 ERROR cinder     sys.exit(main())
>2018-06-26 06:12:37.160 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 06:12:37.160 1 ERROR cinder     service.wait()
>2018-06-26 06:12:37.160 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 06:12:37.160 1 ERROR cinder     _launcher.wait()
>2018-06-26 06:12:37.160 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 06:12:37.160 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 06:12:37.160 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 06:12:37.160 1 ERROR cinder     self.services.wait()
>2018-06-26 06:12:37.160 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 06:12:37.160 1 ERROR cinder     service.wait()
>2018-06-26 06:12:37.160 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 06:12:37.160 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 06:12:37.160 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 06:12:37.160 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 06:12:37.160 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 06:12:37.160 1 ERROR cinder     post_fn = fn()
>2018-06-26 06:12:37.160 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 06:12:37.160 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 06:12:37.160 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 06:12:37.160 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 06:12:37.160 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 06:12:37.160 1 ERROR cinder 
>2018-06-26 06:12:39.815 1 WARNING cinder.scheduler.host_manager [req-0c783abe-e1d8-4a45-88b5-1581e3c576ff - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 06:12:39.821 1 INFO cinder.rpc [req-0c783abe-e1d8-4a45-88b5-1581e3c576ff - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 06:12:39.828 1 INFO cinder.rpc [req-0c783abe-e1d8-4a45-88b5-1581e3c576ff - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 06:12:39.841 1 INFO cinder.rpc [req-0c783abe-e1d8-4a45-88b5-1581e3c576ff - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 06:12:39.847 1 INFO cinder.rpc [req-0c783abe-e1d8-4a45-88b5-1581e3c576ff - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 06:12:39.874 1 WARNING oslo_config.cfg [req-0c783abe-e1d8-4a45-88b5-1581e3c576ff - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 06:12:39.876 1 WARNING oslo_config.cfg [req-0c783abe-e1d8-4a45-88b5-1581e3c576ff - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:12:39.877 1 WARNING oslo_config.cfg [req-0c783abe-e1d8-4a45-88b5-1581e3c576ff - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:12:39.877 1 WARNING oslo_config.cfg [req-0c783abe-e1d8-4a45-88b5-1581e3c576ff - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:12:39.882 1 WARNING oslo_config.cfg [req-0c783abe-e1d8-4a45-88b5-1581e3c576ff - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 06:12:39.883 1 WARNING oslo_config.cfg [req-0c783abe-e1d8-4a45-88b5-1581e3c576ff - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 06:12:39.886 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 06:12:39.891 1 INFO cinder.manager [req-ad61765b-b17f-45b8-aaf2-a6c13a5cc526 - - - - -] Initiating service 5 cleanup
>2018-06-26 06:12:39.898 1 INFO cinder.manager [req-ad61765b-b17f-45b8-aaf2-a6c13a5cc526 - - - - -] Service 5 cleanup completed.
>2018-06-26 06:14:51.277 1 ERROR oslo.messaging._drivers.impl_rabbit [req-ad61765b-b17f-45b8-aaf2-a6c13a5cc526 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:14:51.280 1 ERROR oslo.messaging._drivers.impl_rabbit [req-ad61765b-b17f-45b8-aaf2-a6c13a5cc526 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:14:51.280 1 ERROR oslo_service.service [req-ad61765b-b17f-45b8-aaf2-a6c13a5cc526 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:14:51.280 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 06:14:51.280 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 06:14:51.280 1 ERROR oslo_service.service     service.start()
>2018-06-26 06:14:51.280 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 06:14:51.280 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 06:14:51.280 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 06:14:51.280 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 06:14:51.280 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 06:14:51.280 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 06:14:51.280 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 06:14:51.280 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 06:14:51.280 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 06:14:51.280 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 06:14:51.280 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 06:14:51.280 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 06:14:51.280 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 06:14:51.280 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 06:14:51.280 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 06:14:51.280 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 06:14:51.280 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 06:14:51.280 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 06:14:51.280 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 06:14:51.280 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 06:14:51.280 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 06:14:51.280 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 06:14:51.280 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:14:51.280 1 ERROR oslo_service.service 
>2018-06-26 06:14:51.283 1 CRITICAL cinder [req-0c783abe-e1d8-4a45-88b5-1581e3c576ff - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 06:14:51.283 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 06:14:51.283 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 06:14:51.283 1 ERROR cinder     sys.exit(main())
>2018-06-26 06:14:51.283 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 06:14:51.283 1 ERROR cinder     service.wait()
>2018-06-26 06:14:51.283 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 06:14:51.283 1 ERROR cinder     _launcher.wait()
>2018-06-26 06:14:51.283 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 06:14:51.283 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 06:14:51.283 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 06:14:51.283 1 ERROR cinder     self.services.wait()
>2018-06-26 06:14:51.283 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 06:14:51.283 1 ERROR cinder     service.wait()
>2018-06-26 06:14:51.283 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 06:14:51.283 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 06:14:51.283 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 06:14:51.283 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 06:14:51.283 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 06:14:51.283 1 ERROR cinder     post_fn = fn()
>2018-06-26 06:14:51.283 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 06:14:51.283 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 06:14:51.283 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 06:14:51.283 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 06:14:51.283 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 06:14:51.283 1 ERROR cinder 
>2018-06-26 06:14:53.842 1 WARNING cinder.scheduler.host_manager [req-7860adf1-da64-4d36-b82c-bb62ebd46e63 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 06:14:53.848 1 INFO cinder.rpc [req-7860adf1-da64-4d36-b82c-bb62ebd46e63 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 06:14:53.853 1 INFO cinder.rpc [req-7860adf1-da64-4d36-b82c-bb62ebd46e63 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 06:14:53.865 1 INFO cinder.rpc [req-7860adf1-da64-4d36-b82c-bb62ebd46e63 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 06:14:53.871 1 INFO cinder.rpc [req-7860adf1-da64-4d36-b82c-bb62ebd46e63 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 06:14:53.895 1 WARNING oslo_config.cfg [req-7860adf1-da64-4d36-b82c-bb62ebd46e63 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 06:14:53.897 1 WARNING oslo_config.cfg [req-7860adf1-da64-4d36-b82c-bb62ebd46e63 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:14:53.897 1 WARNING oslo_config.cfg [req-7860adf1-da64-4d36-b82c-bb62ebd46e63 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:14:53.898 1 WARNING oslo_config.cfg [req-7860adf1-da64-4d36-b82c-bb62ebd46e63 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:14:53.903 1 WARNING oslo_config.cfg [req-7860adf1-da64-4d36-b82c-bb62ebd46e63 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 06:14:53.904 1 WARNING oslo_config.cfg [req-7860adf1-da64-4d36-b82c-bb62ebd46e63 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 06:14:53.906 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 06:14:53.915 1 INFO cinder.manager [req-48a5e06d-89ff-48a1-af60-16f23855ec39 - - - - -] Initiating service 5 cleanup
>2018-06-26 06:14:53.919 1 INFO cinder.manager [req-48a5e06d-89ff-48a1-af60-16f23855ec39 - - - - -] Service 5 cleanup completed.
>2018-06-26 06:17:00.002 1 ERROR oslo.messaging._drivers.impl_rabbit [req-48a5e06d-89ff-48a1-af60-16f23855ec39 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:17:00.004 1 ERROR oslo.messaging._drivers.impl_rabbit [req-48a5e06d-89ff-48a1-af60-16f23855ec39 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:17:00.005 1 ERROR oslo_service.service [req-48a5e06d-89ff-48a1-af60-16f23855ec39 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:17:00.005 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 06:17:00.005 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 06:17:00.005 1 ERROR oslo_service.service     service.start()
>2018-06-26 06:17:00.005 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 06:17:00.005 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 06:17:00.005 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 06:17:00.005 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 06:17:00.005 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 06:17:00.005 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 06:17:00.005 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 06:17:00.005 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 06:17:00.005 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 06:17:00.005 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 06:17:00.005 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 06:17:00.005 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 06:17:00.005 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 06:17:00.005 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 06:17:00.005 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 06:17:00.005 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 06:17:00.005 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 06:17:00.005 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 06:17:00.005 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 06:17:00.005 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 06:17:00.005 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 06:17:00.005 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 06:17:00.005 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:17:00.005 1 ERROR oslo_service.service 
>2018-06-26 06:17:00.008 1 CRITICAL cinder [req-7860adf1-da64-4d36-b82c-bb62ebd46e63 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 06:17:00.008 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 06:17:00.008 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 06:17:00.008 1 ERROR cinder     sys.exit(main())
>2018-06-26 06:17:00.008 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 06:17:00.008 1 ERROR cinder     service.wait()
>2018-06-26 06:17:00.008 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 06:17:00.008 1 ERROR cinder     _launcher.wait()
>2018-06-26 06:17:00.008 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 06:17:00.008 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 06:17:00.008 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 06:17:00.008 1 ERROR cinder     self.services.wait()
>2018-06-26 06:17:00.008 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 06:17:00.008 1 ERROR cinder     service.wait()
>2018-06-26 06:17:00.008 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 06:17:00.008 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 06:17:00.008 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 06:17:00.008 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 06:17:00.008 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 06:17:00.008 1 ERROR cinder     post_fn = fn()
>2018-06-26 06:17:00.008 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 06:17:00.008 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 06:17:00.008 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 06:17:00.008 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 06:17:00.008 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 06:17:00.008 1 ERROR cinder 
>2018-06-26 06:17:02.721 1 WARNING cinder.scheduler.host_manager [req-89554e54-9328-40cc-8acf-1b741ca30d75 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 06:17:02.728 1 INFO cinder.rpc [req-89554e54-9328-40cc-8acf-1b741ca30d75 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 06:17:02.734 1 INFO cinder.rpc [req-89554e54-9328-40cc-8acf-1b741ca30d75 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 06:17:02.744 1 INFO cinder.rpc [req-89554e54-9328-40cc-8acf-1b741ca30d75 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 06:17:02.750 1 INFO cinder.rpc [req-89554e54-9328-40cc-8acf-1b741ca30d75 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 06:17:02.776 1 WARNING oslo_config.cfg [req-89554e54-9328-40cc-8acf-1b741ca30d75 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 06:17:02.779 1 WARNING oslo_config.cfg [req-89554e54-9328-40cc-8acf-1b741ca30d75 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:17:02.780 1 WARNING oslo_config.cfg [req-89554e54-9328-40cc-8acf-1b741ca30d75 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:17:02.780 1 WARNING oslo_config.cfg [req-89554e54-9328-40cc-8acf-1b741ca30d75 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:17:02.786 1 WARNING oslo_config.cfg [req-89554e54-9328-40cc-8acf-1b741ca30d75 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 06:17:02.787 1 WARNING oslo_config.cfg [req-89554e54-9328-40cc-8acf-1b741ca30d75 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 06:17:02.792 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 06:17:02.800 1 INFO cinder.manager [req-07bb5d2d-d479-43d0-9c6a-e70af1043bbc - - - - -] Initiating service 5 cleanup
>2018-06-26 06:17:02.805 1 INFO cinder.manager [req-07bb5d2d-d479-43d0-9c6a-e70af1043bbc - - - - -] Service 5 cleanup completed.
>2018-06-26 06:19:07.154 1 ERROR oslo.messaging._drivers.impl_rabbit [req-07bb5d2d-d479-43d0-9c6a-e70af1043bbc - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:19:07.155 1 ERROR oslo.messaging._drivers.impl_rabbit [req-07bb5d2d-d479-43d0-9c6a-e70af1043bbc - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:19:07.156 1 ERROR oslo_service.service [req-07bb5d2d-d479-43d0-9c6a-e70af1043bbc - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:19:07.156 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 06:19:07.156 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 06:19:07.156 1 ERROR oslo_service.service     service.start()
>2018-06-26 06:19:07.156 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 06:19:07.156 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 06:19:07.156 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 06:19:07.156 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 06:19:07.156 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 06:19:07.156 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 06:19:07.156 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 06:19:07.156 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 06:19:07.156 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 06:19:07.156 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 06:19:07.156 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 06:19:07.156 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 06:19:07.156 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 06:19:07.156 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 06:19:07.156 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 06:19:07.156 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 06:19:07.156 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 06:19:07.156 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 06:19:07.156 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 06:19:07.156 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 06:19:07.156 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 06:19:07.156 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 06:19:07.156 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:19:07.156 1 ERROR oslo_service.service 
>2018-06-26 06:19:07.159 1 CRITICAL cinder [req-89554e54-9328-40cc-8acf-1b741ca30d75 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 06:19:07.159 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 06:19:07.159 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 06:19:07.159 1 ERROR cinder     sys.exit(main())
>2018-06-26 06:19:07.159 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 06:19:07.159 1 ERROR cinder     service.wait()
>2018-06-26 06:19:07.159 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 06:19:07.159 1 ERROR cinder     _launcher.wait()
>2018-06-26 06:19:07.159 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 06:19:07.159 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 06:19:07.159 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 06:19:07.159 1 ERROR cinder     self.services.wait()
>2018-06-26 06:19:07.159 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 06:19:07.159 1 ERROR cinder     service.wait()
>2018-06-26 06:19:07.159 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 06:19:07.159 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 06:19:07.159 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 06:19:07.159 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 06:19:07.159 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 06:19:07.159 1 ERROR cinder     post_fn = fn()
>2018-06-26 06:19:07.159 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 06:19:07.159 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 06:19:07.159 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 06:19:07.159 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 06:19:07.159 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 06:19:07.159 1 ERROR cinder 
>2018-06-26 06:19:09.879 1 WARNING cinder.scheduler.host_manager [req-64897469-fd19-4272-8666-9538023312f1 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 06:19:09.886 1 INFO cinder.rpc [req-64897469-fd19-4272-8666-9538023312f1 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 06:19:09.892 1 INFO cinder.rpc [req-64897469-fd19-4272-8666-9538023312f1 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 06:19:09.910 1 INFO cinder.rpc [req-64897469-fd19-4272-8666-9538023312f1 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 06:19:09.918 1 INFO cinder.rpc [req-64897469-fd19-4272-8666-9538023312f1 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 06:19:09.949 1 WARNING oslo_config.cfg [req-64897469-fd19-4272-8666-9538023312f1 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 06:19:09.951 1 WARNING oslo_config.cfg [req-64897469-fd19-4272-8666-9538023312f1 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:19:09.952 1 WARNING oslo_config.cfg [req-64897469-fd19-4272-8666-9538023312f1 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:19:09.952 1 WARNING oslo_config.cfg [req-64897469-fd19-4272-8666-9538023312f1 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:19:09.957 1 WARNING oslo_config.cfg [req-64897469-fd19-4272-8666-9538023312f1 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 06:19:09.958 1 WARNING oslo_config.cfg [req-64897469-fd19-4272-8666-9538023312f1 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 06:19:09.961 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 06:19:09.968 1 INFO cinder.manager [req-f7f25c92-2be0-4f2d-8a58-fc271a42fce5 - - - - -] Initiating service 5 cleanup
>2018-06-26 06:19:09.972 1 INFO cinder.manager [req-f7f25c92-2be0-4f2d-8a58-fc271a42fce5 - - - - -] Service 5 cleanup completed.
>2018-06-26 06:21:16.086 1 ERROR oslo.messaging._drivers.impl_rabbit [req-f7f25c92-2be0-4f2d-8a58-fc271a42fce5 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:21:16.088 1 ERROR oslo.messaging._drivers.impl_rabbit [req-f7f25c92-2be0-4f2d-8a58-fc271a42fce5 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:21:16.088 1 ERROR oslo_service.service [req-f7f25c92-2be0-4f2d-8a58-fc271a42fce5 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:21:16.088 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 06:21:16.088 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 06:21:16.088 1 ERROR oslo_service.service     service.start()
>2018-06-26 06:21:16.088 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 06:21:16.088 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 06:21:16.088 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 06:21:16.088 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 06:21:16.088 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 06:21:16.088 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 06:21:16.088 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 06:21:16.088 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 06:21:16.088 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 06:21:16.088 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 06:21:16.088 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 06:21:16.088 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 06:21:16.088 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 06:21:16.088 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 06:21:16.088 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 06:21:16.088 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 06:21:16.088 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 06:21:16.088 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 06:21:16.088 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 06:21:16.088 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 06:21:16.088 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 06:21:16.088 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 06:21:16.088 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:21:16.088 1 ERROR oslo_service.service 
>2018-06-26 06:21:16.091 1 CRITICAL cinder [req-64897469-fd19-4272-8666-9538023312f1 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 06:21:16.091 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 06:21:16.091 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 06:21:16.091 1 ERROR cinder     sys.exit(main())
>2018-06-26 06:21:16.091 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 06:21:16.091 1 ERROR cinder     service.wait()
>2018-06-26 06:21:16.091 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 06:21:16.091 1 ERROR cinder     _launcher.wait()
>2018-06-26 06:21:16.091 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 06:21:16.091 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 06:21:16.091 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 06:21:16.091 1 ERROR cinder     self.services.wait()
>2018-06-26 06:21:16.091 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 06:21:16.091 1 ERROR cinder     service.wait()
>2018-06-26 06:21:16.091 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 06:21:16.091 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 06:21:16.091 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 06:21:16.091 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 06:21:16.091 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 06:21:16.091 1 ERROR cinder     post_fn = fn()
>2018-06-26 06:21:16.091 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 06:21:16.091 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 06:21:16.091 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 06:21:16.091 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 06:21:16.091 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 06:21:16.091 1 ERROR cinder 
>2018-06-26 06:21:18.843 1 WARNING cinder.scheduler.host_manager [req-50d82c36-4d16-4b51-a1c4-654f40060637 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 06:21:18.859 1 INFO cinder.rpc [req-50d82c36-4d16-4b51-a1c4-654f40060637 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 06:21:18.868 1 INFO cinder.rpc [req-50d82c36-4d16-4b51-a1c4-654f40060637 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 06:21:18.886 1 INFO cinder.rpc [req-50d82c36-4d16-4b51-a1c4-654f40060637 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 06:21:18.896 1 INFO cinder.rpc [req-50d82c36-4d16-4b51-a1c4-654f40060637 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 06:21:18.968 1 WARNING oslo_config.cfg [req-50d82c36-4d16-4b51-a1c4-654f40060637 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 06:21:18.970 1 WARNING oslo_config.cfg [req-50d82c36-4d16-4b51-a1c4-654f40060637 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:21:18.971 1 WARNING oslo_config.cfg [req-50d82c36-4d16-4b51-a1c4-654f40060637 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:21:18.971 1 WARNING oslo_config.cfg [req-50d82c36-4d16-4b51-a1c4-654f40060637 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:21:18.977 1 WARNING oslo_config.cfg [req-50d82c36-4d16-4b51-a1c4-654f40060637 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 06:21:18.978 1 WARNING oslo_config.cfg [req-50d82c36-4d16-4b51-a1c4-654f40060637 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 06:21:18.981 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 06:21:18.995 1 INFO cinder.manager [req-739af41d-a199-4456-9953-c85d82768b68 - - - - -] Initiating service 5 cleanup
>2018-06-26 06:21:19.019 1 INFO cinder.manager [req-739af41d-a199-4456-9953-c85d82768b68 - - - - -] Service 5 cleanup completed.
>2018-06-26 06:23:25.113 1 ERROR oslo.messaging._drivers.impl_rabbit [req-739af41d-a199-4456-9953-c85d82768b68 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:23:25.115 1 ERROR oslo.messaging._drivers.impl_rabbit [req-739af41d-a199-4456-9953-c85d82768b68 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:23:25.115 1 ERROR oslo_service.service [req-739af41d-a199-4456-9953-c85d82768b68 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:23:25.115 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 06:23:25.115 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 06:23:25.115 1 ERROR oslo_service.service     service.start()
>2018-06-26 06:23:25.115 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 06:23:25.115 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 06:23:25.115 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 06:23:25.115 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 06:23:25.115 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 06:23:25.115 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 06:23:25.115 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 06:23:25.115 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 06:23:25.115 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 06:23:25.115 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 06:23:25.115 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 06:23:25.115 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 06:23:25.115 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 06:23:25.115 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 06:23:25.115 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 06:23:25.115 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 06:23:25.115 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 06:23:25.115 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 06:23:25.115 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 06:23:25.115 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 06:23:25.115 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 06:23:25.115 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 06:23:25.115 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:23:25.115 1 ERROR oslo_service.service 
>2018-06-26 06:23:25.118 1 CRITICAL cinder [req-50d82c36-4d16-4b51-a1c4-654f40060637 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 06:23:25.118 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 06:23:25.118 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 06:23:25.118 1 ERROR cinder     sys.exit(main())
>2018-06-26 06:23:25.118 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 06:23:25.118 1 ERROR cinder     service.wait()
>2018-06-26 06:23:25.118 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 06:23:25.118 1 ERROR cinder     _launcher.wait()
>2018-06-26 06:23:25.118 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 06:23:25.118 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 06:23:25.118 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 06:23:25.118 1 ERROR cinder     self.services.wait()
>2018-06-26 06:23:25.118 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 06:23:25.118 1 ERROR cinder     service.wait()
>2018-06-26 06:23:25.118 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 06:23:25.118 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 06:23:25.118 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 06:23:25.118 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 06:23:25.118 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 06:23:25.118 1 ERROR cinder     post_fn = fn()
>2018-06-26 06:23:25.118 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 06:23:25.118 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 06:23:25.118 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 06:23:25.118 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 06:23:25.118 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 06:23:25.118 1 ERROR cinder 
>2018-06-26 06:23:27.756 1 WARNING cinder.scheduler.host_manager [req-c7afd25b-48d4-4c06-b8f4-cfe63aafffc2 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 06:23:27.762 1 INFO cinder.rpc [req-c7afd25b-48d4-4c06-b8f4-cfe63aafffc2 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 06:23:27.769 1 INFO cinder.rpc [req-c7afd25b-48d4-4c06-b8f4-cfe63aafffc2 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 06:23:27.784 1 INFO cinder.rpc [req-c7afd25b-48d4-4c06-b8f4-cfe63aafffc2 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 06:23:27.792 1 INFO cinder.rpc [req-c7afd25b-48d4-4c06-b8f4-cfe63aafffc2 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 06:23:27.815 1 WARNING oslo_config.cfg [req-c7afd25b-48d4-4c06-b8f4-cfe63aafffc2 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 06:23:27.818 1 WARNING oslo_config.cfg [req-c7afd25b-48d4-4c06-b8f4-cfe63aafffc2 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:23:27.818 1 WARNING oslo_config.cfg [req-c7afd25b-48d4-4c06-b8f4-cfe63aafffc2 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:23:27.819 1 WARNING oslo_config.cfg [req-c7afd25b-48d4-4c06-b8f4-cfe63aafffc2 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:23:27.825 1 WARNING oslo_config.cfg [req-c7afd25b-48d4-4c06-b8f4-cfe63aafffc2 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 06:23:27.826 1 WARNING oslo_config.cfg [req-c7afd25b-48d4-4c06-b8f4-cfe63aafffc2 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 06:23:27.829 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 06:23:27.844 1 INFO cinder.manager [req-6ed9f8d9-dfe4-486f-86c7-5499b493e300 - - - - -] Initiating service 5 cleanup
>2018-06-26 06:23:27.849 1 INFO cinder.manager [req-6ed9f8d9-dfe4-486f-86c7-5499b493e300 - - - - -] Service 5 cleanup completed.
>2018-06-26 06:25:32.337 1 ERROR oslo.messaging._drivers.impl_rabbit [req-6ed9f8d9-dfe4-486f-86c7-5499b493e300 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:25:32.339 1 ERROR oslo.messaging._drivers.impl_rabbit [req-6ed9f8d9-dfe4-486f-86c7-5499b493e300 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:25:32.339 1 ERROR oslo_service.service [req-6ed9f8d9-dfe4-486f-86c7-5499b493e300 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:25:32.339 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 06:25:32.339 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 06:25:32.339 1 ERROR oslo_service.service     service.start()
>2018-06-26 06:25:32.339 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 06:25:32.339 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 06:25:32.339 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 06:25:32.339 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 06:25:32.339 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 06:25:32.339 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 06:25:32.339 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 06:25:32.339 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 06:25:32.339 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 06:25:32.339 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 06:25:32.339 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 06:25:32.339 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 06:25:32.339 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 06:25:32.339 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 06:25:32.339 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 06:25:32.339 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 06:25:32.339 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 06:25:32.339 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 06:25:32.339 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 06:25:32.339 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 06:25:32.339 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 06:25:32.339 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 06:25:32.339 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:25:32.339 1 ERROR oslo_service.service 
>2018-06-26 06:25:32.342 1 CRITICAL cinder [req-c7afd25b-48d4-4c06-b8f4-cfe63aafffc2 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 06:25:32.342 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 06:25:32.342 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 06:25:32.342 1 ERROR cinder     sys.exit(main())
>2018-06-26 06:25:32.342 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 06:25:32.342 1 ERROR cinder     service.wait()
>2018-06-26 06:25:32.342 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 06:25:32.342 1 ERROR cinder     _launcher.wait()
>2018-06-26 06:25:32.342 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 06:25:32.342 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 06:25:32.342 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 06:25:32.342 1 ERROR cinder     self.services.wait()
>2018-06-26 06:25:32.342 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 06:25:32.342 1 ERROR cinder     service.wait()
>2018-06-26 06:25:32.342 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 06:25:32.342 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 06:25:32.342 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 06:25:32.342 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 06:25:32.342 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 06:25:32.342 1 ERROR cinder     post_fn = fn()
>2018-06-26 06:25:32.342 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 06:25:32.342 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 06:25:32.342 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 06:25:32.342 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 06:25:32.342 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 06:25:32.342 1 ERROR cinder 
>2018-06-26 06:25:35.052 1 WARNING cinder.scheduler.host_manager [req-a62bcae3-b702-4832-9363-8ccfeb175ee8 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 06:25:35.058 1 INFO cinder.rpc [req-a62bcae3-b702-4832-9363-8ccfeb175ee8 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 06:25:35.064 1 INFO cinder.rpc [req-a62bcae3-b702-4832-9363-8ccfeb175ee8 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 06:25:35.077 1 INFO cinder.rpc [req-a62bcae3-b702-4832-9363-8ccfeb175ee8 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 06:25:35.086 1 INFO cinder.rpc [req-a62bcae3-b702-4832-9363-8ccfeb175ee8 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 06:25:35.109 1 WARNING oslo_config.cfg [req-a62bcae3-b702-4832-9363-8ccfeb175ee8 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 06:25:35.111 1 WARNING oslo_config.cfg [req-a62bcae3-b702-4832-9363-8ccfeb175ee8 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:25:35.112 1 WARNING oslo_config.cfg [req-a62bcae3-b702-4832-9363-8ccfeb175ee8 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:25:35.112 1 WARNING oslo_config.cfg [req-a62bcae3-b702-4832-9363-8ccfeb175ee8 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:25:35.117 1 WARNING oslo_config.cfg [req-a62bcae3-b702-4832-9363-8ccfeb175ee8 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 06:25:35.118 1 WARNING oslo_config.cfg [req-a62bcae3-b702-4832-9363-8ccfeb175ee8 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 06:25:35.121 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 06:25:35.129 1 INFO cinder.manager [req-14236d04-15bc-4d50-8d1a-f17bf5b8df37 - - - - -] Initiating service 5 cleanup
>2018-06-26 06:25:35.135 1 INFO cinder.manager [req-14236d04-15bc-4d50-8d1a-f17bf5b8df37 - - - - -] Service 5 cleanup completed.
>2018-06-26 06:27:41.624 1 ERROR oslo.messaging._drivers.impl_rabbit [req-14236d04-15bc-4d50-8d1a-f17bf5b8df37 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:27:41.625 1 ERROR oslo.messaging._drivers.impl_rabbit [req-14236d04-15bc-4d50-8d1a-f17bf5b8df37 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:27:41.626 1 ERROR oslo_service.service [req-14236d04-15bc-4d50-8d1a-f17bf5b8df37 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:27:41.626 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 06:27:41.626 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 06:27:41.626 1 ERROR oslo_service.service     service.start()
>2018-06-26 06:27:41.626 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 06:27:41.626 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 06:27:41.626 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 06:27:41.626 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 06:27:41.626 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 06:27:41.626 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 06:27:41.626 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 06:27:41.626 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 06:27:41.626 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 06:27:41.626 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 06:27:41.626 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 06:27:41.626 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 06:27:41.626 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 06:27:41.626 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 06:27:41.626 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 06:27:41.626 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 06:27:41.626 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 06:27:41.626 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 06:27:41.626 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 06:27:41.626 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 06:27:41.626 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 06:27:41.626 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 06:27:41.626 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:27:41.626 1 ERROR oslo_service.service 
>2018-06-26 06:27:41.628 1 CRITICAL cinder [req-a62bcae3-b702-4832-9363-8ccfeb175ee8 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 06:27:41.628 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 06:27:41.628 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 06:27:41.628 1 ERROR cinder     sys.exit(main())
>2018-06-26 06:27:41.628 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 06:27:41.628 1 ERROR cinder     service.wait()
>2018-06-26 06:27:41.628 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 06:27:41.628 1 ERROR cinder     _launcher.wait()
>2018-06-26 06:27:41.628 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 06:27:41.628 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 06:27:41.628 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 06:27:41.628 1 ERROR cinder     self.services.wait()
>2018-06-26 06:27:41.628 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 06:27:41.628 1 ERROR cinder     service.wait()
>2018-06-26 06:27:41.628 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 06:27:41.628 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 06:27:41.628 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 06:27:41.628 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 06:27:41.628 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 06:27:41.628 1 ERROR cinder     post_fn = fn()
>2018-06-26 06:27:41.628 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 06:27:41.628 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 06:27:41.628 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 06:27:41.628 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 06:27:41.628 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 06:27:41.628 1 ERROR cinder 
>2018-06-26 06:27:44.112 1 WARNING cinder.scheduler.host_manager [req-5131f97a-30e9-4ad2-9c7d-c8731c81410c - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 06:27:44.118 1 INFO cinder.rpc [req-5131f97a-30e9-4ad2-9c7d-c8731c81410c - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 06:27:44.126 1 INFO cinder.rpc [req-5131f97a-30e9-4ad2-9c7d-c8731c81410c - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 06:27:44.141 1 INFO cinder.rpc [req-5131f97a-30e9-4ad2-9c7d-c8731c81410c - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 06:27:44.146 1 INFO cinder.rpc [req-5131f97a-30e9-4ad2-9c7d-c8731c81410c - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 06:27:44.168 1 WARNING oslo_config.cfg [req-5131f97a-30e9-4ad2-9c7d-c8731c81410c - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 06:27:44.171 1 WARNING oslo_config.cfg [req-5131f97a-30e9-4ad2-9c7d-c8731c81410c - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:27:44.171 1 WARNING oslo_config.cfg [req-5131f97a-30e9-4ad2-9c7d-c8731c81410c - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:27:44.172 1 WARNING oslo_config.cfg [req-5131f97a-30e9-4ad2-9c7d-c8731c81410c - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:27:44.177 1 WARNING oslo_config.cfg [req-5131f97a-30e9-4ad2-9c7d-c8731c81410c - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 06:27:44.178 1 WARNING oslo_config.cfg [req-5131f97a-30e9-4ad2-9c7d-c8731c81410c - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 06:27:44.180 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 06:27:44.186 1 INFO cinder.manager [req-6508b4b7-4d0a-454f-8263-1f59e98fa1a8 - - - - -] Initiating service 5 cleanup
>2018-06-26 06:27:44.191 1 INFO cinder.manager [req-6508b4b7-4d0a-454f-8263-1f59e98fa1a8 - - - - -] Service 5 cleanup completed.
>2018-06-26 06:29:55.900 1 ERROR oslo.messaging._drivers.impl_rabbit [req-6508b4b7-4d0a-454f-8263-1f59e98fa1a8 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:29:55.902 1 ERROR oslo.messaging._drivers.impl_rabbit [req-6508b4b7-4d0a-454f-8263-1f59e98fa1a8 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:29:55.902 1 ERROR oslo_service.service [req-6508b4b7-4d0a-454f-8263-1f59e98fa1a8 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:29:55.902 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 06:29:55.902 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 06:29:55.902 1 ERROR oslo_service.service     service.start()
>2018-06-26 06:29:55.902 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 06:29:55.902 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 06:29:55.902 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 06:29:55.902 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 06:29:55.902 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 06:29:55.902 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 06:29:55.902 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 06:29:55.902 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 06:29:55.902 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 06:29:55.902 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 06:29:55.902 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 06:29:55.902 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 06:29:55.902 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 06:29:55.902 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 06:29:55.902 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 06:29:55.902 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 06:29:55.902 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 06:29:55.902 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 06:29:55.902 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 06:29:55.902 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 06:29:55.902 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 06:29:55.902 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 06:29:55.902 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:29:55.902 1 ERROR oslo_service.service 
>2018-06-26 06:29:55.905 1 CRITICAL cinder [req-5131f97a-30e9-4ad2-9c7d-c8731c81410c - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 06:29:55.905 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 06:29:55.905 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 06:29:55.905 1 ERROR cinder     sys.exit(main())
>2018-06-26 06:29:55.905 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 06:29:55.905 1 ERROR cinder     service.wait()
>2018-06-26 06:29:55.905 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 06:29:55.905 1 ERROR cinder     _launcher.wait()
>2018-06-26 06:29:55.905 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 06:29:55.905 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 06:29:55.905 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 06:29:55.905 1 ERROR cinder     self.services.wait()
>2018-06-26 06:29:55.905 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 06:29:55.905 1 ERROR cinder     service.wait()
>2018-06-26 06:29:55.905 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 06:29:55.905 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 06:29:55.905 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 06:29:55.905 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 06:29:55.905 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 06:29:55.905 1 ERROR cinder     post_fn = fn()
>2018-06-26 06:29:55.905 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 06:29:55.905 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 06:29:55.905 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 06:29:55.905 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 06:29:55.905 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 06:29:55.905 1 ERROR cinder 
>2018-06-26 06:29:58.664 1 WARNING cinder.scheduler.host_manager [req-303601d8-379b-4402-84aa-0d478d9e7315 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 06:29:58.671 1 INFO cinder.rpc [req-303601d8-379b-4402-84aa-0d478d9e7315 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 06:29:58.681 1 INFO cinder.rpc [req-303601d8-379b-4402-84aa-0d478d9e7315 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 06:29:58.694 1 INFO cinder.rpc [req-303601d8-379b-4402-84aa-0d478d9e7315 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 06:29:58.701 1 INFO cinder.rpc [req-303601d8-379b-4402-84aa-0d478d9e7315 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 06:29:58.724 1 WARNING oslo_config.cfg [req-303601d8-379b-4402-84aa-0d478d9e7315 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 06:29:58.726 1 WARNING oslo_config.cfg [req-303601d8-379b-4402-84aa-0d478d9e7315 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:29:58.727 1 WARNING oslo_config.cfg [req-303601d8-379b-4402-84aa-0d478d9e7315 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:29:58.727 1 WARNING oslo_config.cfg [req-303601d8-379b-4402-84aa-0d478d9e7315 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:29:58.732 1 WARNING oslo_config.cfg [req-303601d8-379b-4402-84aa-0d478d9e7315 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 06:29:58.734 1 WARNING oslo_config.cfg [req-303601d8-379b-4402-84aa-0d478d9e7315 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 06:29:58.737 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 06:29:58.743 1 INFO cinder.manager [req-4583d03b-30bb-4118-82b3-5601065a2bc3 - - - - -] Initiating service 5 cleanup
>2018-06-26 06:29:58.748 1 INFO cinder.manager [req-4583d03b-30bb-4118-82b3-5601065a2bc3 - - - - -] Service 5 cleanup completed.
>2018-06-26 06:32:05.242 1 ERROR oslo.messaging._drivers.impl_rabbit [req-4583d03b-30bb-4118-82b3-5601065a2bc3 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:32:05.243 1 ERROR oslo.messaging._drivers.impl_rabbit [req-4583d03b-30bb-4118-82b3-5601065a2bc3 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:32:05.244 1 ERROR oslo_service.service [req-4583d03b-30bb-4118-82b3-5601065a2bc3 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:32:05.244 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 06:32:05.244 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 06:32:05.244 1 ERROR oslo_service.service     service.start()
>2018-06-26 06:32:05.244 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 06:32:05.244 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 06:32:05.244 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 06:32:05.244 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 06:32:05.244 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 06:32:05.244 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 06:32:05.244 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 06:32:05.244 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 06:32:05.244 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 06:32:05.244 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 06:32:05.244 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 06:32:05.244 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 06:32:05.244 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 06:32:05.244 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 06:32:05.244 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 06:32:05.244 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 06:32:05.244 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 06:32:05.244 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 06:32:05.244 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 06:32:05.244 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 06:32:05.244 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 06:32:05.244 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 06:32:05.244 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:32:05.244 1 ERROR oslo_service.service 
>2018-06-26 06:32:05.247 1 CRITICAL cinder [req-303601d8-379b-4402-84aa-0d478d9e7315 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 06:32:05.247 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 06:32:05.247 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 06:32:05.247 1 ERROR cinder     sys.exit(main())
>2018-06-26 06:32:05.247 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 06:32:05.247 1 ERROR cinder     service.wait()
>2018-06-26 06:32:05.247 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 06:32:05.247 1 ERROR cinder     _launcher.wait()
>2018-06-26 06:32:05.247 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 06:32:05.247 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 06:32:05.247 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 06:32:05.247 1 ERROR cinder     self.services.wait()
>2018-06-26 06:32:05.247 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 06:32:05.247 1 ERROR cinder     service.wait()
>2018-06-26 06:32:05.247 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 06:32:05.247 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 06:32:05.247 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 06:32:05.247 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 06:32:05.247 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 06:32:05.247 1 ERROR cinder     post_fn = fn()
>2018-06-26 06:32:05.247 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 06:32:05.247 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 06:32:05.247 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 06:32:05.247 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 06:32:05.247 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 06:32:05.247 1 ERROR cinder 
>2018-06-26 06:32:07.889 1 WARNING cinder.scheduler.host_manager [req-d98b1c23-afec-451c-b3de-41fa09837da6 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 06:32:07.895 1 INFO cinder.rpc [req-d98b1c23-afec-451c-b3de-41fa09837da6 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 06:32:07.900 1 INFO cinder.rpc [req-d98b1c23-afec-451c-b3de-41fa09837da6 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 06:32:07.914 1 INFO cinder.rpc [req-d98b1c23-afec-451c-b3de-41fa09837da6 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 06:32:07.920 1 INFO cinder.rpc [req-d98b1c23-afec-451c-b3de-41fa09837da6 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 06:32:07.943 1 WARNING oslo_config.cfg [req-d98b1c23-afec-451c-b3de-41fa09837da6 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 06:32:07.946 1 WARNING oslo_config.cfg [req-d98b1c23-afec-451c-b3de-41fa09837da6 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:32:07.946 1 WARNING oslo_config.cfg [req-d98b1c23-afec-451c-b3de-41fa09837da6 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:32:07.947 1 WARNING oslo_config.cfg [req-d98b1c23-afec-451c-b3de-41fa09837da6 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:32:07.952 1 WARNING oslo_config.cfg [req-d98b1c23-afec-451c-b3de-41fa09837da6 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 06:32:07.954 1 WARNING oslo_config.cfg [req-d98b1c23-afec-451c-b3de-41fa09837da6 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 06:32:07.956 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 06:32:07.962 1 INFO cinder.manager [req-398f3841-fea5-4d54-b263-cbd574487d8b - - - - -] Initiating service 5 cleanup
>2018-06-26 06:32:07.967 1 INFO cinder.manager [req-398f3841-fea5-4d54-b263-cbd574487d8b - - - - -] Service 5 cleanup completed.
>2018-06-26 06:34:12.406 1 ERROR oslo.messaging._drivers.impl_rabbit [req-398f3841-fea5-4d54-b263-cbd574487d8b - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:34:12.410 1 ERROR oslo.messaging._drivers.impl_rabbit [req-398f3841-fea5-4d54-b263-cbd574487d8b - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:34:12.410 1 ERROR oslo_service.service [req-398f3841-fea5-4d54-b263-cbd574487d8b - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:34:12.410 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 06:34:12.410 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 06:34:12.410 1 ERROR oslo_service.service     service.start()
>2018-06-26 06:34:12.410 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 06:34:12.410 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 06:34:12.410 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 06:34:12.410 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 06:34:12.410 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 06:34:12.410 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 06:34:12.410 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 06:34:12.410 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 06:34:12.410 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 06:34:12.410 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 06:34:12.410 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 06:34:12.410 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 06:34:12.410 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 06:34:12.410 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 06:34:12.410 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 06:34:12.410 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 06:34:12.410 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 06:34:12.410 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 06:34:12.410 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 06:34:12.410 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 06:34:12.410 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 06:34:12.410 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 06:34:12.410 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:34:12.410 1 ERROR oslo_service.service 
>2018-06-26 06:34:12.413 1 CRITICAL cinder [req-d98b1c23-afec-451c-b3de-41fa09837da6 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 06:34:12.413 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 06:34:12.413 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 06:34:12.413 1 ERROR cinder     sys.exit(main())
>2018-06-26 06:34:12.413 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 06:34:12.413 1 ERROR cinder     service.wait()
>2018-06-26 06:34:12.413 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 06:34:12.413 1 ERROR cinder     _launcher.wait()
>2018-06-26 06:34:12.413 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 06:34:12.413 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 06:34:12.413 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 06:34:12.413 1 ERROR cinder     self.services.wait()
>2018-06-26 06:34:12.413 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 06:34:12.413 1 ERROR cinder     service.wait()
>2018-06-26 06:34:12.413 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 06:34:12.413 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 06:34:12.413 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 06:34:12.413 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 06:34:12.413 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 06:34:12.413 1 ERROR cinder     post_fn = fn()
>2018-06-26 06:34:12.413 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 06:34:12.413 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 06:34:12.413 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 06:34:12.413 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 06:34:12.413 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 06:34:12.413 1 ERROR cinder 
>2018-06-26 06:34:15.153 1 WARNING cinder.scheduler.host_manager [req-7a08c731-dab9-4269-85c9-ca6330a76540 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 06:34:15.159 1 INFO cinder.rpc [req-7a08c731-dab9-4269-85c9-ca6330a76540 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 06:34:15.165 1 INFO cinder.rpc [req-7a08c731-dab9-4269-85c9-ca6330a76540 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 06:34:15.179 1 INFO cinder.rpc [req-7a08c731-dab9-4269-85c9-ca6330a76540 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 06:34:15.185 1 INFO cinder.rpc [req-7a08c731-dab9-4269-85c9-ca6330a76540 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 06:34:15.213 1 WARNING oslo_config.cfg [req-7a08c731-dab9-4269-85c9-ca6330a76540 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 06:34:15.217 1 WARNING oslo_config.cfg [req-7a08c731-dab9-4269-85c9-ca6330a76540 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:34:15.218 1 WARNING oslo_config.cfg [req-7a08c731-dab9-4269-85c9-ca6330a76540 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:34:15.219 1 WARNING oslo_config.cfg [req-7a08c731-dab9-4269-85c9-ca6330a76540 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:34:15.230 1 WARNING oslo_config.cfg [req-7a08c731-dab9-4269-85c9-ca6330a76540 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 06:34:15.233 1 WARNING oslo_config.cfg [req-7a08c731-dab9-4269-85c9-ca6330a76540 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 06:34:15.237 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 06:34:15.244 1 INFO cinder.manager [req-cb4f6762-cfdd-443d-a918-5329771236ba - - - - -] Initiating service 5 cleanup
>2018-06-26 06:34:15.251 1 INFO cinder.manager [req-cb4f6762-cfdd-443d-a918-5329771236ba - - - - -] Service 5 cleanup completed.
>2018-06-26 06:36:21.549 1 ERROR oslo.messaging._drivers.impl_rabbit [req-cb4f6762-cfdd-443d-a918-5329771236ba - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:36:21.551 1 ERROR oslo.messaging._drivers.impl_rabbit [req-cb4f6762-cfdd-443d-a918-5329771236ba - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:36:21.551 1 ERROR oslo_service.service [req-cb4f6762-cfdd-443d-a918-5329771236ba - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:36:21.551 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 06:36:21.551 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 06:36:21.551 1 ERROR oslo_service.service     service.start()
>2018-06-26 06:36:21.551 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 06:36:21.551 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 06:36:21.551 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 06:36:21.551 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 06:36:21.551 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 06:36:21.551 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 06:36:21.551 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 06:36:21.551 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 06:36:21.551 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 06:36:21.551 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 06:36:21.551 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 06:36:21.551 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 06:36:21.551 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 06:36:21.551 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 06:36:21.551 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 06:36:21.551 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 06:36:21.551 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 06:36:21.551 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 06:36:21.551 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 06:36:21.551 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 06:36:21.551 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 06:36:21.551 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 06:36:21.551 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:36:21.551 1 ERROR oslo_service.service 
>2018-06-26 06:36:21.554 1 CRITICAL cinder [req-7a08c731-dab9-4269-85c9-ca6330a76540 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 06:36:21.554 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 06:36:21.554 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 06:36:21.554 1 ERROR cinder     sys.exit(main())
>2018-06-26 06:36:21.554 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 06:36:21.554 1 ERROR cinder     service.wait()
>2018-06-26 06:36:21.554 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 06:36:21.554 1 ERROR cinder     _launcher.wait()
>2018-06-26 06:36:21.554 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 06:36:21.554 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 06:36:21.554 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 06:36:21.554 1 ERROR cinder     self.services.wait()
>2018-06-26 06:36:21.554 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 06:36:21.554 1 ERROR cinder     service.wait()
>2018-06-26 06:36:21.554 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 06:36:21.554 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 06:36:21.554 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 06:36:21.554 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 06:36:21.554 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 06:36:21.554 1 ERROR cinder     post_fn = fn()
>2018-06-26 06:36:21.554 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 06:36:21.554 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 06:36:21.554 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 06:36:21.554 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 06:36:21.554 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 06:36:21.554 1 ERROR cinder 
>2018-06-26 06:36:24.219 1 WARNING cinder.scheduler.host_manager [req-fcbe7ed6-ac1c-48c4-8a2e-6ff59bea94e0 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 06:36:24.225 1 INFO cinder.rpc [req-fcbe7ed6-ac1c-48c4-8a2e-6ff59bea94e0 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 06:36:24.233 1 INFO cinder.rpc [req-fcbe7ed6-ac1c-48c4-8a2e-6ff59bea94e0 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 06:36:24.244 1 INFO cinder.rpc [req-fcbe7ed6-ac1c-48c4-8a2e-6ff59bea94e0 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 06:36:24.249 1 INFO cinder.rpc [req-fcbe7ed6-ac1c-48c4-8a2e-6ff59bea94e0 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 06:36:24.272 1 WARNING oslo_config.cfg [req-fcbe7ed6-ac1c-48c4-8a2e-6ff59bea94e0 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 06:36:24.274 1 WARNING oslo_config.cfg [req-fcbe7ed6-ac1c-48c4-8a2e-6ff59bea94e0 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:36:24.275 1 WARNING oslo_config.cfg [req-fcbe7ed6-ac1c-48c4-8a2e-6ff59bea94e0 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:36:24.275 1 WARNING oslo_config.cfg [req-fcbe7ed6-ac1c-48c4-8a2e-6ff59bea94e0 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:36:24.280 1 WARNING oslo_config.cfg [req-fcbe7ed6-ac1c-48c4-8a2e-6ff59bea94e0 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 06:36:24.282 1 WARNING oslo_config.cfg [req-fcbe7ed6-ac1c-48c4-8a2e-6ff59bea94e0 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 06:36:24.284 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 06:36:24.290 1 INFO cinder.manager [req-3f192e10-3419-4346-be28-d0600c27baf0 - - - - -] Initiating service 5 cleanup
>2018-06-26 06:36:24.295 1 INFO cinder.manager [req-3f192e10-3419-4346-be28-d0600c27baf0 - - - - -] Service 5 cleanup completed.
>2018-06-26 06:38:35.950 1 ERROR oslo.messaging._drivers.impl_rabbit [req-3f192e10-3419-4346-be28-d0600c27baf0 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:38:35.952 1 ERROR oslo.messaging._drivers.impl_rabbit [req-3f192e10-3419-4346-be28-d0600c27baf0 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:38:35.952 1 ERROR oslo_service.service [req-3f192e10-3419-4346-be28-d0600c27baf0 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:38:35.952 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 06:38:35.952 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 06:38:35.952 1 ERROR oslo_service.service     service.start()
>2018-06-26 06:38:35.952 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 06:38:35.952 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 06:38:35.952 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 06:38:35.952 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 06:38:35.952 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 06:38:35.952 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 06:38:35.952 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 06:38:35.952 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 06:38:35.952 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 06:38:35.952 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 06:38:35.952 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 06:38:35.952 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 06:38:35.952 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 06:38:35.952 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 06:38:35.952 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 06:38:35.952 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 06:38:35.952 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 06:38:35.952 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 06:38:35.952 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 06:38:35.952 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 06:38:35.952 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 06:38:35.952 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 06:38:35.952 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:38:35.952 1 ERROR oslo_service.service 
>2018-06-26 06:38:35.955 1 CRITICAL cinder [req-fcbe7ed6-ac1c-48c4-8a2e-6ff59bea94e0 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 06:38:35.955 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 06:38:35.955 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 06:38:35.955 1 ERROR cinder     sys.exit(main())
>2018-06-26 06:38:35.955 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 06:38:35.955 1 ERROR cinder     service.wait()
>2018-06-26 06:38:35.955 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 06:38:35.955 1 ERROR cinder     _launcher.wait()
>2018-06-26 06:38:35.955 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 06:38:35.955 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 06:38:35.955 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 06:38:35.955 1 ERROR cinder     self.services.wait()
>2018-06-26 06:38:35.955 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 06:38:35.955 1 ERROR cinder     service.wait()
>2018-06-26 06:38:35.955 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 06:38:35.955 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 06:38:35.955 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 06:38:35.955 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 06:38:35.955 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 06:38:35.955 1 ERROR cinder     post_fn = fn()
>2018-06-26 06:38:35.955 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 06:38:35.955 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 06:38:35.955 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 06:38:35.955 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 06:38:35.955 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 06:38:35.955 1 ERROR cinder 
>2018-06-26 06:38:38.638 1 WARNING cinder.scheduler.host_manager [req-97b2bf00-8080-4a53-82d4-34d4e758032a - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 06:38:38.648 1 INFO cinder.rpc [req-97b2bf00-8080-4a53-82d4-34d4e758032a - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 06:38:38.656 1 INFO cinder.rpc [req-97b2bf00-8080-4a53-82d4-34d4e758032a - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 06:38:38.668 1 INFO cinder.rpc [req-97b2bf00-8080-4a53-82d4-34d4e758032a - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 06:38:38.675 1 INFO cinder.rpc [req-97b2bf00-8080-4a53-82d4-34d4e758032a - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 06:38:38.709 1 WARNING oslo_config.cfg [req-97b2bf00-8080-4a53-82d4-34d4e758032a - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 06:38:38.712 1 WARNING oslo_config.cfg [req-97b2bf00-8080-4a53-82d4-34d4e758032a - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:38:38.712 1 WARNING oslo_config.cfg [req-97b2bf00-8080-4a53-82d4-34d4e758032a - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:38:38.713 1 WARNING oslo_config.cfg [req-97b2bf00-8080-4a53-82d4-34d4e758032a - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:38:38.718 1 WARNING oslo_config.cfg [req-97b2bf00-8080-4a53-82d4-34d4e758032a - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 06:38:38.719 1 WARNING oslo_config.cfg [req-97b2bf00-8080-4a53-82d4-34d4e758032a - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 06:38:38.722 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 06:38:38.731 1 INFO cinder.manager [req-2f8db1f7-9ea0-444a-96e3-1e6c66ab9966 - - - - -] Initiating service 5 cleanup
>2018-06-26 06:38:38.736 1 INFO cinder.manager [req-2f8db1f7-9ea0-444a-96e3-1e6c66ab9966 - - - - -] Service 5 cleanup completed.
>2018-06-26 06:40:51.176 1 ERROR oslo.messaging._drivers.impl_rabbit [req-2f8db1f7-9ea0-444a-96e3-1e6c66ab9966 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:40:51.178 1 ERROR oslo.messaging._drivers.impl_rabbit [req-2f8db1f7-9ea0-444a-96e3-1e6c66ab9966 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:40:51.179 1 ERROR oslo_service.service [req-2f8db1f7-9ea0-444a-96e3-1e6c66ab9966 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:40:51.179 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 06:40:51.179 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 06:40:51.179 1 ERROR oslo_service.service     service.start()
>2018-06-26 06:40:51.179 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 06:40:51.179 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 06:40:51.179 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 06:40:51.179 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 06:40:51.179 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 06:40:51.179 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 06:40:51.179 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 06:40:51.179 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 06:40:51.179 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 06:40:51.179 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 06:40:51.179 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 06:40:51.179 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 06:40:51.179 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 06:40:51.179 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 06:40:51.179 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 06:40:51.179 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 06:40:51.179 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 06:40:51.179 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 06:40:51.179 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 06:40:51.179 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 06:40:51.179 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 06:40:51.179 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 06:40:51.179 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:40:51.179 1 ERROR oslo_service.service 
>2018-06-26 06:40:51.182 1 CRITICAL cinder [req-97b2bf00-8080-4a53-82d4-34d4e758032a - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 06:40:51.182 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 06:40:51.182 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 06:40:51.182 1 ERROR cinder     sys.exit(main())
>2018-06-26 06:40:51.182 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 06:40:51.182 1 ERROR cinder     service.wait()
>2018-06-26 06:40:51.182 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 06:40:51.182 1 ERROR cinder     _launcher.wait()
>2018-06-26 06:40:51.182 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 06:40:51.182 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 06:40:51.182 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 06:40:51.182 1 ERROR cinder     self.services.wait()
>2018-06-26 06:40:51.182 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 06:40:51.182 1 ERROR cinder     service.wait()
>2018-06-26 06:40:51.182 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 06:40:51.182 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 06:40:51.182 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 06:40:51.182 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 06:40:51.182 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 06:40:51.182 1 ERROR cinder     post_fn = fn()
>2018-06-26 06:40:51.182 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 06:40:51.182 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 06:40:51.182 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 06:40:51.182 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 06:40:51.182 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 06:40:51.182 1 ERROR cinder 
>2018-06-26 06:40:53.928 1 WARNING cinder.scheduler.host_manager [req-3ffae93f-76ca-4952-bd19-2ff0ba6cf8e4 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 06:40:53.934 1 INFO cinder.rpc [req-3ffae93f-76ca-4952-bd19-2ff0ba6cf8e4 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 06:40:53.940 1 INFO cinder.rpc [req-3ffae93f-76ca-4952-bd19-2ff0ba6cf8e4 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 06:40:53.951 1 INFO cinder.rpc [req-3ffae93f-76ca-4952-bd19-2ff0ba6cf8e4 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 06:40:53.960 1 INFO cinder.rpc [req-3ffae93f-76ca-4952-bd19-2ff0ba6cf8e4 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 06:40:53.995 1 WARNING oslo_config.cfg [req-3ffae93f-76ca-4952-bd19-2ff0ba6cf8e4 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 06:40:53.998 1 WARNING oslo_config.cfg [req-3ffae93f-76ca-4952-bd19-2ff0ba6cf8e4 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:40:53.999 1 WARNING oslo_config.cfg [req-3ffae93f-76ca-4952-bd19-2ff0ba6cf8e4 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:40:54.000 1 WARNING oslo_config.cfg [req-3ffae93f-76ca-4952-bd19-2ff0ba6cf8e4 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:40:54.008 1 WARNING oslo_config.cfg [req-3ffae93f-76ca-4952-bd19-2ff0ba6cf8e4 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 06:40:54.009 1 WARNING oslo_config.cfg [req-3ffae93f-76ca-4952-bd19-2ff0ba6cf8e4 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 06:40:54.012 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 06:40:54.020 1 INFO cinder.manager [req-15d77628-7474-431b-878c-594da5ad5c43 - - - - -] Initiating service 5 cleanup
>2018-06-26 06:40:54.026 1 INFO cinder.manager [req-15d77628-7474-431b-878c-594da5ad5c43 - - - - -] Service 5 cleanup completed.
>2018-06-26 06:42:58.373 1 ERROR oslo.messaging._drivers.impl_rabbit [req-15d77628-7474-431b-878c-594da5ad5c43 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:42:58.376 1 ERROR oslo.messaging._drivers.impl_rabbit [req-15d77628-7474-431b-878c-594da5ad5c43 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:42:58.376 1 ERROR oslo_service.service [req-15d77628-7474-431b-878c-594da5ad5c43 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:42:58.376 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 06:42:58.376 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 06:42:58.376 1 ERROR oslo_service.service     service.start()
>2018-06-26 06:42:58.376 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 06:42:58.376 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 06:42:58.376 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 06:42:58.376 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 06:42:58.376 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 06:42:58.376 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 06:42:58.376 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 06:42:58.376 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 06:42:58.376 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 06:42:58.376 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 06:42:58.376 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 06:42:58.376 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 06:42:58.376 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 06:42:58.376 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 06:42:58.376 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 06:42:58.376 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 06:42:58.376 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 06:42:58.376 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 06:42:58.376 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 06:42:58.376 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 06:42:58.376 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 06:42:58.376 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 06:42:58.376 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:42:58.376 1 ERROR oslo_service.service 
>2018-06-26 06:42:58.379 1 CRITICAL cinder [req-3ffae93f-76ca-4952-bd19-2ff0ba6cf8e4 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 06:42:58.379 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 06:42:58.379 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 06:42:58.379 1 ERROR cinder     sys.exit(main())
>2018-06-26 06:42:58.379 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 06:42:58.379 1 ERROR cinder     service.wait()
>2018-06-26 06:42:58.379 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 06:42:58.379 1 ERROR cinder     _launcher.wait()
>2018-06-26 06:42:58.379 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 06:42:58.379 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 06:42:58.379 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 06:42:58.379 1 ERROR cinder     self.services.wait()
>2018-06-26 06:42:58.379 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 06:42:58.379 1 ERROR cinder     service.wait()
>2018-06-26 06:42:58.379 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 06:42:58.379 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 06:42:58.379 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 06:42:58.379 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 06:42:58.379 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 06:42:58.379 1 ERROR cinder     post_fn = fn()
>2018-06-26 06:42:58.379 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 06:42:58.379 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 06:42:58.379 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 06:42:58.379 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 06:42:58.379 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 06:42:58.379 1 ERROR cinder 
>2018-06-26 06:43:01.079 1 WARNING cinder.scheduler.host_manager [req-4b391007-dd46-45e1-9e60-023ffb8ef64a - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 06:43:01.085 1 INFO cinder.rpc [req-4b391007-dd46-45e1-9e60-023ffb8ef64a - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 06:43:01.093 1 INFO cinder.rpc [req-4b391007-dd46-45e1-9e60-023ffb8ef64a - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 06:43:01.110 1 INFO cinder.rpc [req-4b391007-dd46-45e1-9e60-023ffb8ef64a - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 06:43:01.117 1 INFO cinder.rpc [req-4b391007-dd46-45e1-9e60-023ffb8ef64a - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 06:43:01.156 1 WARNING oslo_config.cfg [req-4b391007-dd46-45e1-9e60-023ffb8ef64a - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 06:43:01.159 1 WARNING oslo_config.cfg [req-4b391007-dd46-45e1-9e60-023ffb8ef64a - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:43:01.160 1 WARNING oslo_config.cfg [req-4b391007-dd46-45e1-9e60-023ffb8ef64a - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:43:01.162 1 WARNING oslo_config.cfg [req-4b391007-dd46-45e1-9e60-023ffb8ef64a - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:43:01.170 1 WARNING oslo_config.cfg [req-4b391007-dd46-45e1-9e60-023ffb8ef64a - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 06:43:01.171 1 WARNING oslo_config.cfg [req-4b391007-dd46-45e1-9e60-023ffb8ef64a - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 06:43:01.176 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 06:43:01.184 1 INFO cinder.manager [req-67d8c588-4ee0-42c1-aa66-e37af2112e23 - - - - -] Initiating service 5 cleanup
>2018-06-26 06:43:01.191 1 INFO cinder.manager [req-67d8c588-4ee0-42c1-aa66-e37af2112e23 - - - - -] Service 5 cleanup completed.
>2018-06-26 06:45:07.498 1 ERROR oslo.messaging._drivers.impl_rabbit [req-67d8c588-4ee0-42c1-aa66-e37af2112e23 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:45:07.500 1 ERROR oslo.messaging._drivers.impl_rabbit [req-67d8c588-4ee0-42c1-aa66-e37af2112e23 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:45:07.500 1 ERROR oslo_service.service [req-67d8c588-4ee0-42c1-aa66-e37af2112e23 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:45:07.500 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 06:45:07.500 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 06:45:07.500 1 ERROR oslo_service.service     service.start()
>2018-06-26 06:45:07.500 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 06:45:07.500 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 06:45:07.500 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 06:45:07.500 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 06:45:07.500 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 06:45:07.500 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 06:45:07.500 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 06:45:07.500 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 06:45:07.500 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 06:45:07.500 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 06:45:07.500 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 06:45:07.500 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 06:45:07.500 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 06:45:07.500 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 06:45:07.500 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 06:45:07.500 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 06:45:07.500 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 06:45:07.500 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 06:45:07.500 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 06:45:07.500 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 06:45:07.500 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 06:45:07.500 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 06:45:07.500 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:45:07.500 1 ERROR oslo_service.service 
>2018-06-26 06:45:07.503 1 CRITICAL cinder [req-4b391007-dd46-45e1-9e60-023ffb8ef64a - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 06:45:07.503 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 06:45:07.503 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 06:45:07.503 1 ERROR cinder     sys.exit(main())
>2018-06-26 06:45:07.503 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 06:45:07.503 1 ERROR cinder     service.wait()
>2018-06-26 06:45:07.503 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 06:45:07.503 1 ERROR cinder     _launcher.wait()
>2018-06-26 06:45:07.503 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 06:45:07.503 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 06:45:07.503 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 06:45:07.503 1 ERROR cinder     self.services.wait()
>2018-06-26 06:45:07.503 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 06:45:07.503 1 ERROR cinder     service.wait()
>2018-06-26 06:45:07.503 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 06:45:07.503 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 06:45:07.503 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 06:45:07.503 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 06:45:07.503 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 06:45:07.503 1 ERROR cinder     post_fn = fn()
>2018-06-26 06:45:07.503 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 06:45:07.503 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 06:45:07.503 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 06:45:07.503 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 06:45:07.503 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 06:45:07.503 1 ERROR cinder 
>2018-06-26 06:45:10.115 1 WARNING cinder.scheduler.host_manager [req-37be2511-5d11-47c0-b6bb-18070137fb07 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 06:45:10.121 1 INFO cinder.rpc [req-37be2511-5d11-47c0-b6bb-18070137fb07 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 06:45:10.126 1 INFO cinder.rpc [req-37be2511-5d11-47c0-b6bb-18070137fb07 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 06:45:10.139 1 INFO cinder.rpc [req-37be2511-5d11-47c0-b6bb-18070137fb07 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 06:45:10.145 1 INFO cinder.rpc [req-37be2511-5d11-47c0-b6bb-18070137fb07 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 06:45:10.167 1 WARNING oslo_config.cfg [req-37be2511-5d11-47c0-b6bb-18070137fb07 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 06:45:10.170 1 WARNING oslo_config.cfg [req-37be2511-5d11-47c0-b6bb-18070137fb07 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:45:10.170 1 WARNING oslo_config.cfg [req-37be2511-5d11-47c0-b6bb-18070137fb07 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:45:10.171 1 WARNING oslo_config.cfg [req-37be2511-5d11-47c0-b6bb-18070137fb07 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:45:10.175 1 WARNING oslo_config.cfg [req-37be2511-5d11-47c0-b6bb-18070137fb07 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 06:45:10.177 1 WARNING oslo_config.cfg [req-37be2511-5d11-47c0-b6bb-18070137fb07 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 06:45:10.179 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 06:45:10.185 1 INFO cinder.manager [req-e245871c-e543-4b9a-b6c0-f8fcd61310ee - - - - -] Initiating service 5 cleanup
>2018-06-26 06:45:10.189 1 INFO cinder.manager [req-e245871c-e543-4b9a-b6c0-f8fcd61310ee - - - - -] Service 5 cleanup completed.
>2018-06-26 06:47:22.268 1 ERROR oslo.messaging._drivers.impl_rabbit [req-e245871c-e543-4b9a-b6c0-f8fcd61310ee - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:47:22.270 1 ERROR oslo.messaging._drivers.impl_rabbit [req-e245871c-e543-4b9a-b6c0-f8fcd61310ee - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:47:22.270 1 ERROR oslo_service.service [req-e245871c-e543-4b9a-b6c0-f8fcd61310ee - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:47:22.270 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 06:47:22.270 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 06:47:22.270 1 ERROR oslo_service.service     service.start()
>2018-06-26 06:47:22.270 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 06:47:22.270 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 06:47:22.270 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 06:47:22.270 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 06:47:22.270 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 06:47:22.270 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 06:47:22.270 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 06:47:22.270 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 06:47:22.270 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 06:47:22.270 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 06:47:22.270 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 06:47:22.270 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 06:47:22.270 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 06:47:22.270 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 06:47:22.270 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 06:47:22.270 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 06:47:22.270 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 06:47:22.270 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 06:47:22.270 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 06:47:22.270 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 06:47:22.270 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 06:47:22.270 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 06:47:22.270 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:47:22.270 1 ERROR oslo_service.service 
>2018-06-26 06:47:22.273 1 CRITICAL cinder [req-37be2511-5d11-47c0-b6bb-18070137fb07 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 06:47:22.273 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 06:47:22.273 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 06:47:22.273 1 ERROR cinder     sys.exit(main())
>2018-06-26 06:47:22.273 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 06:47:22.273 1 ERROR cinder     service.wait()
>2018-06-26 06:47:22.273 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 06:47:22.273 1 ERROR cinder     _launcher.wait()
>2018-06-26 06:47:22.273 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 06:47:22.273 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 06:47:22.273 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 06:47:22.273 1 ERROR cinder     self.services.wait()
>2018-06-26 06:47:22.273 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 06:47:22.273 1 ERROR cinder     service.wait()
>2018-06-26 06:47:22.273 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 06:47:22.273 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 06:47:22.273 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 06:47:22.273 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 06:47:22.273 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 06:47:22.273 1 ERROR cinder     post_fn = fn()
>2018-06-26 06:47:22.273 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 06:47:22.273 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 06:47:22.273 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 06:47:22.273 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 06:47:22.273 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 06:47:22.273 1 ERROR cinder 
>2018-06-26 06:47:24.857 1 WARNING cinder.scheduler.host_manager [req-de83f4a8-11cd-4333-bb20-a4787781af36 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 06:47:24.862 1 INFO cinder.rpc [req-de83f4a8-11cd-4333-bb20-a4787781af36 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 06:47:24.870 1 INFO cinder.rpc [req-de83f4a8-11cd-4333-bb20-a4787781af36 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 06:47:24.880 1 INFO cinder.rpc [req-de83f4a8-11cd-4333-bb20-a4787781af36 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 06:47:24.886 1 INFO cinder.rpc [req-de83f4a8-11cd-4333-bb20-a4787781af36 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 06:47:24.906 1 WARNING oslo_config.cfg [req-de83f4a8-11cd-4333-bb20-a4787781af36 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 06:47:24.908 1 WARNING oslo_config.cfg [req-de83f4a8-11cd-4333-bb20-a4787781af36 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:47:24.909 1 WARNING oslo_config.cfg [req-de83f4a8-11cd-4333-bb20-a4787781af36 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:47:24.909 1 WARNING oslo_config.cfg [req-de83f4a8-11cd-4333-bb20-a4787781af36 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:47:24.914 1 WARNING oslo_config.cfg [req-de83f4a8-11cd-4333-bb20-a4787781af36 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 06:47:24.915 1 WARNING oslo_config.cfg [req-de83f4a8-11cd-4333-bb20-a4787781af36 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 06:47:24.918 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 06:47:24.924 1 INFO cinder.manager [req-cadc5c49-700e-43d5-a42f-c21b16042d15 - - - - -] Initiating service 5 cleanup
>2018-06-26 06:47:24.929 1 INFO cinder.manager [req-cadc5c49-700e-43d5-a42f-c21b16042d15 - - - - -] Service 5 cleanup completed.
>2018-06-26 06:49:36.365 1 ERROR oslo.messaging._drivers.impl_rabbit [req-cadc5c49-700e-43d5-a42f-c21b16042d15 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:49:36.369 1 ERROR oslo.messaging._drivers.impl_rabbit [req-cadc5c49-700e-43d5-a42f-c21b16042d15 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:49:36.369 1 ERROR oslo_service.service [req-cadc5c49-700e-43d5-a42f-c21b16042d15 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:49:36.369 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 06:49:36.369 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 06:49:36.369 1 ERROR oslo_service.service     service.start()
>2018-06-26 06:49:36.369 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 06:49:36.369 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 06:49:36.369 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 06:49:36.369 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 06:49:36.369 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 06:49:36.369 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 06:49:36.369 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 06:49:36.369 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 06:49:36.369 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 06:49:36.369 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 06:49:36.369 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 06:49:36.369 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 06:49:36.369 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 06:49:36.369 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 06:49:36.369 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 06:49:36.369 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 06:49:36.369 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 06:49:36.369 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 06:49:36.369 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 06:49:36.369 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 06:49:36.369 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 06:49:36.369 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 06:49:36.369 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:49:36.369 1 ERROR oslo_service.service 
>2018-06-26 06:49:36.373 1 CRITICAL cinder [req-de83f4a8-11cd-4333-bb20-a4787781af36 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 06:49:36.373 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 06:49:36.373 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 06:49:36.373 1 ERROR cinder     sys.exit(main())
>2018-06-26 06:49:36.373 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 06:49:36.373 1 ERROR cinder     service.wait()
>2018-06-26 06:49:36.373 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 06:49:36.373 1 ERROR cinder     _launcher.wait()
>2018-06-26 06:49:36.373 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 06:49:36.373 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 06:49:36.373 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 06:49:36.373 1 ERROR cinder     self.services.wait()
>2018-06-26 06:49:36.373 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 06:49:36.373 1 ERROR cinder     service.wait()
>2018-06-26 06:49:36.373 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 06:49:36.373 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 06:49:36.373 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 06:49:36.373 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 06:49:36.373 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 06:49:36.373 1 ERROR cinder     post_fn = fn()
>2018-06-26 06:49:36.373 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 06:49:36.373 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 06:49:36.373 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 06:49:36.373 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 06:49:36.373 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 06:49:36.373 1 ERROR cinder 
>2018-06-26 06:49:38.916 1 WARNING cinder.scheduler.host_manager [req-ee8f2aaf-6359-4553-ba85-fd51d2353c11 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 06:49:38.922 1 INFO cinder.rpc [req-ee8f2aaf-6359-4553-ba85-fd51d2353c11 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 06:49:38.927 1 INFO cinder.rpc [req-ee8f2aaf-6359-4553-ba85-fd51d2353c11 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 06:49:38.947 1 INFO cinder.rpc [req-ee8f2aaf-6359-4553-ba85-fd51d2353c11 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 06:49:38.954 1 INFO cinder.rpc [req-ee8f2aaf-6359-4553-ba85-fd51d2353c11 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 06:49:38.978 1 WARNING oslo_config.cfg [req-ee8f2aaf-6359-4553-ba85-fd51d2353c11 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 06:49:38.980 1 WARNING oslo_config.cfg [req-ee8f2aaf-6359-4553-ba85-fd51d2353c11 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:49:38.981 1 WARNING oslo_config.cfg [req-ee8f2aaf-6359-4553-ba85-fd51d2353c11 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:49:38.982 1 WARNING oslo_config.cfg [req-ee8f2aaf-6359-4553-ba85-fd51d2353c11 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:49:38.986 1 WARNING oslo_config.cfg [req-ee8f2aaf-6359-4553-ba85-fd51d2353c11 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 06:49:38.988 1 WARNING oslo_config.cfg [req-ee8f2aaf-6359-4553-ba85-fd51d2353c11 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 06:49:38.990 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 06:49:38.997 1 INFO cinder.manager [req-667b90a3-691b-4500-bdd2-def158832434 - - - - -] Initiating service 5 cleanup
>2018-06-26 06:49:39.004 1 INFO cinder.manager [req-667b90a3-691b-4500-bdd2-def158832434 - - - - -] Service 5 cleanup completed.
>2018-06-26 06:51:45.069 1 ERROR oslo.messaging._drivers.impl_rabbit [req-667b90a3-691b-4500-bdd2-def158832434 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:51:45.072 1 ERROR oslo.messaging._drivers.impl_rabbit [req-667b90a3-691b-4500-bdd2-def158832434 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:51:45.073 1 ERROR oslo_service.service [req-667b90a3-691b-4500-bdd2-def158832434 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:51:45.073 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 06:51:45.073 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 06:51:45.073 1 ERROR oslo_service.service     service.start()
>2018-06-26 06:51:45.073 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 06:51:45.073 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 06:51:45.073 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 06:51:45.073 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 06:51:45.073 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 06:51:45.073 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 06:51:45.073 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 06:51:45.073 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 06:51:45.073 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 06:51:45.073 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 06:51:45.073 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 06:51:45.073 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 06:51:45.073 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 06:51:45.073 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 06:51:45.073 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 06:51:45.073 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 06:51:45.073 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 06:51:45.073 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 06:51:45.073 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 06:51:45.073 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 06:51:45.073 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 06:51:45.073 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 06:51:45.073 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:51:45.073 1 ERROR oslo_service.service 
>2018-06-26 06:51:45.078 1 CRITICAL cinder [req-ee8f2aaf-6359-4553-ba85-fd51d2353c11 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 06:51:45.078 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 06:51:45.078 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 06:51:45.078 1 ERROR cinder     sys.exit(main())
>2018-06-26 06:51:45.078 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 06:51:45.078 1 ERROR cinder     service.wait()
>2018-06-26 06:51:45.078 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 06:51:45.078 1 ERROR cinder     _launcher.wait()
>2018-06-26 06:51:45.078 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 06:51:45.078 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 06:51:45.078 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 06:51:45.078 1 ERROR cinder     self.services.wait()
>2018-06-26 06:51:45.078 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 06:51:45.078 1 ERROR cinder     service.wait()
>2018-06-26 06:51:45.078 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 06:51:45.078 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 06:51:45.078 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 06:51:45.078 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 06:51:45.078 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 06:51:45.078 1 ERROR cinder     post_fn = fn()
>2018-06-26 06:51:45.078 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 06:51:45.078 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 06:51:45.078 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 06:51:45.078 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 06:51:45.078 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 06:51:45.078 1 ERROR cinder 
>2018-06-26 06:51:47.792 1 WARNING cinder.scheduler.host_manager [req-16ffbd24-7557-4cea-95a5-476a1999c206 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 06:51:47.797 1 INFO cinder.rpc [req-16ffbd24-7557-4cea-95a5-476a1999c206 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 06:51:47.803 1 INFO cinder.rpc [req-16ffbd24-7557-4cea-95a5-476a1999c206 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 06:51:47.814 1 INFO cinder.rpc [req-16ffbd24-7557-4cea-95a5-476a1999c206 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 06:51:47.821 1 INFO cinder.rpc [req-16ffbd24-7557-4cea-95a5-476a1999c206 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 06:51:47.845 1 WARNING oslo_config.cfg [req-16ffbd24-7557-4cea-95a5-476a1999c206 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 06:51:47.847 1 WARNING oslo_config.cfg [req-16ffbd24-7557-4cea-95a5-476a1999c206 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:51:47.848 1 WARNING oslo_config.cfg [req-16ffbd24-7557-4cea-95a5-476a1999c206 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:51:47.848 1 WARNING oslo_config.cfg [req-16ffbd24-7557-4cea-95a5-476a1999c206 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:51:47.853 1 WARNING oslo_config.cfg [req-16ffbd24-7557-4cea-95a5-476a1999c206 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 06:51:47.855 1 WARNING oslo_config.cfg [req-16ffbd24-7557-4cea-95a5-476a1999c206 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 06:51:47.857 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 06:51:47.862 1 INFO cinder.manager [req-037e1364-0cdb-430b-94a6-2a597fc02ba4 - - - - -] Initiating service 5 cleanup
>2018-06-26 06:51:47.868 1 INFO cinder.manager [req-037e1364-0cdb-430b-94a6-2a597fc02ba4 - - - - -] Service 5 cleanup completed.
>2018-06-26 06:53:54.054 1 ERROR oslo.messaging._drivers.impl_rabbit [req-037e1364-0cdb-430b-94a6-2a597fc02ba4 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:53:54.056 1 ERROR oslo.messaging._drivers.impl_rabbit [req-037e1364-0cdb-430b-94a6-2a597fc02ba4 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:53:54.057 1 ERROR oslo_service.service [req-037e1364-0cdb-430b-94a6-2a597fc02ba4 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:53:54.057 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 06:53:54.057 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 06:53:54.057 1 ERROR oslo_service.service     service.start()
>2018-06-26 06:53:54.057 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 06:53:54.057 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 06:53:54.057 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 06:53:54.057 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 06:53:54.057 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 06:53:54.057 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 06:53:54.057 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 06:53:54.057 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 06:53:54.057 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 06:53:54.057 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 06:53:54.057 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 06:53:54.057 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 06:53:54.057 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 06:53:54.057 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 06:53:54.057 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 06:53:54.057 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 06:53:54.057 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 06:53:54.057 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 06:53:54.057 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 06:53:54.057 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 06:53:54.057 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 06:53:54.057 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 06:53:54.057 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:53:54.057 1 ERROR oslo_service.service 
>2018-06-26 06:53:54.060 1 CRITICAL cinder [req-16ffbd24-7557-4cea-95a5-476a1999c206 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 06:53:54.060 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 06:53:54.060 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 06:53:54.060 1 ERROR cinder     sys.exit(main())
>2018-06-26 06:53:54.060 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 06:53:54.060 1 ERROR cinder     service.wait()
>2018-06-26 06:53:54.060 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 06:53:54.060 1 ERROR cinder     _launcher.wait()
>2018-06-26 06:53:54.060 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 06:53:54.060 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 06:53:54.060 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 06:53:54.060 1 ERROR cinder     self.services.wait()
>2018-06-26 06:53:54.060 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 06:53:54.060 1 ERROR cinder     service.wait()
>2018-06-26 06:53:54.060 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 06:53:54.060 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 06:53:54.060 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 06:53:54.060 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 06:53:54.060 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 06:53:54.060 1 ERROR cinder     post_fn = fn()
>2018-06-26 06:53:54.060 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 06:53:54.060 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 06:53:54.060 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 06:53:54.060 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 06:53:54.060 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 06:53:54.060 1 ERROR cinder 
>2018-06-26 06:53:56.754 1 WARNING cinder.scheduler.host_manager [req-0594f7ec-e573-43f5-961a-9e6dc4e8aa5d - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 06:53:56.760 1 INFO cinder.rpc [req-0594f7ec-e573-43f5-961a-9e6dc4e8aa5d - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 06:53:56.766 1 INFO cinder.rpc [req-0594f7ec-e573-43f5-961a-9e6dc4e8aa5d - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 06:53:56.776 1 INFO cinder.rpc [req-0594f7ec-e573-43f5-961a-9e6dc4e8aa5d - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 06:53:56.785 1 INFO cinder.rpc [req-0594f7ec-e573-43f5-961a-9e6dc4e8aa5d - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 06:53:56.817 1 WARNING oslo_config.cfg [req-0594f7ec-e573-43f5-961a-9e6dc4e8aa5d - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 06:53:56.819 1 WARNING oslo_config.cfg [req-0594f7ec-e573-43f5-961a-9e6dc4e8aa5d - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:53:56.819 1 WARNING oslo_config.cfg [req-0594f7ec-e573-43f5-961a-9e6dc4e8aa5d - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:53:56.820 1 WARNING oslo_config.cfg [req-0594f7ec-e573-43f5-961a-9e6dc4e8aa5d - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:53:56.825 1 WARNING oslo_config.cfg [req-0594f7ec-e573-43f5-961a-9e6dc4e8aa5d - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 06:53:56.827 1 WARNING oslo_config.cfg [req-0594f7ec-e573-43f5-961a-9e6dc4e8aa5d - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 06:53:56.829 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 06:53:56.835 1 INFO cinder.manager [req-b395d864-47da-422f-bb95-73c91b3b6207 - - - - -] Initiating service 5 cleanup
>2018-06-26 06:53:56.840 1 INFO cinder.manager [req-b395d864-47da-422f-bb95-73c91b3b6207 - - - - -] Service 5 cleanup completed.
>2018-06-26 06:56:09.155 1 ERROR oslo.messaging._drivers.impl_rabbit [req-b395d864-47da-422f-bb95-73c91b3b6207 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:56:09.157 1 ERROR oslo.messaging._drivers.impl_rabbit [req-b395d864-47da-422f-bb95-73c91b3b6207 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:56:09.157 1 ERROR oslo_service.service [req-b395d864-47da-422f-bb95-73c91b3b6207 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:56:09.157 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 06:56:09.157 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 06:56:09.157 1 ERROR oslo_service.service     service.start()
>2018-06-26 06:56:09.157 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 06:56:09.157 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 06:56:09.157 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 06:56:09.157 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 06:56:09.157 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 06:56:09.157 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 06:56:09.157 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 06:56:09.157 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 06:56:09.157 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 06:56:09.157 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 06:56:09.157 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 06:56:09.157 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 06:56:09.157 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 06:56:09.157 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 06:56:09.157 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 06:56:09.157 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 06:56:09.157 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 06:56:09.157 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 06:56:09.157 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 06:56:09.157 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 06:56:09.157 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 06:56:09.157 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 06:56:09.157 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:56:09.157 1 ERROR oslo_service.service 
>2018-06-26 06:56:09.160 1 CRITICAL cinder [req-0594f7ec-e573-43f5-961a-9e6dc4e8aa5d - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 06:56:09.160 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 06:56:09.160 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 06:56:09.160 1 ERROR cinder     sys.exit(main())
>2018-06-26 06:56:09.160 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 06:56:09.160 1 ERROR cinder     service.wait()
>2018-06-26 06:56:09.160 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 06:56:09.160 1 ERROR cinder     _launcher.wait()
>2018-06-26 06:56:09.160 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 06:56:09.160 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 06:56:09.160 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 06:56:09.160 1 ERROR cinder     self.services.wait()
>2018-06-26 06:56:09.160 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 06:56:09.160 1 ERROR cinder     service.wait()
>2018-06-26 06:56:09.160 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 06:56:09.160 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 06:56:09.160 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 06:56:09.160 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 06:56:09.160 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 06:56:09.160 1 ERROR cinder     post_fn = fn()
>2018-06-26 06:56:09.160 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 06:56:09.160 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 06:56:09.160 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 06:56:09.160 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 06:56:09.160 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 06:56:09.160 1 ERROR cinder 
>2018-06-26 06:56:11.754 1 WARNING cinder.scheduler.host_manager [req-c4952919-9ba9-4838-84b7-22b7b6a16911 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 06:56:11.760 1 INFO cinder.rpc [req-c4952919-9ba9-4838-84b7-22b7b6a16911 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 06:56:11.767 1 INFO cinder.rpc [req-c4952919-9ba9-4838-84b7-22b7b6a16911 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 06:56:11.797 1 INFO cinder.rpc [req-c4952919-9ba9-4838-84b7-22b7b6a16911 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 06:56:11.803 1 INFO cinder.rpc [req-c4952919-9ba9-4838-84b7-22b7b6a16911 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 06:56:11.865 1 WARNING oslo_config.cfg [req-c4952919-9ba9-4838-84b7-22b7b6a16911 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 06:56:11.868 1 WARNING oslo_config.cfg [req-c4952919-9ba9-4838-84b7-22b7b6a16911 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:56:11.868 1 WARNING oslo_config.cfg [req-c4952919-9ba9-4838-84b7-22b7b6a16911 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:56:11.869 1 WARNING oslo_config.cfg [req-c4952919-9ba9-4838-84b7-22b7b6a16911 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:56:11.874 1 WARNING oslo_config.cfg [req-c4952919-9ba9-4838-84b7-22b7b6a16911 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 06:56:11.876 1 WARNING oslo_config.cfg [req-c4952919-9ba9-4838-84b7-22b7b6a16911 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 06:56:11.879 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 06:56:11.887 1 INFO cinder.manager [req-dd4a9147-8b43-41fa-8897-b551c1ee1a81 - - - - -] Initiating service 5 cleanup
>2018-06-26 06:56:11.892 1 INFO cinder.manager [req-dd4a9147-8b43-41fa-8897-b551c1ee1a81 - - - - -] Service 5 cleanup completed.
>2018-06-26 06:58:24.419 1 ERROR oslo.messaging._drivers.impl_rabbit [req-dd4a9147-8b43-41fa-8897-b551c1ee1a81 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:58:24.421 1 ERROR oslo.messaging._drivers.impl_rabbit [req-dd4a9147-8b43-41fa-8897-b551c1ee1a81 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:58:24.421 1 ERROR oslo_service.service [req-dd4a9147-8b43-41fa-8897-b551c1ee1a81 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:58:24.421 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 06:58:24.421 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 06:58:24.421 1 ERROR oslo_service.service     service.start()
>2018-06-26 06:58:24.421 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 06:58:24.421 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 06:58:24.421 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 06:58:24.421 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 06:58:24.421 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 06:58:24.421 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 06:58:24.421 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 06:58:24.421 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 06:58:24.421 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 06:58:24.421 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 06:58:24.421 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 06:58:24.421 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 06:58:24.421 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 06:58:24.421 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 06:58:24.421 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 06:58:24.421 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 06:58:24.421 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 06:58:24.421 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 06:58:24.421 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 06:58:24.421 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 06:58:24.421 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 06:58:24.421 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 06:58:24.421 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 06:58:24.421 1 ERROR oslo_service.service 
>2018-06-26 06:58:24.424 1 CRITICAL cinder [req-c4952919-9ba9-4838-84b7-22b7b6a16911 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 06:58:24.424 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 06:58:24.424 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 06:58:24.424 1 ERROR cinder     sys.exit(main())
>2018-06-26 06:58:24.424 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 06:58:24.424 1 ERROR cinder     service.wait()
>2018-06-26 06:58:24.424 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 06:58:24.424 1 ERROR cinder     _launcher.wait()
>2018-06-26 06:58:24.424 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 06:58:24.424 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 06:58:24.424 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 06:58:24.424 1 ERROR cinder     self.services.wait()
>2018-06-26 06:58:24.424 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 06:58:24.424 1 ERROR cinder     service.wait()
>2018-06-26 06:58:24.424 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 06:58:24.424 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 06:58:24.424 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 06:58:24.424 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 06:58:24.424 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 06:58:24.424 1 ERROR cinder     post_fn = fn()
>2018-06-26 06:58:24.424 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 06:58:24.424 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 06:58:24.424 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 06:58:24.424 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 06:58:24.424 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 06:58:24.424 1 ERROR cinder 
>2018-06-26 06:58:26.989 1 WARNING cinder.scheduler.host_manager [req-f3ef988f-2fd9-44f6-9182-929dcf16285b - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 06:58:26.994 1 INFO cinder.rpc [req-f3ef988f-2fd9-44f6-9182-929dcf16285b - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 06:58:26.999 1 INFO cinder.rpc [req-f3ef988f-2fd9-44f6-9182-929dcf16285b - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 06:58:27.014 1 INFO cinder.rpc [req-f3ef988f-2fd9-44f6-9182-929dcf16285b - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 06:58:27.019 1 INFO cinder.rpc [req-f3ef988f-2fd9-44f6-9182-929dcf16285b - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 06:58:27.039 1 WARNING oslo_config.cfg [req-f3ef988f-2fd9-44f6-9182-929dcf16285b - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 06:58:27.041 1 WARNING oslo_config.cfg [req-f3ef988f-2fd9-44f6-9182-929dcf16285b - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:58:27.041 1 WARNING oslo_config.cfg [req-f3ef988f-2fd9-44f6-9182-929dcf16285b - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:58:27.042 1 WARNING oslo_config.cfg [req-f3ef988f-2fd9-44f6-9182-929dcf16285b - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 06:58:27.047 1 WARNING oslo_config.cfg [req-f3ef988f-2fd9-44f6-9182-929dcf16285b - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 06:58:27.049 1 WARNING oslo_config.cfg [req-f3ef988f-2fd9-44f6-9182-929dcf16285b - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 06:58:27.051 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 06:58:27.061 1 INFO cinder.manager [req-c9d80d75-e3d3-4628-ad78-e450d4af1093 - - - - -] Initiating service 5 cleanup
>2018-06-26 06:58:27.066 1 INFO cinder.manager [req-c9d80d75-e3d3-4628-ad78-e450d4af1093 - - - - -] Service 5 cleanup completed.
>2018-06-26 07:00:33.134 1 ERROR oslo.messaging._drivers.impl_rabbit [req-c9d80d75-e3d3-4628-ad78-e450d4af1093 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:00:33.136 1 ERROR oslo.messaging._drivers.impl_rabbit [req-c9d80d75-e3d3-4628-ad78-e450d4af1093 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:00:33.137 1 ERROR oslo_service.service [req-c9d80d75-e3d3-4628-ad78-e450d4af1093 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:00:33.137 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 07:00:33.137 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 07:00:33.137 1 ERROR oslo_service.service     service.start()
>2018-06-26 07:00:33.137 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 07:00:33.137 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 07:00:33.137 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 07:00:33.137 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 07:00:33.137 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 07:00:33.137 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 07:00:33.137 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 07:00:33.137 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 07:00:33.137 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 07:00:33.137 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 07:00:33.137 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 07:00:33.137 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 07:00:33.137 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 07:00:33.137 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 07:00:33.137 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 07:00:33.137 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 07:00:33.137 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 07:00:33.137 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 07:00:33.137 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 07:00:33.137 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 07:00:33.137 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 07:00:33.137 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 07:00:33.137 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:00:33.137 1 ERROR oslo_service.service 
>2018-06-26 07:00:33.140 1 CRITICAL cinder [req-f3ef988f-2fd9-44f6-9182-929dcf16285b - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 07:00:33.140 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 07:00:33.140 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 07:00:33.140 1 ERROR cinder     sys.exit(main())
>2018-06-26 07:00:33.140 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 07:00:33.140 1 ERROR cinder     service.wait()
>2018-06-26 07:00:33.140 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 07:00:33.140 1 ERROR cinder     _launcher.wait()
>2018-06-26 07:00:33.140 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 07:00:33.140 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 07:00:33.140 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 07:00:33.140 1 ERROR cinder     self.services.wait()
>2018-06-26 07:00:33.140 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 07:00:33.140 1 ERROR cinder     service.wait()
>2018-06-26 07:00:33.140 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 07:00:33.140 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 07:00:33.140 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 07:00:33.140 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 07:00:33.140 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 07:00:33.140 1 ERROR cinder     post_fn = fn()
>2018-06-26 07:00:33.140 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 07:00:33.140 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 07:00:33.140 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 07:00:33.140 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 07:00:33.140 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 07:00:33.140 1 ERROR cinder 
>2018-06-26 07:00:35.769 1 WARNING cinder.scheduler.host_manager [req-4ef68acc-b695-436a-b825-0706cc77bad5 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 07:00:35.777 1 INFO cinder.rpc [req-4ef68acc-b695-436a-b825-0706cc77bad5 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 07:00:35.783 1 INFO cinder.rpc [req-4ef68acc-b695-436a-b825-0706cc77bad5 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 07:00:35.800 1 INFO cinder.rpc [req-4ef68acc-b695-436a-b825-0706cc77bad5 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 07:00:35.805 1 INFO cinder.rpc [req-4ef68acc-b695-436a-b825-0706cc77bad5 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 07:00:35.829 1 WARNING oslo_config.cfg [req-4ef68acc-b695-436a-b825-0706cc77bad5 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 07:00:35.831 1 WARNING oslo_config.cfg [req-4ef68acc-b695-436a-b825-0706cc77bad5 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:00:35.832 1 WARNING oslo_config.cfg [req-4ef68acc-b695-436a-b825-0706cc77bad5 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:00:35.832 1 WARNING oslo_config.cfg [req-4ef68acc-b695-436a-b825-0706cc77bad5 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:00:35.838 1 WARNING oslo_config.cfg [req-4ef68acc-b695-436a-b825-0706cc77bad5 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 07:00:35.839 1 WARNING oslo_config.cfg [req-4ef68acc-b695-436a-b825-0706cc77bad5 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 07:00:35.841 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 07:00:35.848 1 INFO cinder.manager [req-b8aae1fc-3ea2-4a1b-8002-8522ed3aa164 - - - - -] Initiating service 5 cleanup
>2018-06-26 07:00:35.852 1 INFO cinder.manager [req-b8aae1fc-3ea2-4a1b-8002-8522ed3aa164 - - - - -] Service 5 cleanup completed.
>2018-06-26 07:02:40.296 1 ERROR oslo.messaging._drivers.impl_rabbit [req-b8aae1fc-3ea2-4a1b-8002-8522ed3aa164 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:02:40.298 1 ERROR oslo.messaging._drivers.impl_rabbit [req-b8aae1fc-3ea2-4a1b-8002-8522ed3aa164 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:02:40.298 1 ERROR oslo_service.service [req-b8aae1fc-3ea2-4a1b-8002-8522ed3aa164 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:02:40.298 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 07:02:40.298 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 07:02:40.298 1 ERROR oslo_service.service     service.start()
>2018-06-26 07:02:40.298 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 07:02:40.298 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 07:02:40.298 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 07:02:40.298 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 07:02:40.298 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 07:02:40.298 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 07:02:40.298 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 07:02:40.298 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 07:02:40.298 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 07:02:40.298 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 07:02:40.298 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 07:02:40.298 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 07:02:40.298 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 07:02:40.298 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 07:02:40.298 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 07:02:40.298 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 07:02:40.298 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 07:02:40.298 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 07:02:40.298 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 07:02:40.298 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 07:02:40.298 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 07:02:40.298 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 07:02:40.298 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:02:40.298 1 ERROR oslo_service.service 
>2018-06-26 07:02:40.301 1 CRITICAL cinder [req-4ef68acc-b695-436a-b825-0706cc77bad5 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 07:02:40.301 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 07:02:40.301 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 07:02:40.301 1 ERROR cinder     sys.exit(main())
>2018-06-26 07:02:40.301 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 07:02:40.301 1 ERROR cinder     service.wait()
>2018-06-26 07:02:40.301 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 07:02:40.301 1 ERROR cinder     _launcher.wait()
>2018-06-26 07:02:40.301 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 07:02:40.301 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 07:02:40.301 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 07:02:40.301 1 ERROR cinder     self.services.wait()
>2018-06-26 07:02:40.301 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 07:02:40.301 1 ERROR cinder     service.wait()
>2018-06-26 07:02:40.301 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 07:02:40.301 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 07:02:40.301 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 07:02:40.301 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 07:02:40.301 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 07:02:40.301 1 ERROR cinder     post_fn = fn()
>2018-06-26 07:02:40.301 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 07:02:40.301 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 07:02:40.301 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 07:02:40.301 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 07:02:40.301 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 07:02:40.301 1 ERROR cinder 
>2018-06-26 07:02:43.024 1 WARNING cinder.scheduler.host_manager [req-69aaaf65-dde5-4b3f-93f2-5242718bff06 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 07:02:43.030 1 INFO cinder.rpc [req-69aaaf65-dde5-4b3f-93f2-5242718bff06 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 07:02:43.037 1 INFO cinder.rpc [req-69aaaf65-dde5-4b3f-93f2-5242718bff06 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 07:02:43.054 1 INFO cinder.rpc [req-69aaaf65-dde5-4b3f-93f2-5242718bff06 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 07:02:43.064 1 INFO cinder.rpc [req-69aaaf65-dde5-4b3f-93f2-5242718bff06 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 07:02:43.121 1 WARNING oslo_config.cfg [req-69aaaf65-dde5-4b3f-93f2-5242718bff06 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 07:02:43.124 1 WARNING oslo_config.cfg [req-69aaaf65-dde5-4b3f-93f2-5242718bff06 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:02:43.125 1 WARNING oslo_config.cfg [req-69aaaf65-dde5-4b3f-93f2-5242718bff06 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:02:43.125 1 WARNING oslo_config.cfg [req-69aaaf65-dde5-4b3f-93f2-5242718bff06 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:02:43.131 1 WARNING oslo_config.cfg [req-69aaaf65-dde5-4b3f-93f2-5242718bff06 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 07:02:43.133 1 WARNING oslo_config.cfg [req-69aaaf65-dde5-4b3f-93f2-5242718bff06 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 07:02:43.138 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 07:02:43.148 1 INFO cinder.manager [req-665fb7a1-38e8-4165-96c3-a16e5b00ddb9 - - - - -] Initiating service 5 cleanup
>2018-06-26 07:02:43.154 1 INFO cinder.manager [req-665fb7a1-38e8-4165-96c3-a16e5b00ddb9 - - - - -] Service 5 cleanup completed.
>2018-06-26 07:04:47.594 1 ERROR oslo.messaging._drivers.impl_rabbit [req-665fb7a1-38e8-4165-96c3-a16e5b00ddb9 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:04:47.596 1 ERROR oslo.messaging._drivers.impl_rabbit [req-665fb7a1-38e8-4165-96c3-a16e5b00ddb9 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:04:47.596 1 ERROR oslo_service.service [req-665fb7a1-38e8-4165-96c3-a16e5b00ddb9 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:04:47.596 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 07:04:47.596 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 07:04:47.596 1 ERROR oslo_service.service     service.start()
>2018-06-26 07:04:47.596 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 07:04:47.596 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 07:04:47.596 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 07:04:47.596 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 07:04:47.596 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 07:04:47.596 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 07:04:47.596 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 07:04:47.596 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 07:04:47.596 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 07:04:47.596 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 07:04:47.596 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 07:04:47.596 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 07:04:47.596 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 07:04:47.596 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 07:04:47.596 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 07:04:47.596 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 07:04:47.596 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 07:04:47.596 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 07:04:47.596 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 07:04:47.596 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 07:04:47.596 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 07:04:47.596 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 07:04:47.596 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:04:47.596 1 ERROR oslo_service.service 
>2018-06-26 07:04:47.599 1 CRITICAL cinder [req-69aaaf65-dde5-4b3f-93f2-5242718bff06 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 07:04:47.599 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 07:04:47.599 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 07:04:47.599 1 ERROR cinder     sys.exit(main())
>2018-06-26 07:04:47.599 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 07:04:47.599 1 ERROR cinder     service.wait()
>2018-06-26 07:04:47.599 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 07:04:47.599 1 ERROR cinder     _launcher.wait()
>2018-06-26 07:04:47.599 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 07:04:47.599 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 07:04:47.599 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 07:04:47.599 1 ERROR cinder     self.services.wait()
>2018-06-26 07:04:47.599 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 07:04:47.599 1 ERROR cinder     service.wait()
>2018-06-26 07:04:47.599 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 07:04:47.599 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 07:04:47.599 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 07:04:47.599 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 07:04:47.599 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 07:04:47.599 1 ERROR cinder     post_fn = fn()
>2018-06-26 07:04:47.599 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 07:04:47.599 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 07:04:47.599 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 07:04:47.599 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 07:04:47.599 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 07:04:47.599 1 ERROR cinder 
>2018-06-26 07:04:50.214 1 WARNING cinder.scheduler.host_manager [req-251769b7-6dcf-4436-b544-cb7d73ae61c6 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 07:04:50.220 1 INFO cinder.rpc [req-251769b7-6dcf-4436-b544-cb7d73ae61c6 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 07:04:50.225 1 INFO cinder.rpc [req-251769b7-6dcf-4436-b544-cb7d73ae61c6 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 07:04:50.237 1 INFO cinder.rpc [req-251769b7-6dcf-4436-b544-cb7d73ae61c6 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 07:04:50.242 1 INFO cinder.rpc [req-251769b7-6dcf-4436-b544-cb7d73ae61c6 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 07:04:50.267 1 WARNING oslo_config.cfg [req-251769b7-6dcf-4436-b544-cb7d73ae61c6 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 07:04:50.269 1 WARNING oslo_config.cfg [req-251769b7-6dcf-4436-b544-cb7d73ae61c6 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:04:50.269 1 WARNING oslo_config.cfg [req-251769b7-6dcf-4436-b544-cb7d73ae61c6 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:04:50.270 1 WARNING oslo_config.cfg [req-251769b7-6dcf-4436-b544-cb7d73ae61c6 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:04:50.275 1 WARNING oslo_config.cfg [req-251769b7-6dcf-4436-b544-cb7d73ae61c6 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 07:04:50.276 1 WARNING oslo_config.cfg [req-251769b7-6dcf-4436-b544-cb7d73ae61c6 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 07:04:50.278 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 07:04:50.284 1 INFO cinder.manager [req-24b43777-cb33-4fe6-b86c-9183c3b52dba - - - - -] Initiating service 5 cleanup
>2018-06-26 07:04:50.289 1 INFO cinder.manager [req-24b43777-cb33-4fe6-b86c-9183c3b52dba - - - - -] Service 5 cleanup completed.
>2018-06-26 07:07:02.586 1 ERROR oslo.messaging._drivers.impl_rabbit [req-24b43777-cb33-4fe6-b86c-9183c3b52dba - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:07:02.588 1 ERROR oslo.messaging._drivers.impl_rabbit [req-24b43777-cb33-4fe6-b86c-9183c3b52dba - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:07:02.588 1 ERROR oslo_service.service [req-24b43777-cb33-4fe6-b86c-9183c3b52dba - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:07:02.588 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 07:07:02.588 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 07:07:02.588 1 ERROR oslo_service.service     service.start()
>2018-06-26 07:07:02.588 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 07:07:02.588 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 07:07:02.588 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 07:07:02.588 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 07:07:02.588 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 07:07:02.588 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 07:07:02.588 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 07:07:02.588 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 07:07:02.588 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 07:07:02.588 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 07:07:02.588 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 07:07:02.588 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 07:07:02.588 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 07:07:02.588 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 07:07:02.588 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 07:07:02.588 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 07:07:02.588 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 07:07:02.588 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 07:07:02.588 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 07:07:02.588 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 07:07:02.588 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 07:07:02.588 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 07:07:02.588 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:07:02.588 1 ERROR oslo_service.service 
>2018-06-26 07:07:02.591 1 CRITICAL cinder [req-251769b7-6dcf-4436-b544-cb7d73ae61c6 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 07:07:02.591 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 07:07:02.591 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 07:07:02.591 1 ERROR cinder     sys.exit(main())
>2018-06-26 07:07:02.591 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 07:07:02.591 1 ERROR cinder     service.wait()
>2018-06-26 07:07:02.591 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 07:07:02.591 1 ERROR cinder     _launcher.wait()
>2018-06-26 07:07:02.591 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 07:07:02.591 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 07:07:02.591 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 07:07:02.591 1 ERROR cinder     self.services.wait()
>2018-06-26 07:07:02.591 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 07:07:02.591 1 ERROR cinder     service.wait()
>2018-06-26 07:07:02.591 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 07:07:02.591 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 07:07:02.591 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 07:07:02.591 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 07:07:02.591 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 07:07:02.591 1 ERROR cinder     post_fn = fn()
>2018-06-26 07:07:02.591 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 07:07:02.591 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 07:07:02.591 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 07:07:02.591 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 07:07:02.591 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 07:07:02.591 1 ERROR cinder 
>2018-06-26 07:07:05.238 1 WARNING cinder.scheduler.host_manager [req-444fdfef-d017-479d-a3f9-6f2ded5eec28 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 07:07:05.243 1 INFO cinder.rpc [req-444fdfef-d017-479d-a3f9-6f2ded5eec28 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 07:07:05.249 1 INFO cinder.rpc [req-444fdfef-d017-479d-a3f9-6f2ded5eec28 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 07:07:05.263 1 INFO cinder.rpc [req-444fdfef-d017-479d-a3f9-6f2ded5eec28 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 07:07:05.269 1 INFO cinder.rpc [req-444fdfef-d017-479d-a3f9-6f2ded5eec28 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 07:07:05.293 1 WARNING oslo_config.cfg [req-444fdfef-d017-479d-a3f9-6f2ded5eec28 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 07:07:05.295 1 WARNING oslo_config.cfg [req-444fdfef-d017-479d-a3f9-6f2ded5eec28 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:07:05.295 1 WARNING oslo_config.cfg [req-444fdfef-d017-479d-a3f9-6f2ded5eec28 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:07:05.296 1 WARNING oslo_config.cfg [req-444fdfef-d017-479d-a3f9-6f2ded5eec28 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:07:05.301 1 WARNING oslo_config.cfg [req-444fdfef-d017-479d-a3f9-6f2ded5eec28 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 07:07:05.302 1 WARNING oslo_config.cfg [req-444fdfef-d017-479d-a3f9-6f2ded5eec28 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 07:07:05.304 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 07:07:05.310 1 INFO cinder.manager [req-a9f4f6ea-e951-4c72-a0e2-2829f7a88e62 - - - - -] Initiating service 5 cleanup
>2018-06-26 07:07:05.316 1 INFO cinder.manager [req-a9f4f6ea-e951-4c72-a0e2-2829f7a88e62 - - - - -] Service 5 cleanup completed.
>2018-06-26 07:09:17.365 1 ERROR oslo.messaging._drivers.impl_rabbit [req-a9f4f6ea-e951-4c72-a0e2-2829f7a88e62 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:09:17.367 1 ERROR oslo.messaging._drivers.impl_rabbit [req-a9f4f6ea-e951-4c72-a0e2-2829f7a88e62 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:09:17.368 1 ERROR oslo_service.service [req-a9f4f6ea-e951-4c72-a0e2-2829f7a88e62 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:09:17.368 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 07:09:17.368 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 07:09:17.368 1 ERROR oslo_service.service     service.start()
>2018-06-26 07:09:17.368 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 07:09:17.368 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 07:09:17.368 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 07:09:17.368 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 07:09:17.368 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 07:09:17.368 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 07:09:17.368 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 07:09:17.368 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 07:09:17.368 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 07:09:17.368 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 07:09:17.368 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 07:09:17.368 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 07:09:17.368 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 07:09:17.368 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 07:09:17.368 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 07:09:17.368 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 07:09:17.368 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 07:09:17.368 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 07:09:17.368 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 07:09:17.368 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 07:09:17.368 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 07:09:17.368 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 07:09:17.368 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:09:17.368 1 ERROR oslo_service.service 
>2018-06-26 07:09:17.371 1 CRITICAL cinder [req-444fdfef-d017-479d-a3f9-6f2ded5eec28 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 07:09:17.371 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 07:09:17.371 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 07:09:17.371 1 ERROR cinder     sys.exit(main())
>2018-06-26 07:09:17.371 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 07:09:17.371 1 ERROR cinder     service.wait()
>2018-06-26 07:09:17.371 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 07:09:17.371 1 ERROR cinder     _launcher.wait()
>2018-06-26 07:09:17.371 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 07:09:17.371 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 07:09:17.371 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 07:09:17.371 1 ERROR cinder     self.services.wait()
>2018-06-26 07:09:17.371 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 07:09:17.371 1 ERROR cinder     service.wait()
>2018-06-26 07:09:17.371 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 07:09:17.371 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 07:09:17.371 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 07:09:17.371 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 07:09:17.371 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 07:09:17.371 1 ERROR cinder     post_fn = fn()
>2018-06-26 07:09:17.371 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 07:09:17.371 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 07:09:17.371 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 07:09:17.371 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 07:09:17.371 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 07:09:17.371 1 ERROR cinder 
>2018-06-26 07:09:20.011 1 WARNING cinder.scheduler.host_manager [req-b62104ab-4c21-4735-93c8-a086b3499cd0 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 07:09:20.016 1 INFO cinder.rpc [req-b62104ab-4c21-4735-93c8-a086b3499cd0 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 07:09:20.022 1 INFO cinder.rpc [req-b62104ab-4c21-4735-93c8-a086b3499cd0 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 07:09:20.036 1 INFO cinder.rpc [req-b62104ab-4c21-4735-93c8-a086b3499cd0 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 07:09:20.042 1 INFO cinder.rpc [req-b62104ab-4c21-4735-93c8-a086b3499cd0 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 07:09:20.066 1 WARNING oslo_config.cfg [req-b62104ab-4c21-4735-93c8-a086b3499cd0 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 07:09:20.069 1 WARNING oslo_config.cfg [req-b62104ab-4c21-4735-93c8-a086b3499cd0 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:09:20.069 1 WARNING oslo_config.cfg [req-b62104ab-4c21-4735-93c8-a086b3499cd0 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:09:20.070 1 WARNING oslo_config.cfg [req-b62104ab-4c21-4735-93c8-a086b3499cd0 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:09:20.075 1 WARNING oslo_config.cfg [req-b62104ab-4c21-4735-93c8-a086b3499cd0 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 07:09:20.076 1 WARNING oslo_config.cfg [req-b62104ab-4c21-4735-93c8-a086b3499cd0 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 07:09:20.079 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 07:09:20.090 1 INFO cinder.manager [req-6f1c41ff-2df7-4002-996b-e047a5729719 - - - - -] Initiating service 5 cleanup
>2018-06-26 07:09:20.097 1 INFO cinder.manager [req-6f1c41ff-2df7-4002-996b-e047a5729719 - - - - -] Service 5 cleanup completed.
>2018-06-26 07:11:32.499 1 ERROR oslo.messaging._drivers.impl_rabbit [req-6f1c41ff-2df7-4002-996b-e047a5729719 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:11:32.501 1 ERROR oslo.messaging._drivers.impl_rabbit [req-6f1c41ff-2df7-4002-996b-e047a5729719 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:11:32.501 1 ERROR oslo_service.service [req-6f1c41ff-2df7-4002-996b-e047a5729719 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:11:32.501 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 07:11:32.501 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 07:11:32.501 1 ERROR oslo_service.service     service.start()
>2018-06-26 07:11:32.501 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 07:11:32.501 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 07:11:32.501 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 07:11:32.501 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 07:11:32.501 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 07:11:32.501 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 07:11:32.501 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 07:11:32.501 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 07:11:32.501 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 07:11:32.501 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 07:11:32.501 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 07:11:32.501 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 07:11:32.501 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 07:11:32.501 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 07:11:32.501 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 07:11:32.501 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 07:11:32.501 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 07:11:32.501 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 07:11:32.501 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 07:11:32.501 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 07:11:32.501 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 07:11:32.501 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 07:11:32.501 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:11:32.501 1 ERROR oslo_service.service 
>2018-06-26 07:11:32.504 1 CRITICAL cinder [req-b62104ab-4c21-4735-93c8-a086b3499cd0 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 07:11:32.504 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 07:11:32.504 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 07:11:32.504 1 ERROR cinder     sys.exit(main())
>2018-06-26 07:11:32.504 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 07:11:32.504 1 ERROR cinder     service.wait()
>2018-06-26 07:11:32.504 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 07:11:32.504 1 ERROR cinder     _launcher.wait()
>2018-06-26 07:11:32.504 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 07:11:32.504 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 07:11:32.504 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 07:11:32.504 1 ERROR cinder     self.services.wait()
>2018-06-26 07:11:32.504 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 07:11:32.504 1 ERROR cinder     service.wait()
>2018-06-26 07:11:32.504 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 07:11:32.504 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 07:11:32.504 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 07:11:32.504 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 07:11:32.504 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 07:11:32.504 1 ERROR cinder     post_fn = fn()
>2018-06-26 07:11:32.504 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 07:11:32.504 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 07:11:32.504 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 07:11:32.504 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 07:11:32.504 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 07:11:32.504 1 ERROR cinder 
>2018-06-26 07:11:35.228 1 WARNING cinder.scheduler.host_manager [req-24e7b96e-d61f-45fb-b795-064dd25e5f0b - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 07:11:35.234 1 INFO cinder.rpc [req-24e7b96e-d61f-45fb-b795-064dd25e5f0b - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 07:11:35.240 1 INFO cinder.rpc [req-24e7b96e-d61f-45fb-b795-064dd25e5f0b - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 07:11:35.250 1 INFO cinder.rpc [req-24e7b96e-d61f-45fb-b795-064dd25e5f0b - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 07:11:35.256 1 INFO cinder.rpc [req-24e7b96e-d61f-45fb-b795-064dd25e5f0b - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 07:11:35.278 1 WARNING oslo_config.cfg [req-24e7b96e-d61f-45fb-b795-064dd25e5f0b - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 07:11:35.280 1 WARNING oslo_config.cfg [req-24e7b96e-d61f-45fb-b795-064dd25e5f0b - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:11:35.281 1 WARNING oslo_config.cfg [req-24e7b96e-d61f-45fb-b795-064dd25e5f0b - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:11:35.281 1 WARNING oslo_config.cfg [req-24e7b96e-d61f-45fb-b795-064dd25e5f0b - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:11:35.286 1 WARNING oslo_config.cfg [req-24e7b96e-d61f-45fb-b795-064dd25e5f0b - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 07:11:35.288 1 WARNING oslo_config.cfg [req-24e7b96e-d61f-45fb-b795-064dd25e5f0b - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 07:11:35.291 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 07:11:35.297 1 INFO cinder.manager [req-868c9a9f-337d-410a-8bab-5f05739bfcd3 - - - - -] Initiating service 5 cleanup
>2018-06-26 07:11:35.303 1 INFO cinder.manager [req-868c9a9f-337d-410a-8bab-5f05739bfcd3 - - - - -] Service 5 cleanup completed.
>2018-06-26 07:13:41.656 1 ERROR oslo.messaging._drivers.impl_rabbit [req-868c9a9f-337d-410a-8bab-5f05739bfcd3 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:13:41.658 1 ERROR oslo.messaging._drivers.impl_rabbit [req-868c9a9f-337d-410a-8bab-5f05739bfcd3 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:13:41.659 1 ERROR oslo_service.service [req-868c9a9f-337d-410a-8bab-5f05739bfcd3 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:13:41.659 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 07:13:41.659 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 07:13:41.659 1 ERROR oslo_service.service     service.start()
>2018-06-26 07:13:41.659 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 07:13:41.659 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 07:13:41.659 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 07:13:41.659 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 07:13:41.659 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 07:13:41.659 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 07:13:41.659 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 07:13:41.659 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 07:13:41.659 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 07:13:41.659 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 07:13:41.659 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 07:13:41.659 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 07:13:41.659 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 07:13:41.659 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 07:13:41.659 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 07:13:41.659 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 07:13:41.659 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 07:13:41.659 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 07:13:41.659 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 07:13:41.659 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 07:13:41.659 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 07:13:41.659 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 07:13:41.659 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:13:41.659 1 ERROR oslo_service.service 
>2018-06-26 07:13:41.662 1 CRITICAL cinder [req-24e7b96e-d61f-45fb-b795-064dd25e5f0b - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 07:13:41.662 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 07:13:41.662 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 07:13:41.662 1 ERROR cinder     sys.exit(main())
>2018-06-26 07:13:41.662 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 07:13:41.662 1 ERROR cinder     service.wait()
>2018-06-26 07:13:41.662 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 07:13:41.662 1 ERROR cinder     _launcher.wait()
>2018-06-26 07:13:41.662 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 07:13:41.662 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 07:13:41.662 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 07:13:41.662 1 ERROR cinder     self.services.wait()
>2018-06-26 07:13:41.662 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 07:13:41.662 1 ERROR cinder     service.wait()
>2018-06-26 07:13:41.662 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 07:13:41.662 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 07:13:41.662 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 07:13:41.662 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 07:13:41.662 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 07:13:41.662 1 ERROR cinder     post_fn = fn()
>2018-06-26 07:13:41.662 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 07:13:41.662 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 07:13:41.662 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 07:13:41.662 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 07:13:41.662 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 07:13:41.662 1 ERROR cinder 
>2018-06-26 07:13:44.443 1 WARNING cinder.scheduler.host_manager [req-2dcca891-fe1f-4cdb-beb9-fffbbc9bef32 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 07:13:44.450 1 INFO cinder.rpc [req-2dcca891-fe1f-4cdb-beb9-fffbbc9bef32 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 07:13:44.458 1 INFO cinder.rpc [req-2dcca891-fe1f-4cdb-beb9-fffbbc9bef32 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 07:13:44.472 1 INFO cinder.rpc [req-2dcca891-fe1f-4cdb-beb9-fffbbc9bef32 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 07:13:44.480 1 INFO cinder.rpc [req-2dcca891-fe1f-4cdb-beb9-fffbbc9bef32 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 07:13:44.516 1 WARNING oslo_config.cfg [req-2dcca891-fe1f-4cdb-beb9-fffbbc9bef32 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 07:13:44.518 1 WARNING oslo_config.cfg [req-2dcca891-fe1f-4cdb-beb9-fffbbc9bef32 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:13:44.519 1 WARNING oslo_config.cfg [req-2dcca891-fe1f-4cdb-beb9-fffbbc9bef32 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:13:44.519 1 WARNING oslo_config.cfg [req-2dcca891-fe1f-4cdb-beb9-fffbbc9bef32 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:13:44.528 1 WARNING oslo_config.cfg [req-2dcca891-fe1f-4cdb-beb9-fffbbc9bef32 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 07:13:44.529 1 WARNING oslo_config.cfg [req-2dcca891-fe1f-4cdb-beb9-fffbbc9bef32 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 07:13:44.534 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 07:13:44.544 1 INFO cinder.manager [req-98580c51-79fe-4b1f-aa91-31e14b6ef268 - - - - -] Initiating service 5 cleanup
>2018-06-26 07:13:44.550 1 INFO cinder.manager [req-98580c51-79fe-4b1f-aa91-31e14b6ef268 - - - - -] Service 5 cleanup completed.
>2018-06-26 07:15:48.870 1 ERROR oslo.messaging._drivers.impl_rabbit [req-98580c51-79fe-4b1f-aa91-31e14b6ef268 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:15:48.872 1 ERROR oslo.messaging._drivers.impl_rabbit [req-98580c51-79fe-4b1f-aa91-31e14b6ef268 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:15:48.872 1 ERROR oslo_service.service [req-98580c51-79fe-4b1f-aa91-31e14b6ef268 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:15:48.872 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 07:15:48.872 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 07:15:48.872 1 ERROR oslo_service.service     service.start()
>2018-06-26 07:15:48.872 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 07:15:48.872 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 07:15:48.872 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 07:15:48.872 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 07:15:48.872 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 07:15:48.872 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 07:15:48.872 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 07:15:48.872 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 07:15:48.872 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 07:15:48.872 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 07:15:48.872 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 07:15:48.872 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 07:15:48.872 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 07:15:48.872 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 07:15:48.872 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 07:15:48.872 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 07:15:48.872 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 07:15:48.872 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 07:15:48.872 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 07:15:48.872 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 07:15:48.872 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 07:15:48.872 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 07:15:48.872 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:15:48.872 1 ERROR oslo_service.service 
>2018-06-26 07:15:48.875 1 CRITICAL cinder [req-2dcca891-fe1f-4cdb-beb9-fffbbc9bef32 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 07:15:48.875 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 07:15:48.875 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 07:15:48.875 1 ERROR cinder     sys.exit(main())
>2018-06-26 07:15:48.875 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 07:15:48.875 1 ERROR cinder     service.wait()
>2018-06-26 07:15:48.875 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 07:15:48.875 1 ERROR cinder     _launcher.wait()
>2018-06-26 07:15:48.875 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 07:15:48.875 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 07:15:48.875 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 07:15:48.875 1 ERROR cinder     self.services.wait()
>2018-06-26 07:15:48.875 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 07:15:48.875 1 ERROR cinder     service.wait()
>2018-06-26 07:15:48.875 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 07:15:48.875 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 07:15:48.875 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 07:15:48.875 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 07:15:48.875 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 07:15:48.875 1 ERROR cinder     post_fn = fn()
>2018-06-26 07:15:48.875 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 07:15:48.875 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 07:15:48.875 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 07:15:48.875 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 07:15:48.875 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 07:15:48.875 1 ERROR cinder 
>2018-06-26 07:15:51.483 1 WARNING cinder.scheduler.host_manager [req-b6a38733-43e7-419a-8424-89620715dbd0 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 07:15:51.490 1 INFO cinder.rpc [req-b6a38733-43e7-419a-8424-89620715dbd0 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 07:15:51.496 1 INFO cinder.rpc [req-b6a38733-43e7-419a-8424-89620715dbd0 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 07:15:51.509 1 INFO cinder.rpc [req-b6a38733-43e7-419a-8424-89620715dbd0 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 07:15:51.515 1 INFO cinder.rpc [req-b6a38733-43e7-419a-8424-89620715dbd0 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 07:15:51.539 1 WARNING oslo_config.cfg [req-b6a38733-43e7-419a-8424-89620715dbd0 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 07:15:51.541 1 WARNING oslo_config.cfg [req-b6a38733-43e7-419a-8424-89620715dbd0 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:15:51.541 1 WARNING oslo_config.cfg [req-b6a38733-43e7-419a-8424-89620715dbd0 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:15:51.542 1 WARNING oslo_config.cfg [req-b6a38733-43e7-419a-8424-89620715dbd0 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:15:51.547 1 WARNING oslo_config.cfg [req-b6a38733-43e7-419a-8424-89620715dbd0 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 07:15:51.548 1 WARNING oslo_config.cfg [req-b6a38733-43e7-419a-8424-89620715dbd0 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 07:15:51.551 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 07:15:51.559 1 INFO cinder.manager [req-9b3d00ca-abab-4784-adef-0d851987fc61 - - - - -] Initiating service 5 cleanup
>2018-06-26 07:15:51.563 1 INFO cinder.manager [req-9b3d00ca-abab-4784-adef-0d851987fc61 - - - - -] Service 5 cleanup completed.
>2018-06-26 07:18:03.024 1 ERROR oslo.messaging._drivers.impl_rabbit [req-9b3d00ca-abab-4784-adef-0d851987fc61 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:18:03.026 1 ERROR oslo.messaging._drivers.impl_rabbit [req-9b3d00ca-abab-4784-adef-0d851987fc61 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:18:03.027 1 ERROR oslo_service.service [req-9b3d00ca-abab-4784-adef-0d851987fc61 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:18:03.027 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 07:18:03.027 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 07:18:03.027 1 ERROR oslo_service.service     service.start()
>2018-06-26 07:18:03.027 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 07:18:03.027 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 07:18:03.027 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 07:18:03.027 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 07:18:03.027 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 07:18:03.027 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 07:18:03.027 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 07:18:03.027 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 07:18:03.027 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 07:18:03.027 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 07:18:03.027 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 07:18:03.027 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 07:18:03.027 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 07:18:03.027 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 07:18:03.027 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 07:18:03.027 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 07:18:03.027 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 07:18:03.027 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 07:18:03.027 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 07:18:03.027 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 07:18:03.027 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 07:18:03.027 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 07:18:03.027 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:18:03.027 1 ERROR oslo_service.service 
>2018-06-26 07:18:03.030 1 CRITICAL cinder [req-b6a38733-43e7-419a-8424-89620715dbd0 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 07:18:03.030 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 07:18:03.030 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 07:18:03.030 1 ERROR cinder     sys.exit(main())
>2018-06-26 07:18:03.030 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 07:18:03.030 1 ERROR cinder     service.wait()
>2018-06-26 07:18:03.030 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 07:18:03.030 1 ERROR cinder     _launcher.wait()
>2018-06-26 07:18:03.030 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 07:18:03.030 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 07:18:03.030 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 07:18:03.030 1 ERROR cinder     self.services.wait()
>2018-06-26 07:18:03.030 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 07:18:03.030 1 ERROR cinder     service.wait()
>2018-06-26 07:18:03.030 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 07:18:03.030 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 07:18:03.030 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 07:18:03.030 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 07:18:03.030 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 07:18:03.030 1 ERROR cinder     post_fn = fn()
>2018-06-26 07:18:03.030 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 07:18:03.030 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 07:18:03.030 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 07:18:03.030 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 07:18:03.030 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 07:18:03.030 1 ERROR cinder 
>2018-06-26 07:18:05.842 1 WARNING cinder.scheduler.host_manager [req-8bc2aec5-82e7-4f58-8ec1-d945ac47eedc - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 07:18:05.848 1 INFO cinder.rpc [req-8bc2aec5-82e7-4f58-8ec1-d945ac47eedc - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 07:18:05.854 1 INFO cinder.rpc [req-8bc2aec5-82e7-4f58-8ec1-d945ac47eedc - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 07:18:05.867 1 INFO cinder.rpc [req-8bc2aec5-82e7-4f58-8ec1-d945ac47eedc - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 07:18:05.875 1 INFO cinder.rpc [req-8bc2aec5-82e7-4f58-8ec1-d945ac47eedc - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 07:18:05.899 1 WARNING oslo_config.cfg [req-8bc2aec5-82e7-4f58-8ec1-d945ac47eedc - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 07:18:05.901 1 WARNING oslo_config.cfg [req-8bc2aec5-82e7-4f58-8ec1-d945ac47eedc - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:18:05.902 1 WARNING oslo_config.cfg [req-8bc2aec5-82e7-4f58-8ec1-d945ac47eedc - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:18:05.903 1 WARNING oslo_config.cfg [req-8bc2aec5-82e7-4f58-8ec1-d945ac47eedc - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:18:05.908 1 WARNING oslo_config.cfg [req-8bc2aec5-82e7-4f58-8ec1-d945ac47eedc - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 07:18:05.909 1 WARNING oslo_config.cfg [req-8bc2aec5-82e7-4f58-8ec1-d945ac47eedc - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 07:18:05.911 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 07:18:05.919 1 INFO cinder.manager [req-4efbb6c7-aefc-4070-892b-89d039b0ff60 - - - - -] Initiating service 5 cleanup
>2018-06-26 07:18:05.924 1 INFO cinder.manager [req-4efbb6c7-aefc-4070-892b-89d039b0ff60 - - - - -] Service 5 cleanup completed.
>2018-06-26 07:20:17.679 1 ERROR oslo.messaging._drivers.impl_rabbit [req-4efbb6c7-aefc-4070-892b-89d039b0ff60 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:20:17.681 1 ERROR oslo.messaging._drivers.impl_rabbit [req-4efbb6c7-aefc-4070-892b-89d039b0ff60 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:20:17.681 1 ERROR oslo_service.service [req-4efbb6c7-aefc-4070-892b-89d039b0ff60 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:20:17.681 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 07:20:17.681 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 07:20:17.681 1 ERROR oslo_service.service     service.start()
>2018-06-26 07:20:17.681 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 07:20:17.681 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 07:20:17.681 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 07:20:17.681 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 07:20:17.681 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 07:20:17.681 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 07:20:17.681 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 07:20:17.681 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 07:20:17.681 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 07:20:17.681 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 07:20:17.681 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 07:20:17.681 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 07:20:17.681 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 07:20:17.681 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 07:20:17.681 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 07:20:17.681 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 07:20:17.681 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 07:20:17.681 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 07:20:17.681 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 07:20:17.681 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 07:20:17.681 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 07:20:17.681 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 07:20:17.681 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:20:17.681 1 ERROR oslo_service.service 
>2018-06-26 07:20:17.684 1 CRITICAL cinder [req-8bc2aec5-82e7-4f58-8ec1-d945ac47eedc - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 07:20:17.684 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 07:20:17.684 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 07:20:17.684 1 ERROR cinder     sys.exit(main())
>2018-06-26 07:20:17.684 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 07:20:17.684 1 ERROR cinder     service.wait()
>2018-06-26 07:20:17.684 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 07:20:17.684 1 ERROR cinder     _launcher.wait()
>2018-06-26 07:20:17.684 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 07:20:17.684 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 07:20:17.684 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 07:20:17.684 1 ERROR cinder     self.services.wait()
>2018-06-26 07:20:17.684 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 07:20:17.684 1 ERROR cinder     service.wait()
>2018-06-26 07:20:17.684 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 07:20:17.684 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 07:20:17.684 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 07:20:17.684 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 07:20:17.684 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 07:20:17.684 1 ERROR cinder     post_fn = fn()
>2018-06-26 07:20:17.684 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 07:20:17.684 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 07:20:17.684 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 07:20:17.684 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 07:20:17.684 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 07:20:17.684 1 ERROR cinder 
>2018-06-26 07:20:20.333 1 WARNING cinder.scheduler.host_manager [req-82a0527e-a04f-4425-8a46-c4239ac68a19 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 07:20:20.340 1 INFO cinder.rpc [req-82a0527e-a04f-4425-8a46-c4239ac68a19 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 07:20:20.346 1 INFO cinder.rpc [req-82a0527e-a04f-4425-8a46-c4239ac68a19 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 07:20:20.357 1 INFO cinder.rpc [req-82a0527e-a04f-4425-8a46-c4239ac68a19 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 07:20:20.365 1 INFO cinder.rpc [req-82a0527e-a04f-4425-8a46-c4239ac68a19 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 07:20:20.387 1 WARNING oslo_config.cfg [req-82a0527e-a04f-4425-8a46-c4239ac68a19 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 07:20:20.389 1 WARNING oslo_config.cfg [req-82a0527e-a04f-4425-8a46-c4239ac68a19 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:20:20.390 1 WARNING oslo_config.cfg [req-82a0527e-a04f-4425-8a46-c4239ac68a19 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:20:20.391 1 WARNING oslo_config.cfg [req-82a0527e-a04f-4425-8a46-c4239ac68a19 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:20:20.396 1 WARNING oslo_config.cfg [req-82a0527e-a04f-4425-8a46-c4239ac68a19 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 07:20:20.397 1 WARNING oslo_config.cfg [req-82a0527e-a04f-4425-8a46-c4239ac68a19 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 07:20:20.400 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 07:20:20.406 1 INFO cinder.manager [req-7de73538-0112-4e2a-87c8-ac279d64a59e - - - - -] Initiating service 5 cleanup
>2018-06-26 07:20:20.411 1 INFO cinder.manager [req-7de73538-0112-4e2a-87c8-ac279d64a59e - - - - -] Service 5 cleanup completed.
>2018-06-26 07:22:26.336 1 ERROR oslo.messaging._drivers.impl_rabbit [req-7de73538-0112-4e2a-87c8-ac279d64a59e - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:22:26.337 1 ERROR oslo.messaging._drivers.impl_rabbit [req-7de73538-0112-4e2a-87c8-ac279d64a59e - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:22:26.338 1 ERROR oslo_service.service [req-7de73538-0112-4e2a-87c8-ac279d64a59e - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:22:26.338 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 07:22:26.338 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 07:22:26.338 1 ERROR oslo_service.service     service.start()
>2018-06-26 07:22:26.338 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 07:22:26.338 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 07:22:26.338 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 07:22:26.338 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 07:22:26.338 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 07:22:26.338 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 07:22:26.338 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 07:22:26.338 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 07:22:26.338 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 07:22:26.338 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 07:22:26.338 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 07:22:26.338 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 07:22:26.338 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 07:22:26.338 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 07:22:26.338 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 07:22:26.338 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 07:22:26.338 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 07:22:26.338 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 07:22:26.338 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 07:22:26.338 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 07:22:26.338 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 07:22:26.338 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 07:22:26.338 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:22:26.338 1 ERROR oslo_service.service 
>2018-06-26 07:22:26.341 1 CRITICAL cinder [req-82a0527e-a04f-4425-8a46-c4239ac68a19 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 07:22:26.341 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 07:22:26.341 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 07:22:26.341 1 ERROR cinder     sys.exit(main())
>2018-06-26 07:22:26.341 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 07:22:26.341 1 ERROR cinder     service.wait()
>2018-06-26 07:22:26.341 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 07:22:26.341 1 ERROR cinder     _launcher.wait()
>2018-06-26 07:22:26.341 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 07:22:26.341 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 07:22:26.341 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 07:22:26.341 1 ERROR cinder     self.services.wait()
>2018-06-26 07:22:26.341 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 07:22:26.341 1 ERROR cinder     service.wait()
>2018-06-26 07:22:26.341 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 07:22:26.341 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 07:22:26.341 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 07:22:26.341 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 07:22:26.341 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 07:22:26.341 1 ERROR cinder     post_fn = fn()
>2018-06-26 07:22:26.341 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 07:22:26.341 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 07:22:26.341 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 07:22:26.341 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 07:22:26.341 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 07:22:26.341 1 ERROR cinder 
>2018-06-26 07:22:29.038 1 WARNING cinder.scheduler.host_manager [req-9fe091b8-b596-44ef-8102-e5d3c83be893 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 07:22:29.044 1 INFO cinder.rpc [req-9fe091b8-b596-44ef-8102-e5d3c83be893 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 07:22:29.050 1 INFO cinder.rpc [req-9fe091b8-b596-44ef-8102-e5d3c83be893 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 07:22:29.063 1 INFO cinder.rpc [req-9fe091b8-b596-44ef-8102-e5d3c83be893 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 07:22:29.069 1 INFO cinder.rpc [req-9fe091b8-b596-44ef-8102-e5d3c83be893 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 07:22:29.092 1 WARNING oslo_config.cfg [req-9fe091b8-b596-44ef-8102-e5d3c83be893 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 07:22:29.094 1 WARNING oslo_config.cfg [req-9fe091b8-b596-44ef-8102-e5d3c83be893 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:22:29.095 1 WARNING oslo_config.cfg [req-9fe091b8-b596-44ef-8102-e5d3c83be893 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:22:29.095 1 WARNING oslo_config.cfg [req-9fe091b8-b596-44ef-8102-e5d3c83be893 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:22:29.100 1 WARNING oslo_config.cfg [req-9fe091b8-b596-44ef-8102-e5d3c83be893 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 07:22:29.102 1 WARNING oslo_config.cfg [req-9fe091b8-b596-44ef-8102-e5d3c83be893 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 07:22:29.104 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 07:22:29.111 1 INFO cinder.manager [req-d1e739cc-71fe-4494-9e2b-75492f353e8a - - - - -] Initiating service 5 cleanup
>2018-06-26 07:22:29.116 1 INFO cinder.manager [req-d1e739cc-71fe-4494-9e2b-75492f353e8a - - - - -] Service 5 cleanup completed.
>2018-06-26 07:24:33.450 1 ERROR oslo.messaging._drivers.impl_rabbit [req-d1e739cc-71fe-4494-9e2b-75492f353e8a - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:24:33.453 1 ERROR oslo.messaging._drivers.impl_rabbit [req-d1e739cc-71fe-4494-9e2b-75492f353e8a - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:24:33.453 1 ERROR oslo_service.service [req-d1e739cc-71fe-4494-9e2b-75492f353e8a - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:24:33.453 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 07:24:33.453 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 07:24:33.453 1 ERROR oslo_service.service     service.start()
>2018-06-26 07:24:33.453 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 07:24:33.453 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 07:24:33.453 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 07:24:33.453 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 07:24:33.453 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 07:24:33.453 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 07:24:33.453 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 07:24:33.453 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 07:24:33.453 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 07:24:33.453 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 07:24:33.453 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 07:24:33.453 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 07:24:33.453 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 07:24:33.453 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 07:24:33.453 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 07:24:33.453 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 07:24:33.453 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 07:24:33.453 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 07:24:33.453 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 07:24:33.453 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 07:24:33.453 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 07:24:33.453 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 07:24:33.453 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:24:33.453 1 ERROR oslo_service.service 
>2018-06-26 07:24:33.457 1 CRITICAL cinder [req-9fe091b8-b596-44ef-8102-e5d3c83be893 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 07:24:33.457 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 07:24:33.457 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 07:24:33.457 1 ERROR cinder     sys.exit(main())
>2018-06-26 07:24:33.457 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 07:24:33.457 1 ERROR cinder     service.wait()
>2018-06-26 07:24:33.457 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 07:24:33.457 1 ERROR cinder     _launcher.wait()
>2018-06-26 07:24:33.457 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 07:24:33.457 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 07:24:33.457 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 07:24:33.457 1 ERROR cinder     self.services.wait()
>2018-06-26 07:24:33.457 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 07:24:33.457 1 ERROR cinder     service.wait()
>2018-06-26 07:24:33.457 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 07:24:33.457 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 07:24:33.457 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 07:24:33.457 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 07:24:33.457 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 07:24:33.457 1 ERROR cinder     post_fn = fn()
>2018-06-26 07:24:33.457 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 07:24:33.457 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 07:24:33.457 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 07:24:33.457 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 07:24:33.457 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 07:24:33.457 1 ERROR cinder 
>2018-06-26 07:24:36.128 1 WARNING cinder.scheduler.host_manager [req-566fa7cd-9143-49aa-ada0-9fb82849f636 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 07:24:36.134 1 INFO cinder.rpc [req-566fa7cd-9143-49aa-ada0-9fb82849f636 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 07:24:36.140 1 INFO cinder.rpc [req-566fa7cd-9143-49aa-ada0-9fb82849f636 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 07:24:36.165 1 INFO cinder.rpc [req-566fa7cd-9143-49aa-ada0-9fb82849f636 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 07:24:36.171 1 INFO cinder.rpc [req-566fa7cd-9143-49aa-ada0-9fb82849f636 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 07:24:36.197 1 WARNING oslo_config.cfg [req-566fa7cd-9143-49aa-ada0-9fb82849f636 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 07:24:36.199 1 WARNING oslo_config.cfg [req-566fa7cd-9143-49aa-ada0-9fb82849f636 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:24:36.200 1 WARNING oslo_config.cfg [req-566fa7cd-9143-49aa-ada0-9fb82849f636 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:24:36.200 1 WARNING oslo_config.cfg [req-566fa7cd-9143-49aa-ada0-9fb82849f636 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:24:36.205 1 WARNING oslo_config.cfg [req-566fa7cd-9143-49aa-ada0-9fb82849f636 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 07:24:36.206 1 WARNING oslo_config.cfg [req-566fa7cd-9143-49aa-ada0-9fb82849f636 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 07:24:36.209 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 07:24:36.216 1 INFO cinder.manager [req-b5bc4d58-41df-402b-b459-bb5fd41cddaa - - - - -] Initiating service 5 cleanup
>2018-06-26 07:24:36.220 1 INFO cinder.manager [req-b5bc4d58-41df-402b-b459-bb5fd41cddaa - - - - -] Service 5 cleanup completed.
>2018-06-26 07:26:40.567 1 ERROR oslo.messaging._drivers.impl_rabbit [req-b5bc4d58-41df-402b-b459-bb5fd41cddaa - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:26:40.569 1 ERROR oslo.messaging._drivers.impl_rabbit [req-b5bc4d58-41df-402b-b459-bb5fd41cddaa - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:26:40.570 1 ERROR oslo_service.service [req-b5bc4d58-41df-402b-b459-bb5fd41cddaa - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:26:40.570 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 07:26:40.570 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 07:26:40.570 1 ERROR oslo_service.service     service.start()
>2018-06-26 07:26:40.570 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 07:26:40.570 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 07:26:40.570 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 07:26:40.570 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 07:26:40.570 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 07:26:40.570 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 07:26:40.570 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 07:26:40.570 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 07:26:40.570 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 07:26:40.570 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 07:26:40.570 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 07:26:40.570 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 07:26:40.570 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 07:26:40.570 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 07:26:40.570 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 07:26:40.570 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 07:26:40.570 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 07:26:40.570 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 07:26:40.570 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 07:26:40.570 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 07:26:40.570 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 07:26:40.570 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 07:26:40.570 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:26:40.570 1 ERROR oslo_service.service 
>2018-06-26 07:26:40.572 1 CRITICAL cinder [req-566fa7cd-9143-49aa-ada0-9fb82849f636 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 07:26:40.572 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 07:26:40.572 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 07:26:40.572 1 ERROR cinder     sys.exit(main())
>2018-06-26 07:26:40.572 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 07:26:40.572 1 ERROR cinder     service.wait()
>2018-06-26 07:26:40.572 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 07:26:40.572 1 ERROR cinder     _launcher.wait()
>2018-06-26 07:26:40.572 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 07:26:40.572 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 07:26:40.572 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 07:26:40.572 1 ERROR cinder     self.services.wait()
>2018-06-26 07:26:40.572 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 07:26:40.572 1 ERROR cinder     service.wait()
>2018-06-26 07:26:40.572 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 07:26:40.572 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 07:26:40.572 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 07:26:40.572 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 07:26:40.572 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 07:26:40.572 1 ERROR cinder     post_fn = fn()
>2018-06-26 07:26:40.572 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 07:26:40.572 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 07:26:40.572 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 07:26:40.572 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 07:26:40.572 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 07:26:40.572 1 ERROR cinder 
>2018-06-26 07:26:43.195 1 WARNING cinder.scheduler.host_manager [req-7bcffd2e-01b7-491c-99ef-07220b87265b - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 07:26:43.201 1 INFO cinder.rpc [req-7bcffd2e-01b7-491c-99ef-07220b87265b - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 07:26:43.206 1 INFO cinder.rpc [req-7bcffd2e-01b7-491c-99ef-07220b87265b - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 07:26:43.217 1 INFO cinder.rpc [req-7bcffd2e-01b7-491c-99ef-07220b87265b - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 07:26:43.223 1 INFO cinder.rpc [req-7bcffd2e-01b7-491c-99ef-07220b87265b - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 07:26:43.244 1 WARNING oslo_config.cfg [req-7bcffd2e-01b7-491c-99ef-07220b87265b - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 07:26:43.246 1 WARNING oslo_config.cfg [req-7bcffd2e-01b7-491c-99ef-07220b87265b - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:26:43.247 1 WARNING oslo_config.cfg [req-7bcffd2e-01b7-491c-99ef-07220b87265b - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:26:43.248 1 WARNING oslo_config.cfg [req-7bcffd2e-01b7-491c-99ef-07220b87265b - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:26:43.252 1 WARNING oslo_config.cfg [req-7bcffd2e-01b7-491c-99ef-07220b87265b - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 07:26:43.253 1 WARNING oslo_config.cfg [req-7bcffd2e-01b7-491c-99ef-07220b87265b - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 07:26:43.256 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 07:26:43.261 1 INFO cinder.manager [req-a960fd95-e186-4358-aefa-72c6348718f0 - - - - -] Initiating service 5 cleanup
>2018-06-26 07:26:43.266 1 INFO cinder.manager [req-a960fd95-e186-4358-aefa-72c6348718f0 - - - - -] Service 5 cleanup completed.
>2018-06-26 07:28:47.722 1 ERROR oslo.messaging._drivers.impl_rabbit [req-a960fd95-e186-4358-aefa-72c6348718f0 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:28:47.725 1 ERROR oslo.messaging._drivers.impl_rabbit [req-a960fd95-e186-4358-aefa-72c6348718f0 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:28:47.726 1 ERROR oslo_service.service [req-a960fd95-e186-4358-aefa-72c6348718f0 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:28:47.726 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 07:28:47.726 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 07:28:47.726 1 ERROR oslo_service.service     service.start()
>2018-06-26 07:28:47.726 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 07:28:47.726 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 07:28:47.726 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 07:28:47.726 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 07:28:47.726 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 07:28:47.726 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 07:28:47.726 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 07:28:47.726 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 07:28:47.726 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 07:28:47.726 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 07:28:47.726 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 07:28:47.726 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 07:28:47.726 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 07:28:47.726 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 07:28:47.726 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 07:28:47.726 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 07:28:47.726 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 07:28:47.726 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 07:28:47.726 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 07:28:47.726 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 07:28:47.726 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 07:28:47.726 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 07:28:47.726 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:28:47.726 1 ERROR oslo_service.service 
>2018-06-26 07:28:47.730 1 CRITICAL cinder [req-7bcffd2e-01b7-491c-99ef-07220b87265b - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 07:28:47.730 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 07:28:47.730 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 07:28:47.730 1 ERROR cinder     sys.exit(main())
>2018-06-26 07:28:47.730 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 07:28:47.730 1 ERROR cinder     service.wait()
>2018-06-26 07:28:47.730 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 07:28:47.730 1 ERROR cinder     _launcher.wait()
>2018-06-26 07:28:47.730 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 07:28:47.730 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 07:28:47.730 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 07:28:47.730 1 ERROR cinder     self.services.wait()
>2018-06-26 07:28:47.730 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 07:28:47.730 1 ERROR cinder     service.wait()
>2018-06-26 07:28:47.730 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 07:28:47.730 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 07:28:47.730 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 07:28:47.730 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 07:28:47.730 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 07:28:47.730 1 ERROR cinder     post_fn = fn()
>2018-06-26 07:28:47.730 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 07:28:47.730 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 07:28:47.730 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 07:28:47.730 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 07:28:47.730 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 07:28:47.730 1 ERROR cinder 
>2018-06-26 07:28:50.450 1 WARNING cinder.scheduler.host_manager [req-092aa247-77e9-4d65-8e5f-7d45d5c07a34 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 07:28:50.456 1 INFO cinder.rpc [req-092aa247-77e9-4d65-8e5f-7d45d5c07a34 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 07:28:50.461 1 INFO cinder.rpc [req-092aa247-77e9-4d65-8e5f-7d45d5c07a34 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 07:28:50.472 1 INFO cinder.rpc [req-092aa247-77e9-4d65-8e5f-7d45d5c07a34 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 07:28:50.478 1 INFO cinder.rpc [req-092aa247-77e9-4d65-8e5f-7d45d5c07a34 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 07:28:50.500 1 WARNING oslo_config.cfg [req-092aa247-77e9-4d65-8e5f-7d45d5c07a34 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 07:28:50.502 1 WARNING oslo_config.cfg [req-092aa247-77e9-4d65-8e5f-7d45d5c07a34 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:28:50.503 1 WARNING oslo_config.cfg [req-092aa247-77e9-4d65-8e5f-7d45d5c07a34 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:28:50.503 1 WARNING oslo_config.cfg [req-092aa247-77e9-4d65-8e5f-7d45d5c07a34 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:28:50.508 1 WARNING oslo_config.cfg [req-092aa247-77e9-4d65-8e5f-7d45d5c07a34 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 07:28:50.510 1 WARNING oslo_config.cfg [req-092aa247-77e9-4d65-8e5f-7d45d5c07a34 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 07:28:50.512 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 07:28:50.520 1 INFO cinder.manager [req-205d91e9-f04e-4b3f-b937-23f7e5339823 - - - - -] Initiating service 5 cleanup
>2018-06-26 07:28:50.525 1 INFO cinder.manager [req-205d91e9-f04e-4b3f-b937-23f7e5339823 - - - - -] Service 5 cleanup completed.
>2018-06-26 07:30:55.076 1 ERROR oslo.messaging._drivers.impl_rabbit [req-205d91e9-f04e-4b3f-b937-23f7e5339823 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:30:55.077 1 ERROR oslo.messaging._drivers.impl_rabbit [req-205d91e9-f04e-4b3f-b937-23f7e5339823 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:30:55.078 1 ERROR oslo_service.service [req-205d91e9-f04e-4b3f-b937-23f7e5339823 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:30:55.078 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 07:30:55.078 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 07:30:55.078 1 ERROR oslo_service.service     service.start()
>2018-06-26 07:30:55.078 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 07:30:55.078 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 07:30:55.078 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 07:30:55.078 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 07:30:55.078 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 07:30:55.078 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 07:30:55.078 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 07:30:55.078 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 07:30:55.078 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 07:30:55.078 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 07:30:55.078 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 07:30:55.078 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 07:30:55.078 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 07:30:55.078 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 07:30:55.078 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 07:30:55.078 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 07:30:55.078 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 07:30:55.078 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 07:30:55.078 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 07:30:55.078 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 07:30:55.078 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 07:30:55.078 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 07:30:55.078 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:30:55.078 1 ERROR oslo_service.service 
>2018-06-26 07:30:55.081 1 CRITICAL cinder [req-092aa247-77e9-4d65-8e5f-7d45d5c07a34 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 07:30:55.081 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 07:30:55.081 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 07:30:55.081 1 ERROR cinder     sys.exit(main())
>2018-06-26 07:30:55.081 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 07:30:55.081 1 ERROR cinder     service.wait()
>2018-06-26 07:30:55.081 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 07:30:55.081 1 ERROR cinder     _launcher.wait()
>2018-06-26 07:30:55.081 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 07:30:55.081 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 07:30:55.081 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 07:30:55.081 1 ERROR cinder     self.services.wait()
>2018-06-26 07:30:55.081 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 07:30:55.081 1 ERROR cinder     service.wait()
>2018-06-26 07:30:55.081 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 07:30:55.081 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 07:30:55.081 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 07:30:55.081 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 07:30:55.081 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 07:30:55.081 1 ERROR cinder     post_fn = fn()
>2018-06-26 07:30:55.081 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 07:30:55.081 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 07:30:55.081 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 07:30:55.081 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 07:30:55.081 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 07:30:55.081 1 ERROR cinder 
>2018-06-26 07:30:57.748 1 WARNING cinder.scheduler.host_manager [req-f9d7317d-b429-43c6-8a9f-69bb5131b6c0 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 07:30:57.756 1 INFO cinder.rpc [req-f9d7317d-b429-43c6-8a9f-69bb5131b6c0 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 07:30:57.762 1 INFO cinder.rpc [req-f9d7317d-b429-43c6-8a9f-69bb5131b6c0 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 07:30:57.781 1 INFO cinder.rpc [req-f9d7317d-b429-43c6-8a9f-69bb5131b6c0 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 07:30:57.788 1 INFO cinder.rpc [req-f9d7317d-b429-43c6-8a9f-69bb5131b6c0 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 07:30:57.819 1 WARNING oslo_config.cfg [req-f9d7317d-b429-43c6-8a9f-69bb5131b6c0 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 07:30:57.821 1 WARNING oslo_config.cfg [req-f9d7317d-b429-43c6-8a9f-69bb5131b6c0 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:30:57.822 1 WARNING oslo_config.cfg [req-f9d7317d-b429-43c6-8a9f-69bb5131b6c0 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:30:57.822 1 WARNING oslo_config.cfg [req-f9d7317d-b429-43c6-8a9f-69bb5131b6c0 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:30:57.828 1 WARNING oslo_config.cfg [req-f9d7317d-b429-43c6-8a9f-69bb5131b6c0 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 07:30:57.829 1 WARNING oslo_config.cfg [req-f9d7317d-b429-43c6-8a9f-69bb5131b6c0 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 07:30:57.831 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 07:30:57.837 1 INFO cinder.manager [req-b43a8ac4-fc74-498c-8b5c-8b52bd330fa4 - - - - -] Initiating service 5 cleanup
>2018-06-26 07:30:57.842 1 INFO cinder.manager [req-b43a8ac4-fc74-498c-8b5c-8b52bd330fa4 - - - - -] Service 5 cleanup completed.
>2018-06-26 07:33:10.141 1 ERROR oslo.messaging._drivers.impl_rabbit [req-b43a8ac4-fc74-498c-8b5c-8b52bd330fa4 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:33:10.144 1 ERROR oslo.messaging._drivers.impl_rabbit [req-b43a8ac4-fc74-498c-8b5c-8b52bd330fa4 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:33:10.145 1 ERROR oslo_service.service [req-b43a8ac4-fc74-498c-8b5c-8b52bd330fa4 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:33:10.145 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 07:33:10.145 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 07:33:10.145 1 ERROR oslo_service.service     service.start()
>2018-06-26 07:33:10.145 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 07:33:10.145 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 07:33:10.145 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 07:33:10.145 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 07:33:10.145 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 07:33:10.145 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 07:33:10.145 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 07:33:10.145 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 07:33:10.145 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 07:33:10.145 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 07:33:10.145 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 07:33:10.145 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 07:33:10.145 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 07:33:10.145 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 07:33:10.145 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 07:33:10.145 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 07:33:10.145 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 07:33:10.145 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 07:33:10.145 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 07:33:10.145 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 07:33:10.145 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 07:33:10.145 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 07:33:10.145 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:33:10.145 1 ERROR oslo_service.service 
>2018-06-26 07:33:10.149 1 CRITICAL cinder [req-f9d7317d-b429-43c6-8a9f-69bb5131b6c0 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 07:33:10.149 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 07:33:10.149 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 07:33:10.149 1 ERROR cinder     sys.exit(main())
>2018-06-26 07:33:10.149 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 07:33:10.149 1 ERROR cinder     service.wait()
>2018-06-26 07:33:10.149 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 07:33:10.149 1 ERROR cinder     _launcher.wait()
>2018-06-26 07:33:10.149 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 07:33:10.149 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 07:33:10.149 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 07:33:10.149 1 ERROR cinder     self.services.wait()
>2018-06-26 07:33:10.149 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 07:33:10.149 1 ERROR cinder     service.wait()
>2018-06-26 07:33:10.149 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 07:33:10.149 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 07:33:10.149 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 07:33:10.149 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 07:33:10.149 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 07:33:10.149 1 ERROR cinder     post_fn = fn()
>2018-06-26 07:33:10.149 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 07:33:10.149 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 07:33:10.149 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 07:33:10.149 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 07:33:10.149 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 07:33:10.149 1 ERROR cinder 
>2018-06-26 07:33:12.966 1 WARNING cinder.scheduler.host_manager [req-e7892b26-8fff-46ea-ad77-4e6ed19221d9 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 07:33:12.972 1 INFO cinder.rpc [req-e7892b26-8fff-46ea-ad77-4e6ed19221d9 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 07:33:12.979 1 INFO cinder.rpc [req-e7892b26-8fff-46ea-ad77-4e6ed19221d9 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 07:33:12.990 1 INFO cinder.rpc [req-e7892b26-8fff-46ea-ad77-4e6ed19221d9 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 07:33:12.998 1 INFO cinder.rpc [req-e7892b26-8fff-46ea-ad77-4e6ed19221d9 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 07:33:13.023 1 WARNING oslo_config.cfg [req-e7892b26-8fff-46ea-ad77-4e6ed19221d9 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 07:33:13.025 1 WARNING oslo_config.cfg [req-e7892b26-8fff-46ea-ad77-4e6ed19221d9 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:33:13.025 1 WARNING oslo_config.cfg [req-e7892b26-8fff-46ea-ad77-4e6ed19221d9 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:33:13.026 1 WARNING oslo_config.cfg [req-e7892b26-8fff-46ea-ad77-4e6ed19221d9 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:33:13.031 1 WARNING oslo_config.cfg [req-e7892b26-8fff-46ea-ad77-4e6ed19221d9 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 07:33:13.032 1 WARNING oslo_config.cfg [req-e7892b26-8fff-46ea-ad77-4e6ed19221d9 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 07:33:13.035 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 07:33:13.044 1 INFO cinder.manager [req-ae3239f7-6af4-486e-b30a-61244ecd10a0 - - - - -] Initiating service 5 cleanup
>2018-06-26 07:33:13.050 1 INFO cinder.manager [req-ae3239f7-6af4-486e-b30a-61244ecd10a0 - - - - -] Service 5 cleanup completed.
>2018-06-26 07:35:18.964 1 ERROR oslo.messaging._drivers.impl_rabbit [req-ae3239f7-6af4-486e-b30a-61244ecd10a0 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:35:18.965 1 ERROR oslo.messaging._drivers.impl_rabbit [req-ae3239f7-6af4-486e-b30a-61244ecd10a0 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:35:18.966 1 ERROR oslo_service.service [req-ae3239f7-6af4-486e-b30a-61244ecd10a0 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:35:18.966 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 07:35:18.966 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 07:35:18.966 1 ERROR oslo_service.service     service.start()
>2018-06-26 07:35:18.966 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 07:35:18.966 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 07:35:18.966 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 07:35:18.966 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 07:35:18.966 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 07:35:18.966 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 07:35:18.966 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 07:35:18.966 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 07:35:18.966 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 07:35:18.966 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 07:35:18.966 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 07:35:18.966 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 07:35:18.966 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 07:35:18.966 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 07:35:18.966 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 07:35:18.966 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 07:35:18.966 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 07:35:18.966 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 07:35:18.966 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 07:35:18.966 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 07:35:18.966 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 07:35:18.966 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 07:35:18.966 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:35:18.966 1 ERROR oslo_service.service 
>2018-06-26 07:35:18.969 1 CRITICAL cinder [req-e7892b26-8fff-46ea-ad77-4e6ed19221d9 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 07:35:18.969 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 07:35:18.969 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 07:35:18.969 1 ERROR cinder     sys.exit(main())
>2018-06-26 07:35:18.969 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 07:35:18.969 1 ERROR cinder     service.wait()
>2018-06-26 07:35:18.969 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 07:35:18.969 1 ERROR cinder     _launcher.wait()
>2018-06-26 07:35:18.969 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 07:35:18.969 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 07:35:18.969 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 07:35:18.969 1 ERROR cinder     self.services.wait()
>2018-06-26 07:35:18.969 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 07:35:18.969 1 ERROR cinder     service.wait()
>2018-06-26 07:35:18.969 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 07:35:18.969 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 07:35:18.969 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 07:35:18.969 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 07:35:18.969 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 07:35:18.969 1 ERROR cinder     post_fn = fn()
>2018-06-26 07:35:18.969 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 07:35:18.969 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 07:35:18.969 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 07:35:18.969 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 07:35:18.969 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 07:35:18.969 1 ERROR cinder 
>2018-06-26 07:35:21.590 1 WARNING cinder.scheduler.host_manager [req-079de77d-5bf1-40f3-88f4-23d599509e1b - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 07:35:21.596 1 INFO cinder.rpc [req-079de77d-5bf1-40f3-88f4-23d599509e1b - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 07:35:21.603 1 INFO cinder.rpc [req-079de77d-5bf1-40f3-88f4-23d599509e1b - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 07:35:21.616 1 INFO cinder.rpc [req-079de77d-5bf1-40f3-88f4-23d599509e1b - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 07:35:21.623 1 INFO cinder.rpc [req-079de77d-5bf1-40f3-88f4-23d599509e1b - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 07:35:21.659 1 WARNING oslo_config.cfg [req-079de77d-5bf1-40f3-88f4-23d599509e1b - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 07:35:21.662 1 WARNING oslo_config.cfg [req-079de77d-5bf1-40f3-88f4-23d599509e1b - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:35:21.662 1 WARNING oslo_config.cfg [req-079de77d-5bf1-40f3-88f4-23d599509e1b - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:35:21.663 1 WARNING oslo_config.cfg [req-079de77d-5bf1-40f3-88f4-23d599509e1b - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:35:21.668 1 WARNING oslo_config.cfg [req-079de77d-5bf1-40f3-88f4-23d599509e1b - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 07:35:21.669 1 WARNING oslo_config.cfg [req-079de77d-5bf1-40f3-88f4-23d599509e1b - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 07:35:21.672 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 07:35:21.680 1 INFO cinder.manager [req-d4deb216-a13a-44d4-a47c-caf653494830 - - - - -] Initiating service 5 cleanup
>2018-06-26 07:35:21.685 1 INFO cinder.manager [req-d4deb216-a13a-44d4-a47c-caf653494830 - - - - -] Service 5 cleanup completed.
>2018-06-26 07:37:26.088 1 ERROR oslo.messaging._drivers.impl_rabbit [req-d4deb216-a13a-44d4-a47c-caf653494830 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:37:26.090 1 ERROR oslo.messaging._drivers.impl_rabbit [req-d4deb216-a13a-44d4-a47c-caf653494830 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:37:26.091 1 ERROR oslo_service.service [req-d4deb216-a13a-44d4-a47c-caf653494830 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:37:26.091 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 07:37:26.091 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 07:37:26.091 1 ERROR oslo_service.service     service.start()
>2018-06-26 07:37:26.091 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 07:37:26.091 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 07:37:26.091 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 07:37:26.091 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 07:37:26.091 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 07:37:26.091 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 07:37:26.091 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 07:37:26.091 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 07:37:26.091 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 07:37:26.091 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 07:37:26.091 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 07:37:26.091 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 07:37:26.091 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 07:37:26.091 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 07:37:26.091 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 07:37:26.091 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 07:37:26.091 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 07:37:26.091 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 07:37:26.091 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 07:37:26.091 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 07:37:26.091 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 07:37:26.091 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 07:37:26.091 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:37:26.091 1 ERROR oslo_service.service 
>2018-06-26 07:37:26.094 1 CRITICAL cinder [req-079de77d-5bf1-40f3-88f4-23d599509e1b - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 07:37:26.094 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 07:37:26.094 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 07:37:26.094 1 ERROR cinder     sys.exit(main())
>2018-06-26 07:37:26.094 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 07:37:26.094 1 ERROR cinder     service.wait()
>2018-06-26 07:37:26.094 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 07:37:26.094 1 ERROR cinder     _launcher.wait()
>2018-06-26 07:37:26.094 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 07:37:26.094 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 07:37:26.094 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 07:37:26.094 1 ERROR cinder     self.services.wait()
>2018-06-26 07:37:26.094 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 07:37:26.094 1 ERROR cinder     service.wait()
>2018-06-26 07:37:26.094 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 07:37:26.094 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 07:37:26.094 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 07:37:26.094 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 07:37:26.094 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 07:37:26.094 1 ERROR cinder     post_fn = fn()
>2018-06-26 07:37:26.094 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 07:37:26.094 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 07:37:26.094 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 07:37:26.094 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 07:37:26.094 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 07:37:26.094 1 ERROR cinder 
>2018-06-26 07:37:28.872 1 WARNING cinder.scheduler.host_manager [req-820ad3eb-7775-4542-bff4-830915166faa - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 07:37:28.878 1 INFO cinder.rpc [req-820ad3eb-7775-4542-bff4-830915166faa - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 07:37:28.884 1 INFO cinder.rpc [req-820ad3eb-7775-4542-bff4-830915166faa - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 07:37:28.898 1 INFO cinder.rpc [req-820ad3eb-7775-4542-bff4-830915166faa - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 07:37:28.904 1 INFO cinder.rpc [req-820ad3eb-7775-4542-bff4-830915166faa - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 07:37:28.934 1 WARNING oslo_config.cfg [req-820ad3eb-7775-4542-bff4-830915166faa - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 07:37:28.936 1 WARNING oslo_config.cfg [req-820ad3eb-7775-4542-bff4-830915166faa - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:37:28.936 1 WARNING oslo_config.cfg [req-820ad3eb-7775-4542-bff4-830915166faa - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:37:28.937 1 WARNING oslo_config.cfg [req-820ad3eb-7775-4542-bff4-830915166faa - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:37:28.943 1 WARNING oslo_config.cfg [req-820ad3eb-7775-4542-bff4-830915166faa - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 07:37:28.944 1 WARNING oslo_config.cfg [req-820ad3eb-7775-4542-bff4-830915166faa - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 07:37:28.947 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 07:37:28.958 1 INFO cinder.manager [req-2e5f5ba6-b4c9-4c39-bc54-68225ee81c68 - - - - -] Initiating service 5 cleanup
>2018-06-26 07:37:28.963 1 INFO cinder.manager [req-2e5f5ba6-b4c9-4c39-bc54-68225ee81c68 - - - - -] Service 5 cleanup completed.
>2018-06-26 07:39:42.165 1 ERROR oslo.messaging._drivers.impl_rabbit [req-2e5f5ba6-b4c9-4c39-bc54-68225ee81c68 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:39:42.167 1 ERROR oslo.messaging._drivers.impl_rabbit [req-2e5f5ba6-b4c9-4c39-bc54-68225ee81c68 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:39:42.168 1 ERROR oslo_service.service [req-2e5f5ba6-b4c9-4c39-bc54-68225ee81c68 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:39:42.168 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 07:39:42.168 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 07:39:42.168 1 ERROR oslo_service.service     service.start()
>2018-06-26 07:39:42.168 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 07:39:42.168 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 07:39:42.168 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 07:39:42.168 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 07:39:42.168 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 07:39:42.168 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 07:39:42.168 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 07:39:42.168 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 07:39:42.168 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 07:39:42.168 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 07:39:42.168 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 07:39:42.168 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 07:39:42.168 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 07:39:42.168 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 07:39:42.168 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 07:39:42.168 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 07:39:42.168 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 07:39:42.168 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 07:39:42.168 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 07:39:42.168 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 07:39:42.168 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 07:39:42.168 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 07:39:42.168 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:39:42.168 1 ERROR oslo_service.service 
>2018-06-26 07:39:42.171 1 CRITICAL cinder [req-820ad3eb-7775-4542-bff4-830915166faa - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 07:39:42.171 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 07:39:42.171 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 07:39:42.171 1 ERROR cinder     sys.exit(main())
>2018-06-26 07:39:42.171 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 07:39:42.171 1 ERROR cinder     service.wait()
>2018-06-26 07:39:42.171 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 07:39:42.171 1 ERROR cinder     _launcher.wait()
>2018-06-26 07:39:42.171 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 07:39:42.171 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 07:39:42.171 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 07:39:42.171 1 ERROR cinder     self.services.wait()
>2018-06-26 07:39:42.171 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 07:39:42.171 1 ERROR cinder     service.wait()
>2018-06-26 07:39:42.171 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 07:39:42.171 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 07:39:42.171 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 07:39:42.171 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 07:39:42.171 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 07:39:42.171 1 ERROR cinder     post_fn = fn()
>2018-06-26 07:39:42.171 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 07:39:42.171 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 07:39:42.171 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 07:39:42.171 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 07:39:42.171 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 07:39:42.171 1 ERROR cinder 
>2018-06-26 07:39:44.843 1 WARNING cinder.scheduler.host_manager [req-462cf3d9-764c-42b4-845f-38eaf11c8208 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 07:39:44.849 1 INFO cinder.rpc [req-462cf3d9-764c-42b4-845f-38eaf11c8208 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 07:39:44.854 1 INFO cinder.rpc [req-462cf3d9-764c-42b4-845f-38eaf11c8208 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 07:39:44.865 1 INFO cinder.rpc [req-462cf3d9-764c-42b4-845f-38eaf11c8208 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 07:39:44.871 1 INFO cinder.rpc [req-462cf3d9-764c-42b4-845f-38eaf11c8208 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 07:39:44.894 1 WARNING oslo_config.cfg [req-462cf3d9-764c-42b4-845f-38eaf11c8208 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 07:39:44.896 1 WARNING oslo_config.cfg [req-462cf3d9-764c-42b4-845f-38eaf11c8208 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:39:44.897 1 WARNING oslo_config.cfg [req-462cf3d9-764c-42b4-845f-38eaf11c8208 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:39:44.898 1 WARNING oslo_config.cfg [req-462cf3d9-764c-42b4-845f-38eaf11c8208 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:39:44.903 1 WARNING oslo_config.cfg [req-462cf3d9-764c-42b4-845f-38eaf11c8208 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 07:39:44.904 1 WARNING oslo_config.cfg [req-462cf3d9-764c-42b4-845f-38eaf11c8208 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 07:39:44.907 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 07:39:44.913 1 INFO cinder.manager [req-12173721-f541-4c79-b5b7-f5712a8268ad - - - - -] Initiating service 5 cleanup
>2018-06-26 07:39:44.917 1 INFO cinder.manager [req-12173721-f541-4c79-b5b7-f5712a8268ad - - - - -] Service 5 cleanup completed.
>2018-06-26 07:41:57.376 1 ERROR oslo.messaging._drivers.impl_rabbit [req-12173721-f541-4c79-b5b7-f5712a8268ad - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:41:57.378 1 ERROR oslo.messaging._drivers.impl_rabbit [req-12173721-f541-4c79-b5b7-f5712a8268ad - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:41:57.378 1 ERROR oslo_service.service [req-12173721-f541-4c79-b5b7-f5712a8268ad - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:41:57.378 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 07:41:57.378 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 07:41:57.378 1 ERROR oslo_service.service     service.start()
>2018-06-26 07:41:57.378 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 07:41:57.378 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 07:41:57.378 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 07:41:57.378 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 07:41:57.378 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 07:41:57.378 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 07:41:57.378 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 07:41:57.378 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 07:41:57.378 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 07:41:57.378 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 07:41:57.378 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 07:41:57.378 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 07:41:57.378 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 07:41:57.378 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 07:41:57.378 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 07:41:57.378 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 07:41:57.378 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 07:41:57.378 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 07:41:57.378 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 07:41:57.378 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 07:41:57.378 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 07:41:57.378 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 07:41:57.378 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:41:57.378 1 ERROR oslo_service.service 
>2018-06-26 07:41:57.381 1 CRITICAL cinder [req-462cf3d9-764c-42b4-845f-38eaf11c8208 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 07:41:57.381 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 07:41:57.381 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 07:41:57.381 1 ERROR cinder     sys.exit(main())
>2018-06-26 07:41:57.381 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 07:41:57.381 1 ERROR cinder     service.wait()
>2018-06-26 07:41:57.381 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 07:41:57.381 1 ERROR cinder     _launcher.wait()
>2018-06-26 07:41:57.381 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 07:41:57.381 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 07:41:57.381 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 07:41:57.381 1 ERROR cinder     self.services.wait()
>2018-06-26 07:41:57.381 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 07:41:57.381 1 ERROR cinder     service.wait()
>2018-06-26 07:41:57.381 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 07:41:57.381 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 07:41:57.381 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 07:41:57.381 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 07:41:57.381 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 07:41:57.381 1 ERROR cinder     post_fn = fn()
>2018-06-26 07:41:57.381 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 07:41:57.381 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 07:41:57.381 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 07:41:57.381 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 07:41:57.381 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 07:41:57.381 1 ERROR cinder 
>2018-06-26 07:42:00.104 1 WARNING cinder.scheduler.host_manager [req-cf409c0d-e450-4ca0-a02d-b40395293512 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 07:42:00.110 1 INFO cinder.rpc [req-cf409c0d-e450-4ca0-a02d-b40395293512 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 07:42:00.123 1 INFO cinder.rpc [req-cf409c0d-e450-4ca0-a02d-b40395293512 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 07:42:00.141 1 INFO cinder.rpc [req-cf409c0d-e450-4ca0-a02d-b40395293512 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 07:42:00.149 1 INFO cinder.rpc [req-cf409c0d-e450-4ca0-a02d-b40395293512 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 07:42:00.173 1 WARNING oslo_config.cfg [req-cf409c0d-e450-4ca0-a02d-b40395293512 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 07:42:00.175 1 WARNING oslo_config.cfg [req-cf409c0d-e450-4ca0-a02d-b40395293512 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:42:00.176 1 WARNING oslo_config.cfg [req-cf409c0d-e450-4ca0-a02d-b40395293512 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:42:00.177 1 WARNING oslo_config.cfg [req-cf409c0d-e450-4ca0-a02d-b40395293512 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:42:00.182 1 WARNING oslo_config.cfg [req-cf409c0d-e450-4ca0-a02d-b40395293512 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 07:42:00.183 1 WARNING oslo_config.cfg [req-cf409c0d-e450-4ca0-a02d-b40395293512 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 07:42:00.186 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 07:42:00.192 1 INFO cinder.manager [req-ea83ca35-9655-4fad-a81e-d93fbfc06616 - - - - -] Initiating service 5 cleanup
>2018-06-26 07:42:00.197 1 INFO cinder.manager [req-ea83ca35-9655-4fad-a81e-d93fbfc06616 - - - - -] Service 5 cleanup completed.
>2018-06-26 07:44:12.823 1 ERROR oslo.messaging._drivers.impl_rabbit [req-ea83ca35-9655-4fad-a81e-d93fbfc06616 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:44:12.825 1 ERROR oslo.messaging._drivers.impl_rabbit [req-ea83ca35-9655-4fad-a81e-d93fbfc06616 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:44:12.826 1 ERROR oslo_service.service [req-ea83ca35-9655-4fad-a81e-d93fbfc06616 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:44:12.826 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 07:44:12.826 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 07:44:12.826 1 ERROR oslo_service.service     service.start()
>2018-06-26 07:44:12.826 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 07:44:12.826 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 07:44:12.826 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 07:44:12.826 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 07:44:12.826 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 07:44:12.826 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 07:44:12.826 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 07:44:12.826 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 07:44:12.826 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 07:44:12.826 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 07:44:12.826 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 07:44:12.826 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 07:44:12.826 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 07:44:12.826 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 07:44:12.826 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 07:44:12.826 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 07:44:12.826 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 07:44:12.826 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 07:44:12.826 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 07:44:12.826 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 07:44:12.826 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 07:44:12.826 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 07:44:12.826 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:44:12.826 1 ERROR oslo_service.service 
>2018-06-26 07:44:12.829 1 CRITICAL cinder [req-cf409c0d-e450-4ca0-a02d-b40395293512 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 07:44:12.829 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 07:44:12.829 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 07:44:12.829 1 ERROR cinder     sys.exit(main())
>2018-06-26 07:44:12.829 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 07:44:12.829 1 ERROR cinder     service.wait()
>2018-06-26 07:44:12.829 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 07:44:12.829 1 ERROR cinder     _launcher.wait()
>2018-06-26 07:44:12.829 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 07:44:12.829 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 07:44:12.829 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 07:44:12.829 1 ERROR cinder     self.services.wait()
>2018-06-26 07:44:12.829 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 07:44:12.829 1 ERROR cinder     service.wait()
>2018-06-26 07:44:12.829 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 07:44:12.829 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 07:44:12.829 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 07:44:12.829 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 07:44:12.829 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 07:44:12.829 1 ERROR cinder     post_fn = fn()
>2018-06-26 07:44:12.829 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 07:44:12.829 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 07:44:12.829 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 07:44:12.829 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 07:44:12.829 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 07:44:12.829 1 ERROR cinder 
>2018-06-26 07:44:15.520 1 WARNING cinder.scheduler.host_manager [req-906f815e-b0ba-4bf8-91b4-d9ff0ac8a70c - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 07:44:15.526 1 INFO cinder.rpc [req-906f815e-b0ba-4bf8-91b4-d9ff0ac8a70c - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 07:44:15.531 1 INFO cinder.rpc [req-906f815e-b0ba-4bf8-91b4-d9ff0ac8a70c - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 07:44:15.542 1 INFO cinder.rpc [req-906f815e-b0ba-4bf8-91b4-d9ff0ac8a70c - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 07:44:15.547 1 INFO cinder.rpc [req-906f815e-b0ba-4bf8-91b4-d9ff0ac8a70c - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 07:44:15.571 1 WARNING oslo_config.cfg [req-906f815e-b0ba-4bf8-91b4-d9ff0ac8a70c - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 07:44:15.573 1 WARNING oslo_config.cfg [req-906f815e-b0ba-4bf8-91b4-d9ff0ac8a70c - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:44:15.574 1 WARNING oslo_config.cfg [req-906f815e-b0ba-4bf8-91b4-d9ff0ac8a70c - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:44:15.574 1 WARNING oslo_config.cfg [req-906f815e-b0ba-4bf8-91b4-d9ff0ac8a70c - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:44:15.579 1 WARNING oslo_config.cfg [req-906f815e-b0ba-4bf8-91b4-d9ff0ac8a70c - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 07:44:15.581 1 WARNING oslo_config.cfg [req-906f815e-b0ba-4bf8-91b4-d9ff0ac8a70c - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 07:44:15.583 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 07:44:15.590 1 INFO cinder.manager [req-4bd85cd8-d0e2-4b69-9df6-8a397e83133d - - - - -] Initiating service 5 cleanup
>2018-06-26 07:44:15.594 1 INFO cinder.manager [req-4bd85cd8-d0e2-4b69-9df6-8a397e83133d - - - - -] Service 5 cleanup completed.
>2018-06-26 07:46:19.958 1 ERROR oslo.messaging._drivers.impl_rabbit [req-4bd85cd8-d0e2-4b69-9df6-8a397e83133d - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:46:19.960 1 ERROR oslo.messaging._drivers.impl_rabbit [req-4bd85cd8-d0e2-4b69-9df6-8a397e83133d - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:46:19.960 1 ERROR oslo_service.service [req-4bd85cd8-d0e2-4b69-9df6-8a397e83133d - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:46:19.960 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 07:46:19.960 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 07:46:19.960 1 ERROR oslo_service.service     service.start()
>2018-06-26 07:46:19.960 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 07:46:19.960 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 07:46:19.960 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 07:46:19.960 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 07:46:19.960 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 07:46:19.960 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 07:46:19.960 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 07:46:19.960 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 07:46:19.960 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 07:46:19.960 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 07:46:19.960 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 07:46:19.960 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 07:46:19.960 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 07:46:19.960 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 07:46:19.960 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 07:46:19.960 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 07:46:19.960 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 07:46:19.960 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 07:46:19.960 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 07:46:19.960 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 07:46:19.960 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 07:46:19.960 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 07:46:19.960 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:46:19.960 1 ERROR oslo_service.service 
>2018-06-26 07:46:19.963 1 CRITICAL cinder [req-906f815e-b0ba-4bf8-91b4-d9ff0ac8a70c - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 07:46:19.963 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 07:46:19.963 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 07:46:19.963 1 ERROR cinder     sys.exit(main())
>2018-06-26 07:46:19.963 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 07:46:19.963 1 ERROR cinder     service.wait()
>2018-06-26 07:46:19.963 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 07:46:19.963 1 ERROR cinder     _launcher.wait()
>2018-06-26 07:46:19.963 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 07:46:19.963 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 07:46:19.963 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 07:46:19.963 1 ERROR cinder     self.services.wait()
>2018-06-26 07:46:19.963 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 07:46:19.963 1 ERROR cinder     service.wait()
>2018-06-26 07:46:19.963 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 07:46:19.963 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 07:46:19.963 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 07:46:19.963 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 07:46:19.963 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 07:46:19.963 1 ERROR cinder     post_fn = fn()
>2018-06-26 07:46:19.963 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 07:46:19.963 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 07:46:19.963 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 07:46:19.963 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 07:46:19.963 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 07:46:19.963 1 ERROR cinder 
>2018-06-26 07:46:22.637 1 WARNING cinder.scheduler.host_manager [req-0eabc0be-6d54-4935-a3f2-d8d0fb35d3ff - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 07:46:22.643 1 INFO cinder.rpc [req-0eabc0be-6d54-4935-a3f2-d8d0fb35d3ff - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 07:46:22.649 1 INFO cinder.rpc [req-0eabc0be-6d54-4935-a3f2-d8d0fb35d3ff - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 07:46:22.663 1 INFO cinder.rpc [req-0eabc0be-6d54-4935-a3f2-d8d0fb35d3ff - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 07:46:22.668 1 INFO cinder.rpc [req-0eabc0be-6d54-4935-a3f2-d8d0fb35d3ff - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 07:46:22.694 1 WARNING oslo_config.cfg [req-0eabc0be-6d54-4935-a3f2-d8d0fb35d3ff - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 07:46:22.697 1 WARNING oslo_config.cfg [req-0eabc0be-6d54-4935-a3f2-d8d0fb35d3ff - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:46:22.697 1 WARNING oslo_config.cfg [req-0eabc0be-6d54-4935-a3f2-d8d0fb35d3ff - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:46:22.698 1 WARNING oslo_config.cfg [req-0eabc0be-6d54-4935-a3f2-d8d0fb35d3ff - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:46:22.704 1 WARNING oslo_config.cfg [req-0eabc0be-6d54-4935-a3f2-d8d0fb35d3ff - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 07:46:22.705 1 WARNING oslo_config.cfg [req-0eabc0be-6d54-4935-a3f2-d8d0fb35d3ff - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 07:46:22.708 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 07:46:22.716 1 INFO cinder.manager [req-40b58e08-3d74-4c97-8c50-34c6ad1aa7ee - - - - -] Initiating service 5 cleanup
>2018-06-26 07:46:22.720 1 INFO cinder.manager [req-40b58e08-3d74-4c97-8c50-34c6ad1aa7ee - - - - -] Service 5 cleanup completed.
>2018-06-26 07:48:27.111 1 ERROR oslo.messaging._drivers.impl_rabbit [req-40b58e08-3d74-4c97-8c50-34c6ad1aa7ee - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:48:27.113 1 ERROR oslo.messaging._drivers.impl_rabbit [req-40b58e08-3d74-4c97-8c50-34c6ad1aa7ee - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:48:27.113 1 ERROR oslo_service.service [req-40b58e08-3d74-4c97-8c50-34c6ad1aa7ee - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:48:27.113 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 07:48:27.113 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 07:48:27.113 1 ERROR oslo_service.service     service.start()
>2018-06-26 07:48:27.113 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 07:48:27.113 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 07:48:27.113 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 07:48:27.113 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 07:48:27.113 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 07:48:27.113 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 07:48:27.113 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 07:48:27.113 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 07:48:27.113 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 07:48:27.113 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 07:48:27.113 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 07:48:27.113 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 07:48:27.113 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 07:48:27.113 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 07:48:27.113 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 07:48:27.113 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 07:48:27.113 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 07:48:27.113 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 07:48:27.113 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 07:48:27.113 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 07:48:27.113 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 07:48:27.113 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 07:48:27.113 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:48:27.113 1 ERROR oslo_service.service 
>2018-06-26 07:48:27.116 1 CRITICAL cinder [req-0eabc0be-6d54-4935-a3f2-d8d0fb35d3ff - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 07:48:27.116 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 07:48:27.116 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 07:48:27.116 1 ERROR cinder     sys.exit(main())
>2018-06-26 07:48:27.116 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 07:48:27.116 1 ERROR cinder     service.wait()
>2018-06-26 07:48:27.116 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 07:48:27.116 1 ERROR cinder     _launcher.wait()
>2018-06-26 07:48:27.116 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 07:48:27.116 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 07:48:27.116 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 07:48:27.116 1 ERROR cinder     self.services.wait()
>2018-06-26 07:48:27.116 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 07:48:27.116 1 ERROR cinder     service.wait()
>2018-06-26 07:48:27.116 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 07:48:27.116 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 07:48:27.116 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 07:48:27.116 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 07:48:27.116 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 07:48:27.116 1 ERROR cinder     post_fn = fn()
>2018-06-26 07:48:27.116 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 07:48:27.116 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 07:48:27.116 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 07:48:27.116 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 07:48:27.116 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 07:48:27.116 1 ERROR cinder 
>2018-06-26 07:48:29.815 1 WARNING cinder.scheduler.host_manager [req-5945eb63-4f07-4cfb-9ac3-3d1abdeca8d4 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 07:48:29.821 1 INFO cinder.rpc [req-5945eb63-4f07-4cfb-9ac3-3d1abdeca8d4 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 07:48:29.827 1 INFO cinder.rpc [req-5945eb63-4f07-4cfb-9ac3-3d1abdeca8d4 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 07:48:29.849 1 INFO cinder.rpc [req-5945eb63-4f07-4cfb-9ac3-3d1abdeca8d4 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 07:48:29.857 1 INFO cinder.rpc [req-5945eb63-4f07-4cfb-9ac3-3d1abdeca8d4 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 07:48:29.885 1 WARNING oslo_config.cfg [req-5945eb63-4f07-4cfb-9ac3-3d1abdeca8d4 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 07:48:29.887 1 WARNING oslo_config.cfg [req-5945eb63-4f07-4cfb-9ac3-3d1abdeca8d4 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:48:29.887 1 WARNING oslo_config.cfg [req-5945eb63-4f07-4cfb-9ac3-3d1abdeca8d4 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:48:29.888 1 WARNING oslo_config.cfg [req-5945eb63-4f07-4cfb-9ac3-3d1abdeca8d4 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:48:29.893 1 WARNING oslo_config.cfg [req-5945eb63-4f07-4cfb-9ac3-3d1abdeca8d4 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 07:48:29.894 1 WARNING oslo_config.cfg [req-5945eb63-4f07-4cfb-9ac3-3d1abdeca8d4 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 07:48:29.896 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 07:48:29.902 1 INFO cinder.manager [req-00f4806d-66a4-4046-8f62-22ba1f7a1e6e - - - - -] Initiating service 5 cleanup
>2018-06-26 07:48:29.907 1 INFO cinder.manager [req-00f4806d-66a4-4046-8f62-22ba1f7a1e6e - - - - -] Service 5 cleanup completed.
>2018-06-26 07:50:36.041 1 ERROR oslo.messaging._drivers.impl_rabbit [req-00f4806d-66a4-4046-8f62-22ba1f7a1e6e - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:50:36.043 1 ERROR oslo.messaging._drivers.impl_rabbit [req-00f4806d-66a4-4046-8f62-22ba1f7a1e6e - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:50:36.043 1 ERROR oslo_service.service [req-00f4806d-66a4-4046-8f62-22ba1f7a1e6e - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:50:36.043 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 07:50:36.043 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 07:50:36.043 1 ERROR oslo_service.service     service.start()
>2018-06-26 07:50:36.043 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 07:50:36.043 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 07:50:36.043 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 07:50:36.043 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 07:50:36.043 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 07:50:36.043 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 07:50:36.043 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 07:50:36.043 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 07:50:36.043 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 07:50:36.043 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 07:50:36.043 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 07:50:36.043 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 07:50:36.043 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 07:50:36.043 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 07:50:36.043 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 07:50:36.043 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 07:50:36.043 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 07:50:36.043 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 07:50:36.043 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 07:50:36.043 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 07:50:36.043 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 07:50:36.043 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 07:50:36.043 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:50:36.043 1 ERROR oslo_service.service 
>2018-06-26 07:50:36.047 1 CRITICAL cinder [req-5945eb63-4f07-4cfb-9ac3-3d1abdeca8d4 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 07:50:36.047 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 07:50:36.047 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 07:50:36.047 1 ERROR cinder     sys.exit(main())
>2018-06-26 07:50:36.047 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 07:50:36.047 1 ERROR cinder     service.wait()
>2018-06-26 07:50:36.047 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 07:50:36.047 1 ERROR cinder     _launcher.wait()
>2018-06-26 07:50:36.047 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 07:50:36.047 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 07:50:36.047 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 07:50:36.047 1 ERROR cinder     self.services.wait()
>2018-06-26 07:50:36.047 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 07:50:36.047 1 ERROR cinder     service.wait()
>2018-06-26 07:50:36.047 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 07:50:36.047 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 07:50:36.047 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 07:50:36.047 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 07:50:36.047 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 07:50:36.047 1 ERROR cinder     post_fn = fn()
>2018-06-26 07:50:36.047 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 07:50:36.047 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 07:50:36.047 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 07:50:36.047 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 07:50:36.047 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 07:50:36.047 1 ERROR cinder 
>2018-06-26 07:50:38.790 1 WARNING cinder.scheduler.host_manager [req-3c642f76-4225-4756-bd2a-b3bc95987119 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 07:50:38.795 1 INFO cinder.rpc [req-3c642f76-4225-4756-bd2a-b3bc95987119 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 07:50:38.801 1 INFO cinder.rpc [req-3c642f76-4225-4756-bd2a-b3bc95987119 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 07:50:38.811 1 INFO cinder.rpc [req-3c642f76-4225-4756-bd2a-b3bc95987119 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 07:50:38.818 1 INFO cinder.rpc [req-3c642f76-4225-4756-bd2a-b3bc95987119 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 07:50:38.841 1 WARNING oslo_config.cfg [req-3c642f76-4225-4756-bd2a-b3bc95987119 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 07:50:38.843 1 WARNING oslo_config.cfg [req-3c642f76-4225-4756-bd2a-b3bc95987119 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:50:38.844 1 WARNING oslo_config.cfg [req-3c642f76-4225-4756-bd2a-b3bc95987119 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:50:38.844 1 WARNING oslo_config.cfg [req-3c642f76-4225-4756-bd2a-b3bc95987119 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:50:38.850 1 WARNING oslo_config.cfg [req-3c642f76-4225-4756-bd2a-b3bc95987119 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 07:50:38.851 1 WARNING oslo_config.cfg [req-3c642f76-4225-4756-bd2a-b3bc95987119 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 07:50:38.854 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 07:50:38.860 1 INFO cinder.manager [req-14155b4f-5263-4f8c-8953-4c5cffbd61e0 - - - - -] Initiating service 5 cleanup
>2018-06-26 07:50:38.864 1 INFO cinder.manager [req-14155b4f-5263-4f8c-8953-4c5cffbd61e0 - - - - -] Service 5 cleanup completed.
>2018-06-26 07:52:45.121 1 ERROR oslo.messaging._drivers.impl_rabbit [req-14155b4f-5263-4f8c-8953-4c5cffbd61e0 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:52:45.123 1 ERROR oslo.messaging._drivers.impl_rabbit [req-14155b4f-5263-4f8c-8953-4c5cffbd61e0 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:52:45.123 1 ERROR oslo_service.service [req-14155b4f-5263-4f8c-8953-4c5cffbd61e0 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:52:45.123 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 07:52:45.123 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 07:52:45.123 1 ERROR oslo_service.service     service.start()
>2018-06-26 07:52:45.123 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 07:52:45.123 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 07:52:45.123 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 07:52:45.123 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 07:52:45.123 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 07:52:45.123 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 07:52:45.123 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 07:52:45.123 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 07:52:45.123 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 07:52:45.123 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 07:52:45.123 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 07:52:45.123 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 07:52:45.123 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 07:52:45.123 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 07:52:45.123 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 07:52:45.123 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 07:52:45.123 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 07:52:45.123 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 07:52:45.123 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 07:52:45.123 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 07:52:45.123 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 07:52:45.123 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 07:52:45.123 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:52:45.123 1 ERROR oslo_service.service 
>2018-06-26 07:52:45.126 1 CRITICAL cinder [req-3c642f76-4225-4756-bd2a-b3bc95987119 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 07:52:45.126 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 07:52:45.126 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 07:52:45.126 1 ERROR cinder     sys.exit(main())
>2018-06-26 07:52:45.126 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 07:52:45.126 1 ERROR cinder     service.wait()
>2018-06-26 07:52:45.126 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 07:52:45.126 1 ERROR cinder     _launcher.wait()
>2018-06-26 07:52:45.126 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 07:52:45.126 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 07:52:45.126 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 07:52:45.126 1 ERROR cinder     self.services.wait()
>2018-06-26 07:52:45.126 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 07:52:45.126 1 ERROR cinder     service.wait()
>2018-06-26 07:52:45.126 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 07:52:45.126 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 07:52:45.126 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 07:52:45.126 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 07:52:45.126 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 07:52:45.126 1 ERROR cinder     post_fn = fn()
>2018-06-26 07:52:45.126 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 07:52:45.126 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 07:52:45.126 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 07:52:45.126 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 07:52:45.126 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 07:52:45.126 1 ERROR cinder 
>2018-06-26 07:52:47.845 1 WARNING cinder.scheduler.host_manager [req-3cce9963-fddc-4f70-b7a9-e36dd26bff3f - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 07:52:47.851 1 INFO cinder.rpc [req-3cce9963-fddc-4f70-b7a9-e36dd26bff3f - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 07:52:47.857 1 INFO cinder.rpc [req-3cce9963-fddc-4f70-b7a9-e36dd26bff3f - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 07:52:47.867 1 INFO cinder.rpc [req-3cce9963-fddc-4f70-b7a9-e36dd26bff3f - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 07:52:47.873 1 INFO cinder.rpc [req-3cce9963-fddc-4f70-b7a9-e36dd26bff3f - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 07:52:47.898 1 WARNING oslo_config.cfg [req-3cce9963-fddc-4f70-b7a9-e36dd26bff3f - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 07:52:47.900 1 WARNING oslo_config.cfg [req-3cce9963-fddc-4f70-b7a9-e36dd26bff3f - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:52:47.900 1 WARNING oslo_config.cfg [req-3cce9963-fddc-4f70-b7a9-e36dd26bff3f - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:52:47.901 1 WARNING oslo_config.cfg [req-3cce9963-fddc-4f70-b7a9-e36dd26bff3f - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:52:47.906 1 WARNING oslo_config.cfg [req-3cce9963-fddc-4f70-b7a9-e36dd26bff3f - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 07:52:47.908 1 WARNING oslo_config.cfg [req-3cce9963-fddc-4f70-b7a9-e36dd26bff3f - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 07:52:47.910 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 07:52:47.916 1 INFO cinder.manager [req-47533d5d-162b-48c1-aaec-e736cc8dbe00 - - - - -] Initiating service 5 cleanup
>2018-06-26 07:52:47.920 1 INFO cinder.manager [req-47533d5d-162b-48c1-aaec-e736cc8dbe00 - - - - -] Service 5 cleanup completed.
>2018-06-26 07:54:59.700 1 ERROR oslo.messaging._drivers.impl_rabbit [req-47533d5d-162b-48c1-aaec-e736cc8dbe00 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:54:59.702 1 ERROR oslo.messaging._drivers.impl_rabbit [req-47533d5d-162b-48c1-aaec-e736cc8dbe00 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:54:59.703 1 ERROR oslo_service.service [req-47533d5d-162b-48c1-aaec-e736cc8dbe00 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:54:59.703 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 07:54:59.703 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 07:54:59.703 1 ERROR oslo_service.service     service.start()
>2018-06-26 07:54:59.703 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 07:54:59.703 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 07:54:59.703 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 07:54:59.703 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 07:54:59.703 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 07:54:59.703 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 07:54:59.703 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 07:54:59.703 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 07:54:59.703 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 07:54:59.703 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 07:54:59.703 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 07:54:59.703 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 07:54:59.703 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 07:54:59.703 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 07:54:59.703 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 07:54:59.703 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 07:54:59.703 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 07:54:59.703 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 07:54:59.703 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 07:54:59.703 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 07:54:59.703 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 07:54:59.703 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 07:54:59.703 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:54:59.703 1 ERROR oslo_service.service 
>2018-06-26 07:54:59.707 1 CRITICAL cinder [req-3cce9963-fddc-4f70-b7a9-e36dd26bff3f - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 07:54:59.707 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 07:54:59.707 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 07:54:59.707 1 ERROR cinder     sys.exit(main())
>2018-06-26 07:54:59.707 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 07:54:59.707 1 ERROR cinder     service.wait()
>2018-06-26 07:54:59.707 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 07:54:59.707 1 ERROR cinder     _launcher.wait()
>2018-06-26 07:54:59.707 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 07:54:59.707 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 07:54:59.707 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 07:54:59.707 1 ERROR cinder     self.services.wait()
>2018-06-26 07:54:59.707 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 07:54:59.707 1 ERROR cinder     service.wait()
>2018-06-26 07:54:59.707 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 07:54:59.707 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 07:54:59.707 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 07:54:59.707 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 07:54:59.707 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 07:54:59.707 1 ERROR cinder     post_fn = fn()
>2018-06-26 07:54:59.707 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 07:54:59.707 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 07:54:59.707 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 07:54:59.707 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 07:54:59.707 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 07:54:59.707 1 ERROR cinder 
>2018-06-26 07:55:02.509 1 WARNING cinder.scheduler.host_manager [req-7be19361-48ee-4eda-ae1a-ae0c900ec2fd - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 07:55:02.515 1 INFO cinder.rpc [req-7be19361-48ee-4eda-ae1a-ae0c900ec2fd - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 07:55:02.520 1 INFO cinder.rpc [req-7be19361-48ee-4eda-ae1a-ae0c900ec2fd - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 07:55:02.533 1 INFO cinder.rpc [req-7be19361-48ee-4eda-ae1a-ae0c900ec2fd - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 07:55:02.539 1 INFO cinder.rpc [req-7be19361-48ee-4eda-ae1a-ae0c900ec2fd - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 07:55:02.561 1 WARNING oslo_config.cfg [req-7be19361-48ee-4eda-ae1a-ae0c900ec2fd - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 07:55:02.563 1 WARNING oslo_config.cfg [req-7be19361-48ee-4eda-ae1a-ae0c900ec2fd - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:55:02.564 1 WARNING oslo_config.cfg [req-7be19361-48ee-4eda-ae1a-ae0c900ec2fd - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:55:02.565 1 WARNING oslo_config.cfg [req-7be19361-48ee-4eda-ae1a-ae0c900ec2fd - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:55:02.570 1 WARNING oslo_config.cfg [req-7be19361-48ee-4eda-ae1a-ae0c900ec2fd - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 07:55:02.571 1 WARNING oslo_config.cfg [req-7be19361-48ee-4eda-ae1a-ae0c900ec2fd - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 07:55:02.573 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 07:55:02.579 1 INFO cinder.manager [req-ebdb09d5-37ec-4b10-ba42-4925151a35e4 - - - - -] Initiating service 5 cleanup
>2018-06-26 07:55:02.583 1 INFO cinder.manager [req-ebdb09d5-37ec-4b10-ba42-4925151a35e4 - - - - -] Service 5 cleanup completed.
>2018-06-26 07:57:08.715 1 ERROR oslo.messaging._drivers.impl_rabbit [req-ebdb09d5-37ec-4b10-ba42-4925151a35e4 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:57:08.717 1 ERROR oslo.messaging._drivers.impl_rabbit [req-ebdb09d5-37ec-4b10-ba42-4925151a35e4 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:57:08.717 1 ERROR oslo_service.service [req-ebdb09d5-37ec-4b10-ba42-4925151a35e4 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:57:08.717 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 07:57:08.717 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 07:57:08.717 1 ERROR oslo_service.service     service.start()
>2018-06-26 07:57:08.717 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 07:57:08.717 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 07:57:08.717 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 07:57:08.717 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 07:57:08.717 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 07:57:08.717 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 07:57:08.717 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 07:57:08.717 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 07:57:08.717 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 07:57:08.717 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 07:57:08.717 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 07:57:08.717 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 07:57:08.717 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 07:57:08.717 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 07:57:08.717 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 07:57:08.717 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 07:57:08.717 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 07:57:08.717 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 07:57:08.717 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 07:57:08.717 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 07:57:08.717 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 07:57:08.717 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 07:57:08.717 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:57:08.717 1 ERROR oslo_service.service 
>2018-06-26 07:57:08.720 1 CRITICAL cinder [req-7be19361-48ee-4eda-ae1a-ae0c900ec2fd - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 07:57:08.720 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 07:57:08.720 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 07:57:08.720 1 ERROR cinder     sys.exit(main())
>2018-06-26 07:57:08.720 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 07:57:08.720 1 ERROR cinder     service.wait()
>2018-06-26 07:57:08.720 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 07:57:08.720 1 ERROR cinder     _launcher.wait()
>2018-06-26 07:57:08.720 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 07:57:08.720 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 07:57:08.720 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 07:57:08.720 1 ERROR cinder     self.services.wait()
>2018-06-26 07:57:08.720 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 07:57:08.720 1 ERROR cinder     service.wait()
>2018-06-26 07:57:08.720 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 07:57:08.720 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 07:57:08.720 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 07:57:08.720 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 07:57:08.720 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 07:57:08.720 1 ERROR cinder     post_fn = fn()
>2018-06-26 07:57:08.720 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 07:57:08.720 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 07:57:08.720 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 07:57:08.720 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 07:57:08.720 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 07:57:08.720 1 ERROR cinder 
>2018-06-26 07:57:11.346 1 WARNING cinder.scheduler.host_manager [req-26d54986-625f-45f9-97c0-bd0057b571ab - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 07:57:11.351 1 INFO cinder.rpc [req-26d54986-625f-45f9-97c0-bd0057b571ab - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 07:57:11.359 1 INFO cinder.rpc [req-26d54986-625f-45f9-97c0-bd0057b571ab - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 07:57:11.372 1 INFO cinder.rpc [req-26d54986-625f-45f9-97c0-bd0057b571ab - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 07:57:11.380 1 INFO cinder.rpc [req-26d54986-625f-45f9-97c0-bd0057b571ab - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 07:57:11.405 1 WARNING oslo_config.cfg [req-26d54986-625f-45f9-97c0-bd0057b571ab - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 07:57:11.407 1 WARNING oslo_config.cfg [req-26d54986-625f-45f9-97c0-bd0057b571ab - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:57:11.408 1 WARNING oslo_config.cfg [req-26d54986-625f-45f9-97c0-bd0057b571ab - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:57:11.408 1 WARNING oslo_config.cfg [req-26d54986-625f-45f9-97c0-bd0057b571ab - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:57:11.413 1 WARNING oslo_config.cfg [req-26d54986-625f-45f9-97c0-bd0057b571ab - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 07:57:11.414 1 WARNING oslo_config.cfg [req-26d54986-625f-45f9-97c0-bd0057b571ab - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 07:57:11.417 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 07:57:11.423 1 INFO cinder.manager [req-05992202-ddb3-4ef9-83c0-652c93517534 - - - - -] Initiating service 5 cleanup
>2018-06-26 07:57:11.428 1 INFO cinder.manager [req-05992202-ddb3-4ef9-83c0-652c93517534 - - - - -] Service 5 cleanup completed.
>2018-06-26 07:59:23.093 1 ERROR oslo.messaging._drivers.impl_rabbit [req-05992202-ddb3-4ef9-83c0-652c93517534 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:59:23.094 1 ERROR oslo.messaging._drivers.impl_rabbit [req-05992202-ddb3-4ef9-83c0-652c93517534 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:59:23.095 1 ERROR oslo_service.service [req-05992202-ddb3-4ef9-83c0-652c93517534 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:59:23.095 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 07:59:23.095 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 07:59:23.095 1 ERROR oslo_service.service     service.start()
>2018-06-26 07:59:23.095 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 07:59:23.095 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 07:59:23.095 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 07:59:23.095 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 07:59:23.095 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 07:59:23.095 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 07:59:23.095 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 07:59:23.095 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 07:59:23.095 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 07:59:23.095 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 07:59:23.095 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 07:59:23.095 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 07:59:23.095 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 07:59:23.095 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 07:59:23.095 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 07:59:23.095 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 07:59:23.095 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 07:59:23.095 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 07:59:23.095 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 07:59:23.095 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 07:59:23.095 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 07:59:23.095 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 07:59:23.095 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 07:59:23.095 1 ERROR oslo_service.service 
>2018-06-26 07:59:23.097 1 CRITICAL cinder [req-26d54986-625f-45f9-97c0-bd0057b571ab - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 07:59:23.097 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 07:59:23.097 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 07:59:23.097 1 ERROR cinder     sys.exit(main())
>2018-06-26 07:59:23.097 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 07:59:23.097 1 ERROR cinder     service.wait()
>2018-06-26 07:59:23.097 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 07:59:23.097 1 ERROR cinder     _launcher.wait()
>2018-06-26 07:59:23.097 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 07:59:23.097 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 07:59:23.097 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 07:59:23.097 1 ERROR cinder     self.services.wait()
>2018-06-26 07:59:23.097 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 07:59:23.097 1 ERROR cinder     service.wait()
>2018-06-26 07:59:23.097 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 07:59:23.097 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 07:59:23.097 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 07:59:23.097 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 07:59:23.097 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 07:59:23.097 1 ERROR cinder     post_fn = fn()
>2018-06-26 07:59:23.097 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 07:59:23.097 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 07:59:23.097 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 07:59:23.097 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 07:59:23.097 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 07:59:23.097 1 ERROR cinder 
>2018-06-26 07:59:25.710 1 WARNING cinder.scheduler.host_manager [req-d38de6b3-b16f-4624-ac8e-16963de8182e - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 07:59:25.717 1 INFO cinder.rpc [req-d38de6b3-b16f-4624-ac8e-16963de8182e - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 07:59:25.723 1 INFO cinder.rpc [req-d38de6b3-b16f-4624-ac8e-16963de8182e - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 07:59:25.733 1 INFO cinder.rpc [req-d38de6b3-b16f-4624-ac8e-16963de8182e - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 07:59:25.738 1 INFO cinder.rpc [req-d38de6b3-b16f-4624-ac8e-16963de8182e - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 07:59:25.763 1 WARNING oslo_config.cfg [req-d38de6b3-b16f-4624-ac8e-16963de8182e - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 07:59:25.765 1 WARNING oslo_config.cfg [req-d38de6b3-b16f-4624-ac8e-16963de8182e - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:59:25.766 1 WARNING oslo_config.cfg [req-d38de6b3-b16f-4624-ac8e-16963de8182e - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:59:25.766 1 WARNING oslo_config.cfg [req-d38de6b3-b16f-4624-ac8e-16963de8182e - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 07:59:25.771 1 WARNING oslo_config.cfg [req-d38de6b3-b16f-4624-ac8e-16963de8182e - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 07:59:25.772 1 WARNING oslo_config.cfg [req-d38de6b3-b16f-4624-ac8e-16963de8182e - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 07:59:25.775 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 07:59:25.782 1 INFO cinder.manager [req-f5324877-7123-4a34-a913-3a6d03d0bfd5 - - - - -] Initiating service 5 cleanup
>2018-06-26 07:59:25.789 1 INFO cinder.manager [req-f5324877-7123-4a34-a913-3a6d03d0bfd5 - - - - -] Service 5 cleanup completed.
>2018-06-26 08:01:30.157 1 ERROR oslo.messaging._drivers.impl_rabbit [req-f5324877-7123-4a34-a913-3a6d03d0bfd5 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:01:30.159 1 ERROR oslo.messaging._drivers.impl_rabbit [req-f5324877-7123-4a34-a913-3a6d03d0bfd5 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:01:30.160 1 ERROR oslo_service.service [req-f5324877-7123-4a34-a913-3a6d03d0bfd5 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:01:30.160 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 08:01:30.160 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 08:01:30.160 1 ERROR oslo_service.service     service.start()
>2018-06-26 08:01:30.160 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 08:01:30.160 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 08:01:30.160 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 08:01:30.160 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 08:01:30.160 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 08:01:30.160 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 08:01:30.160 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 08:01:30.160 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 08:01:30.160 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 08:01:30.160 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 08:01:30.160 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 08:01:30.160 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 08:01:30.160 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 08:01:30.160 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 08:01:30.160 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 08:01:30.160 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 08:01:30.160 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 08:01:30.160 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 08:01:30.160 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 08:01:30.160 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 08:01:30.160 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 08:01:30.160 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 08:01:30.160 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:01:30.160 1 ERROR oslo_service.service 
>2018-06-26 08:01:30.164 1 CRITICAL cinder [req-d38de6b3-b16f-4624-ac8e-16963de8182e - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 08:01:30.164 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 08:01:30.164 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 08:01:30.164 1 ERROR cinder     sys.exit(main())
>2018-06-26 08:01:30.164 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 08:01:30.164 1 ERROR cinder     service.wait()
>2018-06-26 08:01:30.164 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 08:01:30.164 1 ERROR cinder     _launcher.wait()
>2018-06-26 08:01:30.164 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 08:01:30.164 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 08:01:30.164 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 08:01:30.164 1 ERROR cinder     self.services.wait()
>2018-06-26 08:01:30.164 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 08:01:30.164 1 ERROR cinder     service.wait()
>2018-06-26 08:01:30.164 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 08:01:30.164 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 08:01:30.164 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 08:01:30.164 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 08:01:30.164 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 08:01:30.164 1 ERROR cinder     post_fn = fn()
>2018-06-26 08:01:30.164 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 08:01:30.164 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 08:01:30.164 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 08:01:30.164 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 08:01:30.164 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 08:01:30.164 1 ERROR cinder 
>2018-06-26 08:01:32.780 1 WARNING cinder.scheduler.host_manager [req-86d04d43-8694-4339-a5bf-4c1a3285d8b9 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 08:01:32.785 1 INFO cinder.rpc [req-86d04d43-8694-4339-a5bf-4c1a3285d8b9 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 08:01:32.790 1 INFO cinder.rpc [req-86d04d43-8694-4339-a5bf-4c1a3285d8b9 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 08:01:32.802 1 INFO cinder.rpc [req-86d04d43-8694-4339-a5bf-4c1a3285d8b9 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 08:01:32.807 1 INFO cinder.rpc [req-86d04d43-8694-4339-a5bf-4c1a3285d8b9 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 08:01:32.836 1 WARNING oslo_config.cfg [req-86d04d43-8694-4339-a5bf-4c1a3285d8b9 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 08:01:32.838 1 WARNING oslo_config.cfg [req-86d04d43-8694-4339-a5bf-4c1a3285d8b9 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:01:32.839 1 WARNING oslo_config.cfg [req-86d04d43-8694-4339-a5bf-4c1a3285d8b9 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:01:32.839 1 WARNING oslo_config.cfg [req-86d04d43-8694-4339-a5bf-4c1a3285d8b9 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:01:32.844 1 WARNING oslo_config.cfg [req-86d04d43-8694-4339-a5bf-4c1a3285d8b9 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 08:01:32.845 1 WARNING oslo_config.cfg [req-86d04d43-8694-4339-a5bf-4c1a3285d8b9 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 08:01:32.848 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 08:01:32.853 1 INFO cinder.manager [req-b3d58c31-5238-4446-9285-c36955ce04c8 - - - - -] Initiating service 5 cleanup
>2018-06-26 08:01:32.859 1 INFO cinder.manager [req-b3d58c31-5238-4446-9285-c36955ce04c8 - - - - -] Service 5 cleanup completed.
>2018-06-26 08:03:37.265 1 ERROR oslo.messaging._drivers.impl_rabbit [req-b3d58c31-5238-4446-9285-c36955ce04c8 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:03:37.267 1 ERROR oslo.messaging._drivers.impl_rabbit [req-b3d58c31-5238-4446-9285-c36955ce04c8 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:03:37.268 1 ERROR oslo_service.service [req-b3d58c31-5238-4446-9285-c36955ce04c8 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:03:37.268 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 08:03:37.268 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 08:03:37.268 1 ERROR oslo_service.service     service.start()
>2018-06-26 08:03:37.268 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 08:03:37.268 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 08:03:37.268 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 08:03:37.268 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 08:03:37.268 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 08:03:37.268 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 08:03:37.268 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 08:03:37.268 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 08:03:37.268 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 08:03:37.268 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 08:03:37.268 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 08:03:37.268 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 08:03:37.268 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 08:03:37.268 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 08:03:37.268 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 08:03:37.268 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 08:03:37.268 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 08:03:37.268 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 08:03:37.268 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 08:03:37.268 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 08:03:37.268 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 08:03:37.268 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 08:03:37.268 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:03:37.268 1 ERROR oslo_service.service 
>2018-06-26 08:03:37.270 1 CRITICAL cinder [req-86d04d43-8694-4339-a5bf-4c1a3285d8b9 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 08:03:37.270 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 08:03:37.270 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 08:03:37.270 1 ERROR cinder     sys.exit(main())
>2018-06-26 08:03:37.270 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 08:03:37.270 1 ERROR cinder     service.wait()
>2018-06-26 08:03:37.270 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 08:03:37.270 1 ERROR cinder     _launcher.wait()
>2018-06-26 08:03:37.270 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 08:03:37.270 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 08:03:37.270 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 08:03:37.270 1 ERROR cinder     self.services.wait()
>2018-06-26 08:03:37.270 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 08:03:37.270 1 ERROR cinder     service.wait()
>2018-06-26 08:03:37.270 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 08:03:37.270 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 08:03:37.270 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 08:03:37.270 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 08:03:37.270 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 08:03:37.270 1 ERROR cinder     post_fn = fn()
>2018-06-26 08:03:37.270 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 08:03:37.270 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 08:03:37.270 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 08:03:37.270 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 08:03:37.270 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 08:03:37.270 1 ERROR cinder 
>2018-06-26 08:03:39.847 1 WARNING cinder.scheduler.host_manager [req-8716f922-b671-4a1b-9461-38a72a67a4d3 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 08:03:39.854 1 INFO cinder.rpc [req-8716f922-b671-4a1b-9461-38a72a67a4d3 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 08:03:39.860 1 INFO cinder.rpc [req-8716f922-b671-4a1b-9461-38a72a67a4d3 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 08:03:39.871 1 INFO cinder.rpc [req-8716f922-b671-4a1b-9461-38a72a67a4d3 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 08:03:39.877 1 INFO cinder.rpc [req-8716f922-b671-4a1b-9461-38a72a67a4d3 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 08:03:39.898 1 WARNING oslo_config.cfg [req-8716f922-b671-4a1b-9461-38a72a67a4d3 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 08:03:39.900 1 WARNING oslo_config.cfg [req-8716f922-b671-4a1b-9461-38a72a67a4d3 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:03:39.901 1 WARNING oslo_config.cfg [req-8716f922-b671-4a1b-9461-38a72a67a4d3 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:03:39.902 1 WARNING oslo_config.cfg [req-8716f922-b671-4a1b-9461-38a72a67a4d3 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:03:39.907 1 WARNING oslo_config.cfg [req-8716f922-b671-4a1b-9461-38a72a67a4d3 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 08:03:39.908 1 WARNING oslo_config.cfg [req-8716f922-b671-4a1b-9461-38a72a67a4d3 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 08:03:39.911 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 08:03:39.917 1 INFO cinder.manager [req-839c9a03-d728-48f0-8964-14cb5d364dd9 - - - - -] Initiating service 5 cleanup
>2018-06-26 08:03:39.922 1 INFO cinder.manager [req-839c9a03-d728-48f0-8964-14cb5d364dd9 - - - - -] Service 5 cleanup completed.
>2018-06-26 08:05:51.832 1 ERROR oslo.messaging._drivers.impl_rabbit [req-839c9a03-d728-48f0-8964-14cb5d364dd9 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:05:51.834 1 ERROR oslo.messaging._drivers.impl_rabbit [req-839c9a03-d728-48f0-8964-14cb5d364dd9 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:05:51.834 1 ERROR oslo_service.service [req-839c9a03-d728-48f0-8964-14cb5d364dd9 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:05:51.834 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 08:05:51.834 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 08:05:51.834 1 ERROR oslo_service.service     service.start()
>2018-06-26 08:05:51.834 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 08:05:51.834 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 08:05:51.834 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 08:05:51.834 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 08:05:51.834 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 08:05:51.834 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 08:05:51.834 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 08:05:51.834 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 08:05:51.834 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 08:05:51.834 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 08:05:51.834 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 08:05:51.834 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 08:05:51.834 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 08:05:51.834 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 08:05:51.834 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 08:05:51.834 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 08:05:51.834 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 08:05:51.834 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 08:05:51.834 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 08:05:51.834 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 08:05:51.834 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 08:05:51.834 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 08:05:51.834 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:05:51.834 1 ERROR oslo_service.service 
>2018-06-26 08:05:51.837 1 CRITICAL cinder [req-8716f922-b671-4a1b-9461-38a72a67a4d3 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 08:05:51.837 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 08:05:51.837 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 08:05:51.837 1 ERROR cinder     sys.exit(main())
>2018-06-26 08:05:51.837 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 08:05:51.837 1 ERROR cinder     service.wait()
>2018-06-26 08:05:51.837 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 08:05:51.837 1 ERROR cinder     _launcher.wait()
>2018-06-26 08:05:51.837 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 08:05:51.837 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 08:05:51.837 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 08:05:51.837 1 ERROR cinder     self.services.wait()
>2018-06-26 08:05:51.837 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 08:05:51.837 1 ERROR cinder     service.wait()
>2018-06-26 08:05:51.837 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 08:05:51.837 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 08:05:51.837 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 08:05:51.837 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 08:05:51.837 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 08:05:51.837 1 ERROR cinder     post_fn = fn()
>2018-06-26 08:05:51.837 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 08:05:51.837 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 08:05:51.837 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 08:05:51.837 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 08:05:51.837 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 08:05:51.837 1 ERROR cinder 
>2018-06-26 08:05:54.531 1 WARNING cinder.scheduler.host_manager [req-c17a8f69-ea09-4e89-a958-1ae6a1487597 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 08:05:54.537 1 INFO cinder.rpc [req-c17a8f69-ea09-4e89-a958-1ae6a1487597 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 08:05:54.543 1 INFO cinder.rpc [req-c17a8f69-ea09-4e89-a958-1ae6a1487597 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 08:05:54.553 1 INFO cinder.rpc [req-c17a8f69-ea09-4e89-a958-1ae6a1487597 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 08:05:54.559 1 INFO cinder.rpc [req-c17a8f69-ea09-4e89-a958-1ae6a1487597 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 08:05:54.584 1 WARNING oslo_config.cfg [req-c17a8f69-ea09-4e89-a958-1ae6a1487597 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 08:05:54.586 1 WARNING oslo_config.cfg [req-c17a8f69-ea09-4e89-a958-1ae6a1487597 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:05:54.587 1 WARNING oslo_config.cfg [req-c17a8f69-ea09-4e89-a958-1ae6a1487597 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:05:54.587 1 WARNING oslo_config.cfg [req-c17a8f69-ea09-4e89-a958-1ae6a1487597 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:05:54.593 1 WARNING oslo_config.cfg [req-c17a8f69-ea09-4e89-a958-1ae6a1487597 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 08:05:54.594 1 WARNING oslo_config.cfg [req-c17a8f69-ea09-4e89-a958-1ae6a1487597 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 08:05:54.597 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 08:05:54.603 1 INFO cinder.manager [req-75c193d3-cd0a-430c-8bf4-d4800a4e3aca - - - - -] Initiating service 5 cleanup
>2018-06-26 08:05:54.607 1 INFO cinder.manager [req-75c193d3-cd0a-430c-8bf4-d4800a4e3aca - - - - -] Service 5 cleanup completed.
>2018-06-26 08:08:05.304 1 ERROR oslo.messaging._drivers.impl_rabbit [req-75c193d3-cd0a-430c-8bf4-d4800a4e3aca - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:08:05.306 1 ERROR oslo.messaging._drivers.impl_rabbit [req-75c193d3-cd0a-430c-8bf4-d4800a4e3aca - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:08:05.307 1 ERROR oslo_service.service [req-75c193d3-cd0a-430c-8bf4-d4800a4e3aca - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:08:05.307 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 08:08:05.307 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 08:08:05.307 1 ERROR oslo_service.service     service.start()
>2018-06-26 08:08:05.307 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 08:08:05.307 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 08:08:05.307 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 08:08:05.307 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 08:08:05.307 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 08:08:05.307 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 08:08:05.307 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 08:08:05.307 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 08:08:05.307 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 08:08:05.307 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 08:08:05.307 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 08:08:05.307 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 08:08:05.307 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 08:08:05.307 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 08:08:05.307 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 08:08:05.307 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 08:08:05.307 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 08:08:05.307 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 08:08:05.307 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 08:08:05.307 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 08:08:05.307 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 08:08:05.307 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 08:08:05.307 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:08:05.307 1 ERROR oslo_service.service 
>2018-06-26 08:08:05.310 1 CRITICAL cinder [req-c17a8f69-ea09-4e89-a958-1ae6a1487597 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 08:08:05.310 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 08:08:05.310 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 08:08:05.310 1 ERROR cinder     sys.exit(main())
>2018-06-26 08:08:05.310 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 08:08:05.310 1 ERROR cinder     service.wait()
>2018-06-26 08:08:05.310 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 08:08:05.310 1 ERROR cinder     _launcher.wait()
>2018-06-26 08:08:05.310 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 08:08:05.310 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 08:08:05.310 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 08:08:05.310 1 ERROR cinder     self.services.wait()
>2018-06-26 08:08:05.310 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 08:08:05.310 1 ERROR cinder     service.wait()
>2018-06-26 08:08:05.310 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 08:08:05.310 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 08:08:05.310 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 08:08:05.310 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 08:08:05.310 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 08:08:05.310 1 ERROR cinder     post_fn = fn()
>2018-06-26 08:08:05.310 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 08:08:05.310 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 08:08:05.310 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 08:08:05.310 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 08:08:05.310 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 08:08:05.310 1 ERROR cinder 
>2018-06-26 08:08:08.028 1 WARNING cinder.scheduler.host_manager [req-71d16dbb-2186-42cd-9927-bc08848b20db - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 08:08:08.034 1 INFO cinder.rpc [req-71d16dbb-2186-42cd-9927-bc08848b20db - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 08:08:08.039 1 INFO cinder.rpc [req-71d16dbb-2186-42cd-9927-bc08848b20db - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 08:08:08.053 1 INFO cinder.rpc [req-71d16dbb-2186-42cd-9927-bc08848b20db - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 08:08:08.058 1 INFO cinder.rpc [req-71d16dbb-2186-42cd-9927-bc08848b20db - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 08:08:08.088 1 WARNING oslo_config.cfg [req-71d16dbb-2186-42cd-9927-bc08848b20db - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 08:08:08.090 1 WARNING oslo_config.cfg [req-71d16dbb-2186-42cd-9927-bc08848b20db - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:08:08.090 1 WARNING oslo_config.cfg [req-71d16dbb-2186-42cd-9927-bc08848b20db - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:08:08.091 1 WARNING oslo_config.cfg [req-71d16dbb-2186-42cd-9927-bc08848b20db - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:08:08.096 1 WARNING oslo_config.cfg [req-71d16dbb-2186-42cd-9927-bc08848b20db - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 08:08:08.098 1 WARNING oslo_config.cfg [req-71d16dbb-2186-42cd-9927-bc08848b20db - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 08:08:08.100 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 08:08:08.109 1 INFO cinder.manager [req-8030648f-c189-4d05-b955-9f4043305780 - - - - -] Initiating service 5 cleanup
>2018-06-26 08:08:08.114 1 INFO cinder.manager [req-8030648f-c189-4d05-b955-9f4043305780 - - - - -] Service 5 cleanup completed.
>2018-06-26 08:10:13.924 1 ERROR oslo.messaging._drivers.impl_rabbit [req-8030648f-c189-4d05-b955-9f4043305780 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:10:13.926 1 ERROR oslo.messaging._drivers.impl_rabbit [req-8030648f-c189-4d05-b955-9f4043305780 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:10:13.926 1 ERROR oslo_service.service [req-8030648f-c189-4d05-b955-9f4043305780 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:10:13.926 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 08:10:13.926 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 08:10:13.926 1 ERROR oslo_service.service     service.start()
>2018-06-26 08:10:13.926 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 08:10:13.926 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 08:10:13.926 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 08:10:13.926 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 08:10:13.926 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 08:10:13.926 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 08:10:13.926 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 08:10:13.926 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 08:10:13.926 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 08:10:13.926 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 08:10:13.926 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 08:10:13.926 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 08:10:13.926 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 08:10:13.926 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 08:10:13.926 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 08:10:13.926 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 08:10:13.926 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 08:10:13.926 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 08:10:13.926 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 08:10:13.926 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 08:10:13.926 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 08:10:13.926 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 08:10:13.926 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:10:13.926 1 ERROR oslo_service.service 
>2018-06-26 08:10:13.929 1 CRITICAL cinder [req-71d16dbb-2186-42cd-9927-bc08848b20db - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 08:10:13.929 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 08:10:13.929 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 08:10:13.929 1 ERROR cinder     sys.exit(main())
>2018-06-26 08:10:13.929 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 08:10:13.929 1 ERROR cinder     service.wait()
>2018-06-26 08:10:13.929 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 08:10:13.929 1 ERROR cinder     _launcher.wait()
>2018-06-26 08:10:13.929 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 08:10:13.929 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 08:10:13.929 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 08:10:13.929 1 ERROR cinder     self.services.wait()
>2018-06-26 08:10:13.929 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 08:10:13.929 1 ERROR cinder     service.wait()
>2018-06-26 08:10:13.929 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 08:10:13.929 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 08:10:13.929 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 08:10:13.929 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 08:10:13.929 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 08:10:13.929 1 ERROR cinder     post_fn = fn()
>2018-06-26 08:10:13.929 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 08:10:13.929 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 08:10:13.929 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 08:10:13.929 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 08:10:13.929 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 08:10:13.929 1 ERROR cinder 
>2018-06-26 08:10:16.543 1 WARNING cinder.scheduler.host_manager [req-511ff68a-5e78-4f41-99b7-1eaf565975fa - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 08:10:16.549 1 INFO cinder.rpc [req-511ff68a-5e78-4f41-99b7-1eaf565975fa - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 08:10:16.554 1 INFO cinder.rpc [req-511ff68a-5e78-4f41-99b7-1eaf565975fa - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 08:10:16.568 1 INFO cinder.rpc [req-511ff68a-5e78-4f41-99b7-1eaf565975fa - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 08:10:16.576 1 INFO cinder.rpc [req-511ff68a-5e78-4f41-99b7-1eaf565975fa - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 08:10:16.602 1 WARNING oslo_config.cfg [req-511ff68a-5e78-4f41-99b7-1eaf565975fa - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 08:10:16.604 1 WARNING oslo_config.cfg [req-511ff68a-5e78-4f41-99b7-1eaf565975fa - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:10:16.605 1 WARNING oslo_config.cfg [req-511ff68a-5e78-4f41-99b7-1eaf565975fa - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:10:16.605 1 WARNING oslo_config.cfg [req-511ff68a-5e78-4f41-99b7-1eaf565975fa - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:10:16.610 1 WARNING oslo_config.cfg [req-511ff68a-5e78-4f41-99b7-1eaf565975fa - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 08:10:16.612 1 WARNING oslo_config.cfg [req-511ff68a-5e78-4f41-99b7-1eaf565975fa - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 08:10:16.614 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 08:10:16.622 1 INFO cinder.manager [req-16538edd-b526-4375-bb61-b6b0d0b6654f - - - - -] Initiating service 5 cleanup
>2018-06-26 08:10:16.627 1 INFO cinder.manager [req-16538edd-b526-4375-bb61-b6b0d0b6654f - - - - -] Service 5 cleanup completed.
>2018-06-26 08:12:21.019 1 ERROR oslo.messaging._drivers.impl_rabbit [req-16538edd-b526-4375-bb61-b6b0d0b6654f - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:12:21.022 1 ERROR oslo.messaging._drivers.impl_rabbit [req-16538edd-b526-4375-bb61-b6b0d0b6654f - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:12:21.022 1 ERROR oslo_service.service [req-16538edd-b526-4375-bb61-b6b0d0b6654f - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:12:21.022 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 08:12:21.022 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 08:12:21.022 1 ERROR oslo_service.service     service.start()
>2018-06-26 08:12:21.022 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 08:12:21.022 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 08:12:21.022 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 08:12:21.022 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 08:12:21.022 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 08:12:21.022 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 08:12:21.022 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 08:12:21.022 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 08:12:21.022 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 08:12:21.022 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 08:12:21.022 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 08:12:21.022 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 08:12:21.022 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 08:12:21.022 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 08:12:21.022 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 08:12:21.022 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 08:12:21.022 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 08:12:21.022 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 08:12:21.022 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 08:12:21.022 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 08:12:21.022 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 08:12:21.022 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 08:12:21.022 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:12:21.022 1 ERROR oslo_service.service 
>2018-06-26 08:12:21.025 1 CRITICAL cinder [req-511ff68a-5e78-4f41-99b7-1eaf565975fa - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 08:12:21.025 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 08:12:21.025 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 08:12:21.025 1 ERROR cinder     sys.exit(main())
>2018-06-26 08:12:21.025 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 08:12:21.025 1 ERROR cinder     service.wait()
>2018-06-26 08:12:21.025 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 08:12:21.025 1 ERROR cinder     _launcher.wait()
>2018-06-26 08:12:21.025 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 08:12:21.025 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 08:12:21.025 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 08:12:21.025 1 ERROR cinder     self.services.wait()
>2018-06-26 08:12:21.025 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 08:12:21.025 1 ERROR cinder     service.wait()
>2018-06-26 08:12:21.025 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 08:12:21.025 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 08:12:21.025 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 08:12:21.025 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 08:12:21.025 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 08:12:21.025 1 ERROR cinder     post_fn = fn()
>2018-06-26 08:12:21.025 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 08:12:21.025 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 08:12:21.025 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 08:12:21.025 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 08:12:21.025 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 08:12:21.025 1 ERROR cinder 
>2018-06-26 08:12:23.726 1 WARNING cinder.scheduler.host_manager [req-3bfe252c-fdf9-479d-b51c-b01a51444036 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 08:12:23.734 1 INFO cinder.rpc [req-3bfe252c-fdf9-479d-b51c-b01a51444036 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 08:12:23.742 1 INFO cinder.rpc [req-3bfe252c-fdf9-479d-b51c-b01a51444036 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 08:12:23.756 1 INFO cinder.rpc [req-3bfe252c-fdf9-479d-b51c-b01a51444036 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 08:12:23.765 1 INFO cinder.rpc [req-3bfe252c-fdf9-479d-b51c-b01a51444036 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 08:12:23.794 1 WARNING oslo_config.cfg [req-3bfe252c-fdf9-479d-b51c-b01a51444036 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 08:12:23.798 1 WARNING oslo_config.cfg [req-3bfe252c-fdf9-479d-b51c-b01a51444036 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:12:23.799 1 WARNING oslo_config.cfg [req-3bfe252c-fdf9-479d-b51c-b01a51444036 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:12:23.799 1 WARNING oslo_config.cfg [req-3bfe252c-fdf9-479d-b51c-b01a51444036 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:12:23.806 1 WARNING oslo_config.cfg [req-3bfe252c-fdf9-479d-b51c-b01a51444036 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 08:12:23.807 1 WARNING oslo_config.cfg [req-3bfe252c-fdf9-479d-b51c-b01a51444036 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 08:12:23.811 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 08:12:23.819 1 INFO cinder.manager [req-5241fe8b-62f6-4c88-9b52-a4df6388f427 - - - - -] Initiating service 5 cleanup
>2018-06-26 08:12:23.825 1 INFO cinder.manager [req-5241fe8b-62f6-4c88-9b52-a4df6388f427 - - - - -] Service 5 cleanup completed.
>2018-06-26 08:14:36.021 1 ERROR oslo.messaging._drivers.impl_rabbit [req-5241fe8b-62f6-4c88-9b52-a4df6388f427 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:14:36.023 1 ERROR oslo.messaging._drivers.impl_rabbit [req-5241fe8b-62f6-4c88-9b52-a4df6388f427 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:14:36.023 1 ERROR oslo_service.service [req-5241fe8b-62f6-4c88-9b52-a4df6388f427 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:14:36.023 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 08:14:36.023 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 08:14:36.023 1 ERROR oslo_service.service     service.start()
>2018-06-26 08:14:36.023 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 08:14:36.023 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 08:14:36.023 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 08:14:36.023 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 08:14:36.023 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 08:14:36.023 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 08:14:36.023 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 08:14:36.023 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 08:14:36.023 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 08:14:36.023 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 08:14:36.023 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 08:14:36.023 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 08:14:36.023 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 08:14:36.023 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 08:14:36.023 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 08:14:36.023 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 08:14:36.023 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 08:14:36.023 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 08:14:36.023 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 08:14:36.023 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 08:14:36.023 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 08:14:36.023 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 08:14:36.023 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:14:36.023 1 ERROR oslo_service.service 
>2018-06-26 08:14:36.026 1 CRITICAL cinder [req-3bfe252c-fdf9-479d-b51c-b01a51444036 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 08:14:36.026 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 08:14:36.026 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 08:14:36.026 1 ERROR cinder     sys.exit(main())
>2018-06-26 08:14:36.026 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 08:14:36.026 1 ERROR cinder     service.wait()
>2018-06-26 08:14:36.026 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 08:14:36.026 1 ERROR cinder     _launcher.wait()
>2018-06-26 08:14:36.026 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 08:14:36.026 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 08:14:36.026 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 08:14:36.026 1 ERROR cinder     self.services.wait()
>2018-06-26 08:14:36.026 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 08:14:36.026 1 ERROR cinder     service.wait()
>2018-06-26 08:14:36.026 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 08:14:36.026 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 08:14:36.026 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 08:14:36.026 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 08:14:36.026 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 08:14:36.026 1 ERROR cinder     post_fn = fn()
>2018-06-26 08:14:36.026 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 08:14:36.026 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 08:14:36.026 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 08:14:36.026 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 08:14:36.026 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 08:14:36.026 1 ERROR cinder 
>2018-06-26 08:14:38.709 1 WARNING cinder.scheduler.host_manager [req-48f245bb-b68f-42b7-bbed-73a37c04c27f - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 08:14:38.715 1 INFO cinder.rpc [req-48f245bb-b68f-42b7-bbed-73a37c04c27f - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 08:14:38.722 1 INFO cinder.rpc [req-48f245bb-b68f-42b7-bbed-73a37c04c27f - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 08:14:38.734 1 INFO cinder.rpc [req-48f245bb-b68f-42b7-bbed-73a37c04c27f - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 08:14:38.744 1 INFO cinder.rpc [req-48f245bb-b68f-42b7-bbed-73a37c04c27f - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 08:14:38.774 1 WARNING oslo_config.cfg [req-48f245bb-b68f-42b7-bbed-73a37c04c27f - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 08:14:38.776 1 WARNING oslo_config.cfg [req-48f245bb-b68f-42b7-bbed-73a37c04c27f - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:14:38.776 1 WARNING oslo_config.cfg [req-48f245bb-b68f-42b7-bbed-73a37c04c27f - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:14:38.777 1 WARNING oslo_config.cfg [req-48f245bb-b68f-42b7-bbed-73a37c04c27f - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:14:38.782 1 WARNING oslo_config.cfg [req-48f245bb-b68f-42b7-bbed-73a37c04c27f - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 08:14:38.783 1 WARNING oslo_config.cfg [req-48f245bb-b68f-42b7-bbed-73a37c04c27f - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 08:14:38.786 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 08:14:38.796 1 INFO cinder.manager [req-305fda9d-836b-4d7c-a6ec-a93e68790ace - - - - -] Initiating service 5 cleanup
>2018-06-26 08:14:38.804 1 INFO cinder.manager [req-305fda9d-836b-4d7c-a6ec-a93e68790ace - - - - -] Service 5 cleanup completed.
>2018-06-26 08:16:50.850 1 ERROR oslo.messaging._drivers.impl_rabbit [req-305fda9d-836b-4d7c-a6ec-a93e68790ace - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:16:50.852 1 ERROR oslo.messaging._drivers.impl_rabbit [req-305fda9d-836b-4d7c-a6ec-a93e68790ace - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:16:50.853 1 ERROR oslo_service.service [req-305fda9d-836b-4d7c-a6ec-a93e68790ace - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:16:50.853 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 08:16:50.853 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 08:16:50.853 1 ERROR oslo_service.service     service.start()
>2018-06-26 08:16:50.853 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 08:16:50.853 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 08:16:50.853 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 08:16:50.853 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 08:16:50.853 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 08:16:50.853 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 08:16:50.853 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 08:16:50.853 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 08:16:50.853 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 08:16:50.853 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 08:16:50.853 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 08:16:50.853 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 08:16:50.853 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 08:16:50.853 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 08:16:50.853 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 08:16:50.853 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 08:16:50.853 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 08:16:50.853 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 08:16:50.853 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 08:16:50.853 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 08:16:50.853 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 08:16:50.853 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 08:16:50.853 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:16:50.853 1 ERROR oslo_service.service 
>2018-06-26 08:16:50.855 1 CRITICAL cinder [req-48f245bb-b68f-42b7-bbed-73a37c04c27f - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 08:16:50.855 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 08:16:50.855 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 08:16:50.855 1 ERROR cinder     sys.exit(main())
>2018-06-26 08:16:50.855 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 08:16:50.855 1 ERROR cinder     service.wait()
>2018-06-26 08:16:50.855 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 08:16:50.855 1 ERROR cinder     _launcher.wait()
>2018-06-26 08:16:50.855 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 08:16:50.855 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 08:16:50.855 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 08:16:50.855 1 ERROR cinder     self.services.wait()
>2018-06-26 08:16:50.855 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 08:16:50.855 1 ERROR cinder     service.wait()
>2018-06-26 08:16:50.855 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 08:16:50.855 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 08:16:50.855 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 08:16:50.855 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 08:16:50.855 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 08:16:50.855 1 ERROR cinder     post_fn = fn()
>2018-06-26 08:16:50.855 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 08:16:50.855 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 08:16:50.855 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 08:16:50.855 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 08:16:50.855 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 08:16:50.855 1 ERROR cinder 
>2018-06-26 08:16:53.564 1 WARNING cinder.scheduler.host_manager [req-1fd7e9cd-1773-4812-beb1-a821ea1585c9 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 08:16:53.577 1 INFO cinder.rpc [req-1fd7e9cd-1773-4812-beb1-a821ea1585c9 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 08:16:53.583 1 INFO cinder.rpc [req-1fd7e9cd-1773-4812-beb1-a821ea1585c9 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 08:16:53.593 1 INFO cinder.rpc [req-1fd7e9cd-1773-4812-beb1-a821ea1585c9 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 08:16:53.599 1 INFO cinder.rpc [req-1fd7e9cd-1773-4812-beb1-a821ea1585c9 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 08:16:53.622 1 WARNING oslo_config.cfg [req-1fd7e9cd-1773-4812-beb1-a821ea1585c9 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 08:16:53.624 1 WARNING oslo_config.cfg [req-1fd7e9cd-1773-4812-beb1-a821ea1585c9 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:16:53.625 1 WARNING oslo_config.cfg [req-1fd7e9cd-1773-4812-beb1-a821ea1585c9 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:16:53.625 1 WARNING oslo_config.cfg [req-1fd7e9cd-1773-4812-beb1-a821ea1585c9 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:16:53.631 1 WARNING oslo_config.cfg [req-1fd7e9cd-1773-4812-beb1-a821ea1585c9 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 08:16:53.632 1 WARNING oslo_config.cfg [req-1fd7e9cd-1773-4812-beb1-a821ea1585c9 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 08:16:53.634 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 08:16:53.650 1 INFO cinder.manager [req-1aab8f8f-d044-4194-aa36-7cece4be2df0 - - - - -] Initiating service 5 cleanup
>2018-06-26 08:16:53.657 1 INFO cinder.manager [req-1aab8f8f-d044-4194-aa36-7cece4be2df0 - - - - -] Service 5 cleanup completed.
>2018-06-26 08:18:59.815 1 ERROR oslo.messaging._drivers.impl_rabbit [req-1aab8f8f-d044-4194-aa36-7cece4be2df0 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:18:59.817 1 ERROR oslo.messaging._drivers.impl_rabbit [req-1aab8f8f-d044-4194-aa36-7cece4be2df0 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:18:59.818 1 ERROR oslo_service.service [req-1aab8f8f-d044-4194-aa36-7cece4be2df0 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:18:59.818 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 08:18:59.818 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 08:18:59.818 1 ERROR oslo_service.service     service.start()
>2018-06-26 08:18:59.818 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 08:18:59.818 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 08:18:59.818 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 08:18:59.818 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 08:18:59.818 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 08:18:59.818 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 08:18:59.818 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 08:18:59.818 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 08:18:59.818 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 08:18:59.818 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 08:18:59.818 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 08:18:59.818 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 08:18:59.818 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 08:18:59.818 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 08:18:59.818 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 08:18:59.818 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 08:18:59.818 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 08:18:59.818 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 08:18:59.818 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 08:18:59.818 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 08:18:59.818 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 08:18:59.818 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 08:18:59.818 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:18:59.818 1 ERROR oslo_service.service 
>2018-06-26 08:18:59.821 1 CRITICAL cinder [req-1fd7e9cd-1773-4812-beb1-a821ea1585c9 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 08:18:59.821 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 08:18:59.821 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 08:18:59.821 1 ERROR cinder     sys.exit(main())
>2018-06-26 08:18:59.821 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 08:18:59.821 1 ERROR cinder     service.wait()
>2018-06-26 08:18:59.821 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 08:18:59.821 1 ERROR cinder     _launcher.wait()
>2018-06-26 08:18:59.821 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 08:18:59.821 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 08:18:59.821 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 08:18:59.821 1 ERROR cinder     self.services.wait()
>2018-06-26 08:18:59.821 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 08:18:59.821 1 ERROR cinder     service.wait()
>2018-06-26 08:18:59.821 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 08:18:59.821 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 08:18:59.821 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 08:18:59.821 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 08:18:59.821 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 08:18:59.821 1 ERROR cinder     post_fn = fn()
>2018-06-26 08:18:59.821 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 08:18:59.821 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 08:18:59.821 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 08:18:59.821 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 08:18:59.821 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 08:18:59.821 1 ERROR cinder 
>2018-06-26 08:19:02.520 1 WARNING cinder.scheduler.host_manager [req-937516cf-7e90-41bd-aea1-93e60613667e - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 08:19:02.526 1 INFO cinder.rpc [req-937516cf-7e90-41bd-aea1-93e60613667e - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 08:19:02.531 1 INFO cinder.rpc [req-937516cf-7e90-41bd-aea1-93e60613667e - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 08:19:02.549 1 INFO cinder.rpc [req-937516cf-7e90-41bd-aea1-93e60613667e - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 08:19:02.556 1 INFO cinder.rpc [req-937516cf-7e90-41bd-aea1-93e60613667e - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 08:19:02.585 1 WARNING oslo_config.cfg [req-937516cf-7e90-41bd-aea1-93e60613667e - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 08:19:02.587 1 WARNING oslo_config.cfg [req-937516cf-7e90-41bd-aea1-93e60613667e - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:19:02.588 1 WARNING oslo_config.cfg [req-937516cf-7e90-41bd-aea1-93e60613667e - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:19:02.588 1 WARNING oslo_config.cfg [req-937516cf-7e90-41bd-aea1-93e60613667e - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:19:02.593 1 WARNING oslo_config.cfg [req-937516cf-7e90-41bd-aea1-93e60613667e - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 08:19:02.594 1 WARNING oslo_config.cfg [req-937516cf-7e90-41bd-aea1-93e60613667e - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 08:19:02.597 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 08:19:02.603 1 INFO cinder.manager [req-29e5090d-215f-46ed-ba78-5ea47b482ae7 - - - - -] Initiating service 5 cleanup
>2018-06-26 08:19:02.608 1 INFO cinder.manager [req-29e5090d-215f-46ed-ba78-5ea47b482ae7 - - - - -] Service 5 cleanup completed.
>2018-06-26 08:21:06.950 1 ERROR oslo.messaging._drivers.impl_rabbit [req-29e5090d-215f-46ed-ba78-5ea47b482ae7 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:21:06.952 1 ERROR oslo.messaging._drivers.impl_rabbit [req-29e5090d-215f-46ed-ba78-5ea47b482ae7 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:21:06.952 1 ERROR oslo_service.service [req-29e5090d-215f-46ed-ba78-5ea47b482ae7 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:21:06.952 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 08:21:06.952 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 08:21:06.952 1 ERROR oslo_service.service     service.start()
>2018-06-26 08:21:06.952 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 08:21:06.952 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 08:21:06.952 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 08:21:06.952 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 08:21:06.952 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 08:21:06.952 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 08:21:06.952 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 08:21:06.952 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 08:21:06.952 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 08:21:06.952 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 08:21:06.952 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 08:21:06.952 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 08:21:06.952 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 08:21:06.952 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 08:21:06.952 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 08:21:06.952 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 08:21:06.952 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 08:21:06.952 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 08:21:06.952 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 08:21:06.952 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 08:21:06.952 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 08:21:06.952 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 08:21:06.952 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:21:06.952 1 ERROR oslo_service.service 
>2018-06-26 08:21:06.955 1 CRITICAL cinder [req-937516cf-7e90-41bd-aea1-93e60613667e - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 08:21:06.955 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 08:21:06.955 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 08:21:06.955 1 ERROR cinder     sys.exit(main())
>2018-06-26 08:21:06.955 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 08:21:06.955 1 ERROR cinder     service.wait()
>2018-06-26 08:21:06.955 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 08:21:06.955 1 ERROR cinder     _launcher.wait()
>2018-06-26 08:21:06.955 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 08:21:06.955 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 08:21:06.955 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 08:21:06.955 1 ERROR cinder     self.services.wait()
>2018-06-26 08:21:06.955 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 08:21:06.955 1 ERROR cinder     service.wait()
>2018-06-26 08:21:06.955 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 08:21:06.955 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 08:21:06.955 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 08:21:06.955 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 08:21:06.955 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 08:21:06.955 1 ERROR cinder     post_fn = fn()
>2018-06-26 08:21:06.955 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 08:21:06.955 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 08:21:06.955 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 08:21:06.955 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 08:21:06.955 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 08:21:06.955 1 ERROR cinder 
>2018-06-26 08:21:09.695 1 WARNING cinder.scheduler.host_manager [req-4c657175-1d73-4a98-9fbe-ff7a19089641 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 08:21:09.703 1 INFO cinder.rpc [req-4c657175-1d73-4a98-9fbe-ff7a19089641 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 08:21:09.715 1 INFO cinder.rpc [req-4c657175-1d73-4a98-9fbe-ff7a19089641 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 08:21:09.733 1 INFO cinder.rpc [req-4c657175-1d73-4a98-9fbe-ff7a19089641 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 08:21:09.740 1 INFO cinder.rpc [req-4c657175-1d73-4a98-9fbe-ff7a19089641 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 08:21:09.763 1 WARNING oslo_config.cfg [req-4c657175-1d73-4a98-9fbe-ff7a19089641 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 08:21:09.765 1 WARNING oslo_config.cfg [req-4c657175-1d73-4a98-9fbe-ff7a19089641 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:21:09.765 1 WARNING oslo_config.cfg [req-4c657175-1d73-4a98-9fbe-ff7a19089641 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:21:09.766 1 WARNING oslo_config.cfg [req-4c657175-1d73-4a98-9fbe-ff7a19089641 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:21:09.771 1 WARNING oslo_config.cfg [req-4c657175-1d73-4a98-9fbe-ff7a19089641 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 08:21:09.773 1 WARNING oslo_config.cfg [req-4c657175-1d73-4a98-9fbe-ff7a19089641 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 08:21:09.775 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 08:21:09.781 1 INFO cinder.manager [req-86e7b483-a2b6-4044-a897-9e931f54bbb9 - - - - -] Initiating service 5 cleanup
>2018-06-26 08:21:09.785 1 INFO cinder.manager [req-86e7b483-a2b6-4044-a897-9e931f54bbb9 - - - - -] Service 5 cleanup completed.
>2018-06-26 08:23:15.797 1 ERROR oslo.messaging._drivers.impl_rabbit [req-86e7b483-a2b6-4044-a897-9e931f54bbb9 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:23:15.799 1 ERROR oslo.messaging._drivers.impl_rabbit [req-86e7b483-a2b6-4044-a897-9e931f54bbb9 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:23:15.800 1 ERROR oslo_service.service [req-86e7b483-a2b6-4044-a897-9e931f54bbb9 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:23:15.800 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 08:23:15.800 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 08:23:15.800 1 ERROR oslo_service.service     service.start()
>2018-06-26 08:23:15.800 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 08:23:15.800 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 08:23:15.800 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 08:23:15.800 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 08:23:15.800 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 08:23:15.800 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 08:23:15.800 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 08:23:15.800 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 08:23:15.800 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 08:23:15.800 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 08:23:15.800 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 08:23:15.800 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 08:23:15.800 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 08:23:15.800 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 08:23:15.800 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 08:23:15.800 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 08:23:15.800 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 08:23:15.800 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 08:23:15.800 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 08:23:15.800 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 08:23:15.800 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 08:23:15.800 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 08:23:15.800 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:23:15.800 1 ERROR oslo_service.service 
>2018-06-26 08:23:15.803 1 CRITICAL cinder [req-4c657175-1d73-4a98-9fbe-ff7a19089641 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 08:23:15.803 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 08:23:15.803 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 08:23:15.803 1 ERROR cinder     sys.exit(main())
>2018-06-26 08:23:15.803 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 08:23:15.803 1 ERROR cinder     service.wait()
>2018-06-26 08:23:15.803 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 08:23:15.803 1 ERROR cinder     _launcher.wait()
>2018-06-26 08:23:15.803 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 08:23:15.803 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 08:23:15.803 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 08:23:15.803 1 ERROR cinder     self.services.wait()
>2018-06-26 08:23:15.803 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 08:23:15.803 1 ERROR cinder     service.wait()
>2018-06-26 08:23:15.803 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 08:23:15.803 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 08:23:15.803 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 08:23:15.803 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 08:23:15.803 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 08:23:15.803 1 ERROR cinder     post_fn = fn()
>2018-06-26 08:23:15.803 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 08:23:15.803 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 08:23:15.803 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 08:23:15.803 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 08:23:15.803 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 08:23:15.803 1 ERROR cinder 
>2018-06-26 08:23:18.390 1 WARNING cinder.scheduler.host_manager [req-b41a3411-a966-4643-9025-7e7dbb0afe72 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 08:23:18.396 1 INFO cinder.rpc [req-b41a3411-a966-4643-9025-7e7dbb0afe72 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 08:23:18.403 1 INFO cinder.rpc [req-b41a3411-a966-4643-9025-7e7dbb0afe72 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 08:23:18.420 1 INFO cinder.rpc [req-b41a3411-a966-4643-9025-7e7dbb0afe72 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 08:23:18.428 1 INFO cinder.rpc [req-b41a3411-a966-4643-9025-7e7dbb0afe72 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 08:23:18.461 1 WARNING oslo_config.cfg [req-b41a3411-a966-4643-9025-7e7dbb0afe72 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 08:23:18.463 1 WARNING oslo_config.cfg [req-b41a3411-a966-4643-9025-7e7dbb0afe72 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:23:18.463 1 WARNING oslo_config.cfg [req-b41a3411-a966-4643-9025-7e7dbb0afe72 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:23:18.464 1 WARNING oslo_config.cfg [req-b41a3411-a966-4643-9025-7e7dbb0afe72 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:23:18.469 1 WARNING oslo_config.cfg [req-b41a3411-a966-4643-9025-7e7dbb0afe72 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 08:23:18.471 1 WARNING oslo_config.cfg [req-b41a3411-a966-4643-9025-7e7dbb0afe72 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 08:23:18.473 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 08:23:18.481 1 INFO cinder.manager [req-7981d915-cf91-4a7f-9d6f-af8c00d31eda - - - - -] Initiating service 5 cleanup
>2018-06-26 08:23:18.489 1 INFO cinder.manager [req-7981d915-cf91-4a7f-9d6f-af8c00d31eda - - - - -] Service 5 cleanup completed.
>2018-06-26 08:25:24.374 1 ERROR oslo.messaging._drivers.impl_rabbit [req-7981d915-cf91-4a7f-9d6f-af8c00d31eda - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:25:24.375 1 ERROR oslo.messaging._drivers.impl_rabbit [req-7981d915-cf91-4a7f-9d6f-af8c00d31eda - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:25:24.376 1 ERROR oslo_service.service [req-7981d915-cf91-4a7f-9d6f-af8c00d31eda - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:25:24.376 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 08:25:24.376 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 08:25:24.376 1 ERROR oslo_service.service     service.start()
>2018-06-26 08:25:24.376 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 08:25:24.376 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 08:25:24.376 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 08:25:24.376 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 08:25:24.376 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 08:25:24.376 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 08:25:24.376 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 08:25:24.376 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 08:25:24.376 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 08:25:24.376 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 08:25:24.376 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 08:25:24.376 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 08:25:24.376 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 08:25:24.376 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 08:25:24.376 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 08:25:24.376 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 08:25:24.376 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 08:25:24.376 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 08:25:24.376 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 08:25:24.376 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 08:25:24.376 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 08:25:24.376 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 08:25:24.376 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:25:24.376 1 ERROR oslo_service.service 
>2018-06-26 08:25:24.378 1 CRITICAL cinder [req-b41a3411-a966-4643-9025-7e7dbb0afe72 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 08:25:24.378 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 08:25:24.378 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 08:25:24.378 1 ERROR cinder     sys.exit(main())
>2018-06-26 08:25:24.378 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 08:25:24.378 1 ERROR cinder     service.wait()
>2018-06-26 08:25:24.378 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 08:25:24.378 1 ERROR cinder     _launcher.wait()
>2018-06-26 08:25:24.378 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 08:25:24.378 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 08:25:24.378 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 08:25:24.378 1 ERROR cinder     self.services.wait()
>2018-06-26 08:25:24.378 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 08:25:24.378 1 ERROR cinder     service.wait()
>2018-06-26 08:25:24.378 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 08:25:24.378 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 08:25:24.378 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 08:25:24.378 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 08:25:24.378 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 08:25:24.378 1 ERROR cinder     post_fn = fn()
>2018-06-26 08:25:24.378 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 08:25:24.378 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 08:25:24.378 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 08:25:24.378 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 08:25:24.378 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 08:25:24.378 1 ERROR cinder 
>2018-06-26 08:25:26.971 1 WARNING cinder.scheduler.host_manager [req-bb7c2f96-f736-4095-a488-11903c98e0bd - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 08:25:26.977 1 INFO cinder.rpc [req-bb7c2f96-f736-4095-a488-11903c98e0bd - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 08:25:26.982 1 INFO cinder.rpc [req-bb7c2f96-f736-4095-a488-11903c98e0bd - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 08:25:26.995 1 INFO cinder.rpc [req-bb7c2f96-f736-4095-a488-11903c98e0bd - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 08:25:27.001 1 INFO cinder.rpc [req-bb7c2f96-f736-4095-a488-11903c98e0bd - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 08:25:27.033 1 WARNING oslo_config.cfg [req-bb7c2f96-f736-4095-a488-11903c98e0bd - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 08:25:27.035 1 WARNING oslo_config.cfg [req-bb7c2f96-f736-4095-a488-11903c98e0bd - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:25:27.035 1 WARNING oslo_config.cfg [req-bb7c2f96-f736-4095-a488-11903c98e0bd - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:25:27.036 1 WARNING oslo_config.cfg [req-bb7c2f96-f736-4095-a488-11903c98e0bd - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:25:27.041 1 WARNING oslo_config.cfg [req-bb7c2f96-f736-4095-a488-11903c98e0bd - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 08:25:27.042 1 WARNING oslo_config.cfg [req-bb7c2f96-f736-4095-a488-11903c98e0bd - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 08:25:27.045 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 08:25:27.052 1 INFO cinder.manager [req-0bff7c35-783c-49fd-b1d5-3dfe9459a8a2 - - - - -] Initiating service 5 cleanup
>2018-06-26 08:25:27.056 1 INFO cinder.manager [req-0bff7c35-783c-49fd-b1d5-3dfe9459a8a2 - - - - -] Service 5 cleanup completed.
>2018-06-26 08:27:31.491 1 ERROR oslo.messaging._drivers.impl_rabbit [req-0bff7c35-783c-49fd-b1d5-3dfe9459a8a2 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:27:31.492 1 ERROR oslo.messaging._drivers.impl_rabbit [req-0bff7c35-783c-49fd-b1d5-3dfe9459a8a2 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:27:31.493 1 ERROR oslo_service.service [req-0bff7c35-783c-49fd-b1d5-3dfe9459a8a2 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:27:31.493 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 08:27:31.493 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 08:27:31.493 1 ERROR oslo_service.service     service.start()
>2018-06-26 08:27:31.493 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 08:27:31.493 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 08:27:31.493 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 08:27:31.493 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 08:27:31.493 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 08:27:31.493 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 08:27:31.493 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 08:27:31.493 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 08:27:31.493 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 08:27:31.493 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 08:27:31.493 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 08:27:31.493 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 08:27:31.493 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 08:27:31.493 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 08:27:31.493 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 08:27:31.493 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 08:27:31.493 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 08:27:31.493 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 08:27:31.493 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 08:27:31.493 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 08:27:31.493 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 08:27:31.493 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 08:27:31.493 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:27:31.493 1 ERROR oslo_service.service 
>2018-06-26 08:27:31.496 1 CRITICAL cinder [req-bb7c2f96-f736-4095-a488-11903c98e0bd - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 08:27:31.496 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 08:27:31.496 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 08:27:31.496 1 ERROR cinder     sys.exit(main())
>2018-06-26 08:27:31.496 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 08:27:31.496 1 ERROR cinder     service.wait()
>2018-06-26 08:27:31.496 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 08:27:31.496 1 ERROR cinder     _launcher.wait()
>2018-06-26 08:27:31.496 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 08:27:31.496 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 08:27:31.496 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 08:27:31.496 1 ERROR cinder     self.services.wait()
>2018-06-26 08:27:31.496 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 08:27:31.496 1 ERROR cinder     service.wait()
>2018-06-26 08:27:31.496 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 08:27:31.496 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 08:27:31.496 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 08:27:31.496 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 08:27:31.496 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 08:27:31.496 1 ERROR cinder     post_fn = fn()
>2018-06-26 08:27:31.496 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 08:27:31.496 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 08:27:31.496 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 08:27:31.496 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 08:27:31.496 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 08:27:31.496 1 ERROR cinder 
>2018-06-26 08:27:34.258 1 WARNING cinder.scheduler.host_manager [req-83dd5288-29d2-4ed1-8863-cc1a11823018 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 08:27:34.264 1 INFO cinder.rpc [req-83dd5288-29d2-4ed1-8863-cc1a11823018 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 08:27:34.270 1 INFO cinder.rpc [req-83dd5288-29d2-4ed1-8863-cc1a11823018 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 08:27:34.281 1 INFO cinder.rpc [req-83dd5288-29d2-4ed1-8863-cc1a11823018 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 08:27:34.287 1 INFO cinder.rpc [req-83dd5288-29d2-4ed1-8863-cc1a11823018 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 08:27:34.311 1 WARNING oslo_config.cfg [req-83dd5288-29d2-4ed1-8863-cc1a11823018 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 08:27:34.313 1 WARNING oslo_config.cfg [req-83dd5288-29d2-4ed1-8863-cc1a11823018 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:27:34.314 1 WARNING oslo_config.cfg [req-83dd5288-29d2-4ed1-8863-cc1a11823018 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:27:34.314 1 WARNING oslo_config.cfg [req-83dd5288-29d2-4ed1-8863-cc1a11823018 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:27:34.319 1 WARNING oslo_config.cfg [req-83dd5288-29d2-4ed1-8863-cc1a11823018 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 08:27:34.321 1 WARNING oslo_config.cfg [req-83dd5288-29d2-4ed1-8863-cc1a11823018 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 08:27:34.323 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 08:27:34.329 1 INFO cinder.manager [req-18ec5cf6-7e2a-4848-b829-6fee71d0696b - - - - -] Initiating service 5 cleanup
>2018-06-26 08:27:34.334 1 INFO cinder.manager [req-18ec5cf6-7e2a-4848-b829-6fee71d0696b - - - - -] Service 5 cleanup completed.
>2018-06-26 08:29:46.368 1 ERROR oslo.messaging._drivers.impl_rabbit [req-18ec5cf6-7e2a-4848-b829-6fee71d0696b - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:29:46.370 1 ERROR oslo.messaging._drivers.impl_rabbit [req-18ec5cf6-7e2a-4848-b829-6fee71d0696b - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:29:46.371 1 ERROR oslo_service.service [req-18ec5cf6-7e2a-4848-b829-6fee71d0696b - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:29:46.371 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 08:29:46.371 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 08:29:46.371 1 ERROR oslo_service.service     service.start()
>2018-06-26 08:29:46.371 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 08:29:46.371 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 08:29:46.371 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 08:29:46.371 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 08:29:46.371 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 08:29:46.371 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 08:29:46.371 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 08:29:46.371 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 08:29:46.371 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 08:29:46.371 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 08:29:46.371 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 08:29:46.371 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 08:29:46.371 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 08:29:46.371 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 08:29:46.371 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 08:29:46.371 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 08:29:46.371 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 08:29:46.371 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 08:29:46.371 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 08:29:46.371 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 08:29:46.371 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 08:29:46.371 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 08:29:46.371 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:29:46.371 1 ERROR oslo_service.service 
>2018-06-26 08:29:46.374 1 CRITICAL cinder [req-83dd5288-29d2-4ed1-8863-cc1a11823018 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 08:29:46.374 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 08:29:46.374 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 08:29:46.374 1 ERROR cinder     sys.exit(main())
>2018-06-26 08:29:46.374 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 08:29:46.374 1 ERROR cinder     service.wait()
>2018-06-26 08:29:46.374 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 08:29:46.374 1 ERROR cinder     _launcher.wait()
>2018-06-26 08:29:46.374 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 08:29:46.374 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 08:29:46.374 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 08:29:46.374 1 ERROR cinder     self.services.wait()
>2018-06-26 08:29:46.374 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 08:29:46.374 1 ERROR cinder     service.wait()
>2018-06-26 08:29:46.374 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 08:29:46.374 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 08:29:46.374 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 08:29:46.374 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 08:29:46.374 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 08:29:46.374 1 ERROR cinder     post_fn = fn()
>2018-06-26 08:29:46.374 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 08:29:46.374 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 08:29:46.374 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 08:29:46.374 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 08:29:46.374 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 08:29:46.374 1 ERROR cinder 
>2018-06-26 08:29:49.018 1 WARNING cinder.scheduler.host_manager [req-b62ea8a3-a82b-405a-b12c-f3f070d8246a - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 08:29:49.025 1 INFO cinder.rpc [req-b62ea8a3-a82b-405a-b12c-f3f070d8246a - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 08:29:49.033 1 INFO cinder.rpc [req-b62ea8a3-a82b-405a-b12c-f3f070d8246a - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 08:29:49.046 1 INFO cinder.rpc [req-b62ea8a3-a82b-405a-b12c-f3f070d8246a - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 08:29:49.053 1 INFO cinder.rpc [req-b62ea8a3-a82b-405a-b12c-f3f070d8246a - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 08:29:49.078 1 WARNING oslo_config.cfg [req-b62ea8a3-a82b-405a-b12c-f3f070d8246a - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 08:29:49.080 1 WARNING oslo_config.cfg [req-b62ea8a3-a82b-405a-b12c-f3f070d8246a - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:29:49.081 1 WARNING oslo_config.cfg [req-b62ea8a3-a82b-405a-b12c-f3f070d8246a - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:29:49.082 1 WARNING oslo_config.cfg [req-b62ea8a3-a82b-405a-b12c-f3f070d8246a - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:29:49.087 1 WARNING oslo_config.cfg [req-b62ea8a3-a82b-405a-b12c-f3f070d8246a - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 08:29:49.089 1 WARNING oslo_config.cfg [req-b62ea8a3-a82b-405a-b12c-f3f070d8246a - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 08:29:49.092 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 08:29:49.099 1 INFO cinder.manager [req-92a22ecd-fbd8-4c87-9709-a88d7332edac - - - - -] Initiating service 5 cleanup
>2018-06-26 08:29:49.105 1 INFO cinder.manager [req-92a22ecd-fbd8-4c87-9709-a88d7332edac - - - - -] Service 5 cleanup completed.
>2018-06-26 08:31:53.472 1 ERROR oslo.messaging._drivers.impl_rabbit [req-92a22ecd-fbd8-4c87-9709-a88d7332edac - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:31:53.475 1 ERROR oslo.messaging._drivers.impl_rabbit [req-92a22ecd-fbd8-4c87-9709-a88d7332edac - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:31:53.475 1 ERROR oslo_service.service [req-92a22ecd-fbd8-4c87-9709-a88d7332edac - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:31:53.475 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 08:31:53.475 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 08:31:53.475 1 ERROR oslo_service.service     service.start()
>2018-06-26 08:31:53.475 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 08:31:53.475 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 08:31:53.475 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 08:31:53.475 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 08:31:53.475 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 08:31:53.475 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 08:31:53.475 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 08:31:53.475 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 08:31:53.475 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 08:31:53.475 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 08:31:53.475 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 08:31:53.475 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 08:31:53.475 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 08:31:53.475 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 08:31:53.475 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 08:31:53.475 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 08:31:53.475 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 08:31:53.475 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 08:31:53.475 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 08:31:53.475 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 08:31:53.475 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 08:31:53.475 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 08:31:53.475 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:31:53.475 1 ERROR oslo_service.service 
>2018-06-26 08:31:53.478 1 CRITICAL cinder [req-b62ea8a3-a82b-405a-b12c-f3f070d8246a - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 08:31:53.478 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 08:31:53.478 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 08:31:53.478 1 ERROR cinder     sys.exit(main())
>2018-06-26 08:31:53.478 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 08:31:53.478 1 ERROR cinder     service.wait()
>2018-06-26 08:31:53.478 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 08:31:53.478 1 ERROR cinder     _launcher.wait()
>2018-06-26 08:31:53.478 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 08:31:53.478 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 08:31:53.478 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 08:31:53.478 1 ERROR cinder     self.services.wait()
>2018-06-26 08:31:53.478 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 08:31:53.478 1 ERROR cinder     service.wait()
>2018-06-26 08:31:53.478 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 08:31:53.478 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 08:31:53.478 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 08:31:53.478 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 08:31:53.478 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 08:31:53.478 1 ERROR cinder     post_fn = fn()
>2018-06-26 08:31:53.478 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 08:31:53.478 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 08:31:53.478 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 08:31:53.478 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 08:31:53.478 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 08:31:53.478 1 ERROR cinder 
>2018-06-26 08:31:56.161 1 WARNING cinder.scheduler.host_manager [req-22977827-a963-4b7f-afcb-137387d81e99 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 08:31:56.171 1 INFO cinder.rpc [req-22977827-a963-4b7f-afcb-137387d81e99 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 08:31:56.177 1 INFO cinder.rpc [req-22977827-a963-4b7f-afcb-137387d81e99 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 08:31:56.194 1 INFO cinder.rpc [req-22977827-a963-4b7f-afcb-137387d81e99 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 08:31:56.201 1 INFO cinder.rpc [req-22977827-a963-4b7f-afcb-137387d81e99 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 08:31:56.224 1 WARNING oslo_config.cfg [req-22977827-a963-4b7f-afcb-137387d81e99 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 08:31:56.226 1 WARNING oslo_config.cfg [req-22977827-a963-4b7f-afcb-137387d81e99 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:31:56.227 1 WARNING oslo_config.cfg [req-22977827-a963-4b7f-afcb-137387d81e99 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:31:56.228 1 WARNING oslo_config.cfg [req-22977827-a963-4b7f-afcb-137387d81e99 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:31:56.233 1 WARNING oslo_config.cfg [req-22977827-a963-4b7f-afcb-137387d81e99 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 08:31:56.235 1 WARNING oslo_config.cfg [req-22977827-a963-4b7f-afcb-137387d81e99 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 08:31:56.238 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 08:31:56.244 1 INFO cinder.manager [req-5f11c07e-15ae-48db-9922-4085aadfc5e1 - - - - -] Initiating service 5 cleanup
>2018-06-26 08:31:56.249 1 INFO cinder.manager [req-5f11c07e-15ae-48db-9922-4085aadfc5e1 - - - - -] Service 5 cleanup completed.
>2018-06-26 08:34:00.595 1 ERROR oslo.messaging._drivers.impl_rabbit [req-5f11c07e-15ae-48db-9922-4085aadfc5e1 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:34:00.597 1 ERROR oslo.messaging._drivers.impl_rabbit [req-5f11c07e-15ae-48db-9922-4085aadfc5e1 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:34:00.598 1 ERROR oslo_service.service [req-5f11c07e-15ae-48db-9922-4085aadfc5e1 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:34:00.598 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 08:34:00.598 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 08:34:00.598 1 ERROR oslo_service.service     service.start()
>2018-06-26 08:34:00.598 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 08:34:00.598 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 08:34:00.598 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 08:34:00.598 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 08:34:00.598 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 08:34:00.598 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 08:34:00.598 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 08:34:00.598 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 08:34:00.598 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 08:34:00.598 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 08:34:00.598 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 08:34:00.598 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 08:34:00.598 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 08:34:00.598 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 08:34:00.598 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 08:34:00.598 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 08:34:00.598 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 08:34:00.598 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 08:34:00.598 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 08:34:00.598 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 08:34:00.598 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 08:34:00.598 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 08:34:00.598 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:34:00.598 1 ERROR oslo_service.service 
>2018-06-26 08:34:00.601 1 CRITICAL cinder [req-22977827-a963-4b7f-afcb-137387d81e99 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 08:34:00.601 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 08:34:00.601 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 08:34:00.601 1 ERROR cinder     sys.exit(main())
>2018-06-26 08:34:00.601 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 08:34:00.601 1 ERROR cinder     service.wait()
>2018-06-26 08:34:00.601 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 08:34:00.601 1 ERROR cinder     _launcher.wait()
>2018-06-26 08:34:00.601 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 08:34:00.601 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 08:34:00.601 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 08:34:00.601 1 ERROR cinder     self.services.wait()
>2018-06-26 08:34:00.601 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 08:34:00.601 1 ERROR cinder     service.wait()
>2018-06-26 08:34:00.601 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 08:34:00.601 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 08:34:00.601 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 08:34:00.601 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 08:34:00.601 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 08:34:00.601 1 ERROR cinder     post_fn = fn()
>2018-06-26 08:34:00.601 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 08:34:00.601 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 08:34:00.601 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 08:34:00.601 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 08:34:00.601 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 08:34:00.601 1 ERROR cinder 
>2018-06-26 08:34:03.242 1 WARNING cinder.scheduler.host_manager [req-602a7689-6350-41ea-b9b4-10888210125f - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 08:34:03.247 1 INFO cinder.rpc [req-602a7689-6350-41ea-b9b4-10888210125f - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 08:34:03.254 1 INFO cinder.rpc [req-602a7689-6350-41ea-b9b4-10888210125f - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 08:34:03.265 1 INFO cinder.rpc [req-602a7689-6350-41ea-b9b4-10888210125f - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 08:34:03.271 1 INFO cinder.rpc [req-602a7689-6350-41ea-b9b4-10888210125f - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 08:34:03.294 1 WARNING oslo_config.cfg [req-602a7689-6350-41ea-b9b4-10888210125f - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 08:34:03.296 1 WARNING oslo_config.cfg [req-602a7689-6350-41ea-b9b4-10888210125f - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:34:03.296 1 WARNING oslo_config.cfg [req-602a7689-6350-41ea-b9b4-10888210125f - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:34:03.297 1 WARNING oslo_config.cfg [req-602a7689-6350-41ea-b9b4-10888210125f - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:34:03.302 1 WARNING oslo_config.cfg [req-602a7689-6350-41ea-b9b4-10888210125f - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 08:34:03.303 1 WARNING oslo_config.cfg [req-602a7689-6350-41ea-b9b4-10888210125f - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 08:34:03.305 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 08:34:03.311 1 INFO cinder.manager [req-b6bdfe58-ee2d-4010-bee6-c2cf5a62c711 - - - - -] Initiating service 5 cleanup
>2018-06-26 08:34:03.314 1 INFO cinder.manager [req-b6bdfe58-ee2d-4010-bee6-c2cf5a62c711 - - - - -] Service 5 cleanup completed.
>2018-06-26 08:36:07.778 1 ERROR oslo.messaging._drivers.impl_rabbit [req-b6bdfe58-ee2d-4010-bee6-c2cf5a62c711 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:36:07.780 1 ERROR oslo.messaging._drivers.impl_rabbit [req-b6bdfe58-ee2d-4010-bee6-c2cf5a62c711 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:36:07.780 1 ERROR oslo_service.service [req-b6bdfe58-ee2d-4010-bee6-c2cf5a62c711 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:36:07.780 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 08:36:07.780 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 08:36:07.780 1 ERROR oslo_service.service     service.start()
>2018-06-26 08:36:07.780 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 08:36:07.780 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 08:36:07.780 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 08:36:07.780 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 08:36:07.780 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 08:36:07.780 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 08:36:07.780 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 08:36:07.780 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 08:36:07.780 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 08:36:07.780 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 08:36:07.780 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 08:36:07.780 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 08:36:07.780 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 08:36:07.780 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 08:36:07.780 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 08:36:07.780 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 08:36:07.780 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 08:36:07.780 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 08:36:07.780 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 08:36:07.780 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 08:36:07.780 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 08:36:07.780 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 08:36:07.780 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:36:07.780 1 ERROR oslo_service.service 
>2018-06-26 08:36:07.783 1 CRITICAL cinder [req-602a7689-6350-41ea-b9b4-10888210125f - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 08:36:07.783 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 08:36:07.783 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 08:36:07.783 1 ERROR cinder     sys.exit(main())
>2018-06-26 08:36:07.783 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 08:36:07.783 1 ERROR cinder     service.wait()
>2018-06-26 08:36:07.783 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 08:36:07.783 1 ERROR cinder     _launcher.wait()
>2018-06-26 08:36:07.783 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 08:36:07.783 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 08:36:07.783 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 08:36:07.783 1 ERROR cinder     self.services.wait()
>2018-06-26 08:36:07.783 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 08:36:07.783 1 ERROR cinder     service.wait()
>2018-06-26 08:36:07.783 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 08:36:07.783 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 08:36:07.783 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 08:36:07.783 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 08:36:07.783 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 08:36:07.783 1 ERROR cinder     post_fn = fn()
>2018-06-26 08:36:07.783 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 08:36:07.783 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 08:36:07.783 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 08:36:07.783 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 08:36:07.783 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 08:36:07.783 1 ERROR cinder 
>2018-06-26 08:36:10.401 1 WARNING cinder.scheduler.host_manager [req-f2162af3-e22f-41c2-866a-3c3252a8c457 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 08:36:10.406 1 INFO cinder.rpc [req-f2162af3-e22f-41c2-866a-3c3252a8c457 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 08:36:10.411 1 INFO cinder.rpc [req-f2162af3-e22f-41c2-866a-3c3252a8c457 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 08:36:10.425 1 INFO cinder.rpc [req-f2162af3-e22f-41c2-866a-3c3252a8c457 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 08:36:10.431 1 INFO cinder.rpc [req-f2162af3-e22f-41c2-866a-3c3252a8c457 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 08:36:10.457 1 WARNING oslo_config.cfg [req-f2162af3-e22f-41c2-866a-3c3252a8c457 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 08:36:10.459 1 WARNING oslo_config.cfg [req-f2162af3-e22f-41c2-866a-3c3252a8c457 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:36:10.460 1 WARNING oslo_config.cfg [req-f2162af3-e22f-41c2-866a-3c3252a8c457 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:36:10.460 1 WARNING oslo_config.cfg [req-f2162af3-e22f-41c2-866a-3c3252a8c457 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:36:10.465 1 WARNING oslo_config.cfg [req-f2162af3-e22f-41c2-866a-3c3252a8c457 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 08:36:10.466 1 WARNING oslo_config.cfg [req-f2162af3-e22f-41c2-866a-3c3252a8c457 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 08:36:10.469 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 08:36:10.475 1 INFO cinder.manager [req-ee57340c-bdae-4764-b184-73b2e7c1d478 - - - - -] Initiating service 5 cleanup
>2018-06-26 08:36:10.482 1 INFO cinder.manager [req-ee57340c-bdae-4764-b184-73b2e7c1d478 - - - - -] Service 5 cleanup completed.
>2018-06-26 08:38:14.931 1 ERROR oslo.messaging._drivers.impl_rabbit [req-ee57340c-bdae-4764-b184-73b2e7c1d478 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:38:14.933 1 ERROR oslo.messaging._drivers.impl_rabbit [req-ee57340c-bdae-4764-b184-73b2e7c1d478 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:38:14.933 1 ERROR oslo_service.service [req-ee57340c-bdae-4764-b184-73b2e7c1d478 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:38:14.933 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 08:38:14.933 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 08:38:14.933 1 ERROR oslo_service.service     service.start()
>2018-06-26 08:38:14.933 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 08:38:14.933 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 08:38:14.933 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 08:38:14.933 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 08:38:14.933 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 08:38:14.933 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 08:38:14.933 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 08:38:14.933 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 08:38:14.933 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 08:38:14.933 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 08:38:14.933 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 08:38:14.933 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 08:38:14.933 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 08:38:14.933 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 08:38:14.933 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 08:38:14.933 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 08:38:14.933 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 08:38:14.933 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 08:38:14.933 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 08:38:14.933 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 08:38:14.933 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 08:38:14.933 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 08:38:14.933 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:38:14.933 1 ERROR oslo_service.service 
>2018-06-26 08:38:14.936 1 CRITICAL cinder [req-f2162af3-e22f-41c2-866a-3c3252a8c457 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 08:38:14.936 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 08:38:14.936 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 08:38:14.936 1 ERROR cinder     sys.exit(main())
>2018-06-26 08:38:14.936 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 08:38:14.936 1 ERROR cinder     service.wait()
>2018-06-26 08:38:14.936 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 08:38:14.936 1 ERROR cinder     _launcher.wait()
>2018-06-26 08:38:14.936 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 08:38:14.936 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 08:38:14.936 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 08:38:14.936 1 ERROR cinder     self.services.wait()
>2018-06-26 08:38:14.936 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 08:38:14.936 1 ERROR cinder     service.wait()
>2018-06-26 08:38:14.936 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 08:38:14.936 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 08:38:14.936 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 08:38:14.936 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 08:38:14.936 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 08:38:14.936 1 ERROR cinder     post_fn = fn()
>2018-06-26 08:38:14.936 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 08:38:14.936 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 08:38:14.936 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 08:38:14.936 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 08:38:14.936 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 08:38:14.936 1 ERROR cinder 
>2018-06-26 08:38:17.545 1 WARNING cinder.scheduler.host_manager [req-7963cfbb-6f39-4063-b219-d8f78f7869b2 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 08:38:17.551 1 INFO cinder.rpc [req-7963cfbb-6f39-4063-b219-d8f78f7869b2 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 08:38:17.559 1 INFO cinder.rpc [req-7963cfbb-6f39-4063-b219-d8f78f7869b2 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 08:38:17.572 1 INFO cinder.rpc [req-7963cfbb-6f39-4063-b219-d8f78f7869b2 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 08:38:17.578 1 INFO cinder.rpc [req-7963cfbb-6f39-4063-b219-d8f78f7869b2 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 08:38:17.603 1 WARNING oslo_config.cfg [req-7963cfbb-6f39-4063-b219-d8f78f7869b2 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 08:38:17.605 1 WARNING oslo_config.cfg [req-7963cfbb-6f39-4063-b219-d8f78f7869b2 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:38:17.606 1 WARNING oslo_config.cfg [req-7963cfbb-6f39-4063-b219-d8f78f7869b2 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:38:17.607 1 WARNING oslo_config.cfg [req-7963cfbb-6f39-4063-b219-d8f78f7869b2 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:38:17.612 1 WARNING oslo_config.cfg [req-7963cfbb-6f39-4063-b219-d8f78f7869b2 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 08:38:17.613 1 WARNING oslo_config.cfg [req-7963cfbb-6f39-4063-b219-d8f78f7869b2 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 08:38:17.616 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 08:38:17.622 1 INFO cinder.manager [req-9b09b597-056c-4463-b5a6-028e3589a923 - - - - -] Initiating service 5 cleanup
>2018-06-26 08:38:17.629 1 INFO cinder.manager [req-9b09b597-056c-4463-b5a6-028e3589a923 - - - - -] Service 5 cleanup completed.
>2018-06-26 08:40:22.074 1 ERROR oslo.messaging._drivers.impl_rabbit [req-9b09b597-056c-4463-b5a6-028e3589a923 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:40:22.076 1 ERROR oslo.messaging._drivers.impl_rabbit [req-9b09b597-056c-4463-b5a6-028e3589a923 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:40:22.076 1 ERROR oslo_service.service [req-9b09b597-056c-4463-b5a6-028e3589a923 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:40:22.076 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 08:40:22.076 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 08:40:22.076 1 ERROR oslo_service.service     service.start()
>2018-06-26 08:40:22.076 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 08:40:22.076 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 08:40:22.076 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 08:40:22.076 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 08:40:22.076 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 08:40:22.076 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 08:40:22.076 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 08:40:22.076 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 08:40:22.076 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 08:40:22.076 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 08:40:22.076 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 08:40:22.076 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 08:40:22.076 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 08:40:22.076 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 08:40:22.076 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 08:40:22.076 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 08:40:22.076 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 08:40:22.076 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 08:40:22.076 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 08:40:22.076 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 08:40:22.076 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 08:40:22.076 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 08:40:22.076 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:40:22.076 1 ERROR oslo_service.service 
>2018-06-26 08:40:22.079 1 CRITICAL cinder [req-7963cfbb-6f39-4063-b219-d8f78f7869b2 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 08:40:22.079 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 08:40:22.079 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 08:40:22.079 1 ERROR cinder     sys.exit(main())
>2018-06-26 08:40:22.079 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 08:40:22.079 1 ERROR cinder     service.wait()
>2018-06-26 08:40:22.079 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 08:40:22.079 1 ERROR cinder     _launcher.wait()
>2018-06-26 08:40:22.079 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 08:40:22.079 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 08:40:22.079 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 08:40:22.079 1 ERROR cinder     self.services.wait()
>2018-06-26 08:40:22.079 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 08:40:22.079 1 ERROR cinder     service.wait()
>2018-06-26 08:40:22.079 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 08:40:22.079 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 08:40:22.079 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 08:40:22.079 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 08:40:22.079 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 08:40:22.079 1 ERROR cinder     post_fn = fn()
>2018-06-26 08:40:22.079 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 08:40:22.079 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 08:40:22.079 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 08:40:22.079 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 08:40:22.079 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 08:40:22.079 1 ERROR cinder 
>2018-06-26 08:40:24.682 1 WARNING cinder.scheduler.host_manager [req-9d033267-fbc9-4ce3-8dcb-4789deb77ce6 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 08:40:24.688 1 INFO cinder.rpc [req-9d033267-fbc9-4ce3-8dcb-4789deb77ce6 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 08:40:24.693 1 INFO cinder.rpc [req-9d033267-fbc9-4ce3-8dcb-4789deb77ce6 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 08:40:24.704 1 INFO cinder.rpc [req-9d033267-fbc9-4ce3-8dcb-4789deb77ce6 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 08:40:24.711 1 INFO cinder.rpc [req-9d033267-fbc9-4ce3-8dcb-4789deb77ce6 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 08:40:24.735 1 WARNING oslo_config.cfg [req-9d033267-fbc9-4ce3-8dcb-4789deb77ce6 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 08:40:24.737 1 WARNING oslo_config.cfg [req-9d033267-fbc9-4ce3-8dcb-4789deb77ce6 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:40:24.738 1 WARNING oslo_config.cfg [req-9d033267-fbc9-4ce3-8dcb-4789deb77ce6 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:40:24.739 1 WARNING oslo_config.cfg [req-9d033267-fbc9-4ce3-8dcb-4789deb77ce6 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:40:24.744 1 WARNING oslo_config.cfg [req-9d033267-fbc9-4ce3-8dcb-4789deb77ce6 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 08:40:24.745 1 WARNING oslo_config.cfg [req-9d033267-fbc9-4ce3-8dcb-4789deb77ce6 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 08:40:24.748 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 08:40:24.754 1 INFO cinder.manager [req-32b71a9f-c7fb-42d9-be31-ffe8ae6870e7 - - - - -] Initiating service 5 cleanup
>2018-06-26 08:40:24.759 1 INFO cinder.manager [req-32b71a9f-c7fb-42d9-be31-ffe8ae6870e7 - - - - -] Service 5 cleanup completed.
>2018-06-26 08:42:37.476 1 ERROR oslo.messaging._drivers.impl_rabbit [req-32b71a9f-c7fb-42d9-be31-ffe8ae6870e7 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:42:37.479 1 ERROR oslo.messaging._drivers.impl_rabbit [req-32b71a9f-c7fb-42d9-be31-ffe8ae6870e7 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:42:37.479 1 ERROR oslo_service.service [req-32b71a9f-c7fb-42d9-be31-ffe8ae6870e7 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:42:37.479 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 08:42:37.479 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 08:42:37.479 1 ERROR oslo_service.service     service.start()
>2018-06-26 08:42:37.479 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 08:42:37.479 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 08:42:37.479 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 08:42:37.479 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 08:42:37.479 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 08:42:37.479 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 08:42:37.479 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 08:42:37.479 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 08:42:37.479 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 08:42:37.479 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 08:42:37.479 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 08:42:37.479 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 08:42:37.479 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 08:42:37.479 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 08:42:37.479 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 08:42:37.479 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 08:42:37.479 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 08:42:37.479 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 08:42:37.479 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 08:42:37.479 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 08:42:37.479 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 08:42:37.479 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 08:42:37.479 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:42:37.479 1 ERROR oslo_service.service 
>2018-06-26 08:42:37.483 1 CRITICAL cinder [req-9d033267-fbc9-4ce3-8dcb-4789deb77ce6 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 08:42:37.483 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 08:42:37.483 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 08:42:37.483 1 ERROR cinder     sys.exit(main())
>2018-06-26 08:42:37.483 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 08:42:37.483 1 ERROR cinder     service.wait()
>2018-06-26 08:42:37.483 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 08:42:37.483 1 ERROR cinder     _launcher.wait()
>2018-06-26 08:42:37.483 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 08:42:37.483 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 08:42:37.483 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 08:42:37.483 1 ERROR cinder     self.services.wait()
>2018-06-26 08:42:37.483 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 08:42:37.483 1 ERROR cinder     service.wait()
>2018-06-26 08:42:37.483 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 08:42:37.483 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 08:42:37.483 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 08:42:37.483 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 08:42:37.483 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 08:42:37.483 1 ERROR cinder     post_fn = fn()
>2018-06-26 08:42:37.483 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 08:42:37.483 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 08:42:37.483 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 08:42:37.483 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 08:42:37.483 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 08:42:37.483 1 ERROR cinder 
>2018-06-26 08:42:40.130 1 WARNING cinder.scheduler.host_manager [req-7016b235-28bd-435d-8961-dbaf792bbb00 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 08:42:40.136 1 INFO cinder.rpc [req-7016b235-28bd-435d-8961-dbaf792bbb00 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 08:42:40.142 1 INFO cinder.rpc [req-7016b235-28bd-435d-8961-dbaf792bbb00 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 08:42:40.155 1 INFO cinder.rpc [req-7016b235-28bd-435d-8961-dbaf792bbb00 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 08:42:40.160 1 INFO cinder.rpc [req-7016b235-28bd-435d-8961-dbaf792bbb00 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 08:42:40.184 1 WARNING oslo_config.cfg [req-7016b235-28bd-435d-8961-dbaf792bbb00 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 08:42:40.186 1 WARNING oslo_config.cfg [req-7016b235-28bd-435d-8961-dbaf792bbb00 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:42:40.187 1 WARNING oslo_config.cfg [req-7016b235-28bd-435d-8961-dbaf792bbb00 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:42:40.187 1 WARNING oslo_config.cfg [req-7016b235-28bd-435d-8961-dbaf792bbb00 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:42:40.193 1 WARNING oslo_config.cfg [req-7016b235-28bd-435d-8961-dbaf792bbb00 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 08:42:40.194 1 WARNING oslo_config.cfg [req-7016b235-28bd-435d-8961-dbaf792bbb00 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 08:42:40.197 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 08:42:40.204 1 INFO cinder.manager [req-75b397d5-0582-431a-a097-c76fa2d51650 - - - - -] Initiating service 5 cleanup
>2018-06-26 08:42:40.209 1 INFO cinder.manager [req-75b397d5-0582-431a-a097-c76fa2d51650 - - - - -] Service 5 cleanup completed.
>2018-06-26 08:44:44.720 1 ERROR oslo.messaging._drivers.impl_rabbit [req-75b397d5-0582-431a-a097-c76fa2d51650 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:44:44.722 1 ERROR oslo.messaging._drivers.impl_rabbit [req-75b397d5-0582-431a-a097-c76fa2d51650 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:44:44.722 1 ERROR oslo_service.service [req-75b397d5-0582-431a-a097-c76fa2d51650 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:44:44.722 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 08:44:44.722 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 08:44:44.722 1 ERROR oslo_service.service     service.start()
>2018-06-26 08:44:44.722 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 08:44:44.722 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 08:44:44.722 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 08:44:44.722 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 08:44:44.722 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 08:44:44.722 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 08:44:44.722 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 08:44:44.722 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 08:44:44.722 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 08:44:44.722 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 08:44:44.722 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 08:44:44.722 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 08:44:44.722 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 08:44:44.722 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 08:44:44.722 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 08:44:44.722 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 08:44:44.722 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 08:44:44.722 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 08:44:44.722 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 08:44:44.722 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 08:44:44.722 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 08:44:44.722 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 08:44:44.722 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:44:44.722 1 ERROR oslo_service.service 
>2018-06-26 08:44:44.727 1 CRITICAL cinder [req-7016b235-28bd-435d-8961-dbaf792bbb00 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 08:44:44.727 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 08:44:44.727 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 08:44:44.727 1 ERROR cinder     sys.exit(main())
>2018-06-26 08:44:44.727 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 08:44:44.727 1 ERROR cinder     service.wait()
>2018-06-26 08:44:44.727 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 08:44:44.727 1 ERROR cinder     _launcher.wait()
>2018-06-26 08:44:44.727 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 08:44:44.727 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 08:44:44.727 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 08:44:44.727 1 ERROR cinder     self.services.wait()
>2018-06-26 08:44:44.727 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 08:44:44.727 1 ERROR cinder     service.wait()
>2018-06-26 08:44:44.727 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 08:44:44.727 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 08:44:44.727 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 08:44:44.727 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 08:44:44.727 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 08:44:44.727 1 ERROR cinder     post_fn = fn()
>2018-06-26 08:44:44.727 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 08:44:44.727 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 08:44:44.727 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 08:44:44.727 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 08:44:44.727 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 08:44:44.727 1 ERROR cinder 
>2018-06-26 08:44:47.541 1 WARNING cinder.scheduler.host_manager [req-e2f0c7f0-9331-46af-97d6-ec256b37b2e7 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 08:44:47.547 1 INFO cinder.rpc [req-e2f0c7f0-9331-46af-97d6-ec256b37b2e7 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 08:44:47.557 1 INFO cinder.rpc [req-e2f0c7f0-9331-46af-97d6-ec256b37b2e7 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 08:44:47.571 1 INFO cinder.rpc [req-e2f0c7f0-9331-46af-97d6-ec256b37b2e7 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 08:44:47.577 1 INFO cinder.rpc [req-e2f0c7f0-9331-46af-97d6-ec256b37b2e7 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 08:44:47.605 1 WARNING oslo_config.cfg [req-e2f0c7f0-9331-46af-97d6-ec256b37b2e7 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 08:44:47.607 1 WARNING oslo_config.cfg [req-e2f0c7f0-9331-46af-97d6-ec256b37b2e7 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:44:47.607 1 WARNING oslo_config.cfg [req-e2f0c7f0-9331-46af-97d6-ec256b37b2e7 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:44:47.608 1 WARNING oslo_config.cfg [req-e2f0c7f0-9331-46af-97d6-ec256b37b2e7 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:44:47.613 1 WARNING oslo_config.cfg [req-e2f0c7f0-9331-46af-97d6-ec256b37b2e7 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 08:44:47.614 1 WARNING oslo_config.cfg [req-e2f0c7f0-9331-46af-97d6-ec256b37b2e7 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 08:44:47.617 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 08:44:47.623 1 INFO cinder.manager [req-31249c4d-86cf-422a-9c2b-89c176742571 - - - - -] Initiating service 5 cleanup
>2018-06-26 08:44:47.631 1 INFO cinder.manager [req-31249c4d-86cf-422a-9c2b-89c176742571 - - - - -] Service 5 cleanup completed.
>2018-06-26 08:46:52.152 1 ERROR oslo.messaging._drivers.impl_rabbit [req-31249c4d-86cf-422a-9c2b-89c176742571 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:46:52.154 1 ERROR oslo.messaging._drivers.impl_rabbit [req-31249c4d-86cf-422a-9c2b-89c176742571 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:46:52.154 1 ERROR oslo_service.service [req-31249c4d-86cf-422a-9c2b-89c176742571 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:46:52.154 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 08:46:52.154 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 08:46:52.154 1 ERROR oslo_service.service     service.start()
>2018-06-26 08:46:52.154 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 08:46:52.154 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 08:46:52.154 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 08:46:52.154 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 08:46:52.154 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 08:46:52.154 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 08:46:52.154 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 08:46:52.154 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 08:46:52.154 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 08:46:52.154 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 08:46:52.154 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 08:46:52.154 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 08:46:52.154 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 08:46:52.154 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 08:46:52.154 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 08:46:52.154 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 08:46:52.154 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 08:46:52.154 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 08:46:52.154 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 08:46:52.154 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 08:46:52.154 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 08:46:52.154 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 08:46:52.154 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:46:52.154 1 ERROR oslo_service.service 
>2018-06-26 08:46:52.157 1 CRITICAL cinder [req-e2f0c7f0-9331-46af-97d6-ec256b37b2e7 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 08:46:52.157 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 08:46:52.157 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 08:46:52.157 1 ERROR cinder     sys.exit(main())
>2018-06-26 08:46:52.157 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 08:46:52.157 1 ERROR cinder     service.wait()
>2018-06-26 08:46:52.157 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 08:46:52.157 1 ERROR cinder     _launcher.wait()
>2018-06-26 08:46:52.157 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 08:46:52.157 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 08:46:52.157 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 08:46:52.157 1 ERROR cinder     self.services.wait()
>2018-06-26 08:46:52.157 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 08:46:52.157 1 ERROR cinder     service.wait()
>2018-06-26 08:46:52.157 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 08:46:52.157 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 08:46:52.157 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 08:46:52.157 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 08:46:52.157 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 08:46:52.157 1 ERROR cinder     post_fn = fn()
>2018-06-26 08:46:52.157 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 08:46:52.157 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 08:46:52.157 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 08:46:52.157 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 08:46:52.157 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 08:46:52.157 1 ERROR cinder 
>2018-06-26 08:46:54.744 1 WARNING cinder.scheduler.host_manager [req-f54d16a8-e63a-4baa-b159-2b6a2d3411a4 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 08:46:54.750 1 INFO cinder.rpc [req-f54d16a8-e63a-4baa-b159-2b6a2d3411a4 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 08:46:54.755 1 INFO cinder.rpc [req-f54d16a8-e63a-4baa-b159-2b6a2d3411a4 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 08:46:54.766 1 INFO cinder.rpc [req-f54d16a8-e63a-4baa-b159-2b6a2d3411a4 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 08:46:54.772 1 INFO cinder.rpc [req-f54d16a8-e63a-4baa-b159-2b6a2d3411a4 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 08:46:54.797 1 WARNING oslo_config.cfg [req-f54d16a8-e63a-4baa-b159-2b6a2d3411a4 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 08:46:54.799 1 WARNING oslo_config.cfg [req-f54d16a8-e63a-4baa-b159-2b6a2d3411a4 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:46:54.799 1 WARNING oslo_config.cfg [req-f54d16a8-e63a-4baa-b159-2b6a2d3411a4 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:46:54.800 1 WARNING oslo_config.cfg [req-f54d16a8-e63a-4baa-b159-2b6a2d3411a4 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:46:54.805 1 WARNING oslo_config.cfg [req-f54d16a8-e63a-4baa-b159-2b6a2d3411a4 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 08:46:54.806 1 WARNING oslo_config.cfg [req-f54d16a8-e63a-4baa-b159-2b6a2d3411a4 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 08:46:54.809 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 08:46:54.815 1 INFO cinder.manager [req-80be0577-b7c2-4fdb-8a52-15c4e13192fb - - - - -] Initiating service 5 cleanup
>2018-06-26 08:46:54.819 1 INFO cinder.manager [req-80be0577-b7c2-4fdb-8a52-15c4e13192fb - - - - -] Service 5 cleanup completed.
>2018-06-26 08:49:00.923 1 ERROR oslo.messaging._drivers.impl_rabbit [req-80be0577-b7c2-4fdb-8a52-15c4e13192fb - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:49:00.925 1 ERROR oslo.messaging._drivers.impl_rabbit [req-80be0577-b7c2-4fdb-8a52-15c4e13192fb - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:49:00.925 1 ERROR oslo_service.service [req-80be0577-b7c2-4fdb-8a52-15c4e13192fb - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:49:00.925 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 08:49:00.925 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 08:49:00.925 1 ERROR oslo_service.service     service.start()
>2018-06-26 08:49:00.925 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 08:49:00.925 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 08:49:00.925 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 08:49:00.925 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 08:49:00.925 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 08:49:00.925 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 08:49:00.925 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 08:49:00.925 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 08:49:00.925 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 08:49:00.925 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 08:49:00.925 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 08:49:00.925 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 08:49:00.925 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 08:49:00.925 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 08:49:00.925 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 08:49:00.925 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 08:49:00.925 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 08:49:00.925 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 08:49:00.925 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 08:49:00.925 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 08:49:00.925 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 08:49:00.925 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 08:49:00.925 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:49:00.925 1 ERROR oslo_service.service 
>2018-06-26 08:49:00.928 1 CRITICAL cinder [req-f54d16a8-e63a-4baa-b159-2b6a2d3411a4 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 08:49:00.928 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 08:49:00.928 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 08:49:00.928 1 ERROR cinder     sys.exit(main())
>2018-06-26 08:49:00.928 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 08:49:00.928 1 ERROR cinder     service.wait()
>2018-06-26 08:49:00.928 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 08:49:00.928 1 ERROR cinder     _launcher.wait()
>2018-06-26 08:49:00.928 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 08:49:00.928 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 08:49:00.928 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 08:49:00.928 1 ERROR cinder     self.services.wait()
>2018-06-26 08:49:00.928 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 08:49:00.928 1 ERROR cinder     service.wait()
>2018-06-26 08:49:00.928 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 08:49:00.928 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 08:49:00.928 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 08:49:00.928 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 08:49:00.928 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 08:49:00.928 1 ERROR cinder     post_fn = fn()
>2018-06-26 08:49:00.928 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 08:49:00.928 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 08:49:00.928 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 08:49:00.928 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 08:49:00.928 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 08:49:00.928 1 ERROR cinder 
>2018-06-26 08:49:03.482 1 WARNING cinder.scheduler.host_manager [req-88c7ce80-c171-427b-a1fc-70c14bb17ab7 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 08:49:03.488 1 INFO cinder.rpc [req-88c7ce80-c171-427b-a1fc-70c14bb17ab7 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 08:49:03.494 1 INFO cinder.rpc [req-88c7ce80-c171-427b-a1fc-70c14bb17ab7 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 08:49:03.504 1 INFO cinder.rpc [req-88c7ce80-c171-427b-a1fc-70c14bb17ab7 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 08:49:03.510 1 INFO cinder.rpc [req-88c7ce80-c171-427b-a1fc-70c14bb17ab7 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 08:49:03.532 1 WARNING oslo_config.cfg [req-88c7ce80-c171-427b-a1fc-70c14bb17ab7 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 08:49:03.534 1 WARNING oslo_config.cfg [req-88c7ce80-c171-427b-a1fc-70c14bb17ab7 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:49:03.535 1 WARNING oslo_config.cfg [req-88c7ce80-c171-427b-a1fc-70c14bb17ab7 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:49:03.535 1 WARNING oslo_config.cfg [req-88c7ce80-c171-427b-a1fc-70c14bb17ab7 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:49:03.540 1 WARNING oslo_config.cfg [req-88c7ce80-c171-427b-a1fc-70c14bb17ab7 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 08:49:03.541 1 WARNING oslo_config.cfg [req-88c7ce80-c171-427b-a1fc-70c14bb17ab7 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 08:49:03.543 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 08:49:03.549 1 INFO cinder.manager [req-523891fb-0e9d-49df-976a-7331a83e5ad6 - - - - -] Initiating service 5 cleanup
>2018-06-26 08:49:03.553 1 INFO cinder.manager [req-523891fb-0e9d-49df-976a-7331a83e5ad6 - - - - -] Service 5 cleanup completed.
>2018-06-26 08:51:09.567 1 ERROR oslo.messaging._drivers.impl_rabbit [req-523891fb-0e9d-49df-976a-7331a83e5ad6 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:51:09.569 1 ERROR oslo.messaging._drivers.impl_rabbit [req-523891fb-0e9d-49df-976a-7331a83e5ad6 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:51:09.569 1 ERROR oslo_service.service [req-523891fb-0e9d-49df-976a-7331a83e5ad6 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:51:09.569 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 08:51:09.569 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 08:51:09.569 1 ERROR oslo_service.service     service.start()
>2018-06-26 08:51:09.569 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 08:51:09.569 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 08:51:09.569 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 08:51:09.569 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 08:51:09.569 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 08:51:09.569 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 08:51:09.569 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 08:51:09.569 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 08:51:09.569 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 08:51:09.569 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 08:51:09.569 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 08:51:09.569 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 08:51:09.569 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 08:51:09.569 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 08:51:09.569 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 08:51:09.569 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 08:51:09.569 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 08:51:09.569 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 08:51:09.569 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 08:51:09.569 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 08:51:09.569 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 08:51:09.569 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 08:51:09.569 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:51:09.569 1 ERROR oslo_service.service 
>2018-06-26 08:51:09.572 1 CRITICAL cinder [req-88c7ce80-c171-427b-a1fc-70c14bb17ab7 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 08:51:09.572 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 08:51:09.572 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 08:51:09.572 1 ERROR cinder     sys.exit(main())
>2018-06-26 08:51:09.572 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 08:51:09.572 1 ERROR cinder     service.wait()
>2018-06-26 08:51:09.572 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 08:51:09.572 1 ERROR cinder     _launcher.wait()
>2018-06-26 08:51:09.572 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 08:51:09.572 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 08:51:09.572 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 08:51:09.572 1 ERROR cinder     self.services.wait()
>2018-06-26 08:51:09.572 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 08:51:09.572 1 ERROR cinder     service.wait()
>2018-06-26 08:51:09.572 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 08:51:09.572 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 08:51:09.572 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 08:51:09.572 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 08:51:09.572 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 08:51:09.572 1 ERROR cinder     post_fn = fn()
>2018-06-26 08:51:09.572 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 08:51:09.572 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 08:51:09.572 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 08:51:09.572 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 08:51:09.572 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 08:51:09.572 1 ERROR cinder 
>2018-06-26 08:51:12.215 1 WARNING cinder.scheduler.host_manager [req-26e1be78-efe1-43e6-ad80-69088420bf22 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 08:51:12.220 1 INFO cinder.rpc [req-26e1be78-efe1-43e6-ad80-69088420bf22 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 08:51:12.225 1 INFO cinder.rpc [req-26e1be78-efe1-43e6-ad80-69088420bf22 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 08:51:12.235 1 INFO cinder.rpc [req-26e1be78-efe1-43e6-ad80-69088420bf22 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 08:51:12.243 1 INFO cinder.rpc [req-26e1be78-efe1-43e6-ad80-69088420bf22 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 08:51:12.271 1 WARNING oslo_config.cfg [req-26e1be78-efe1-43e6-ad80-69088420bf22 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 08:51:12.273 1 WARNING oslo_config.cfg [req-26e1be78-efe1-43e6-ad80-69088420bf22 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:51:12.274 1 WARNING oslo_config.cfg [req-26e1be78-efe1-43e6-ad80-69088420bf22 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:51:12.274 1 WARNING oslo_config.cfg [req-26e1be78-efe1-43e6-ad80-69088420bf22 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:51:12.280 1 WARNING oslo_config.cfg [req-26e1be78-efe1-43e6-ad80-69088420bf22 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 08:51:12.281 1 WARNING oslo_config.cfg [req-26e1be78-efe1-43e6-ad80-69088420bf22 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 08:51:12.284 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 08:51:12.290 1 INFO cinder.manager [req-07b885fa-6e03-4bdb-b00c-300f862eac44 - - - - -] Initiating service 5 cleanup
>2018-06-26 08:51:12.295 1 INFO cinder.manager [req-07b885fa-6e03-4bdb-b00c-300f862eac44 - - - - -] Service 5 cleanup completed.
>2018-06-26 08:53:16.843 1 ERROR oslo.messaging._drivers.impl_rabbit [req-07b885fa-6e03-4bdb-b00c-300f862eac44 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:53:16.845 1 ERROR oslo.messaging._drivers.impl_rabbit [req-07b885fa-6e03-4bdb-b00c-300f862eac44 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:53:16.846 1 ERROR oslo_service.service [req-07b885fa-6e03-4bdb-b00c-300f862eac44 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:53:16.846 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 08:53:16.846 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 08:53:16.846 1 ERROR oslo_service.service     service.start()
>2018-06-26 08:53:16.846 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 08:53:16.846 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 08:53:16.846 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 08:53:16.846 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 08:53:16.846 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 08:53:16.846 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 08:53:16.846 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 08:53:16.846 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 08:53:16.846 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 08:53:16.846 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 08:53:16.846 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 08:53:16.846 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 08:53:16.846 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 08:53:16.846 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 08:53:16.846 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 08:53:16.846 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 08:53:16.846 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 08:53:16.846 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 08:53:16.846 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 08:53:16.846 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 08:53:16.846 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 08:53:16.846 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 08:53:16.846 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:53:16.846 1 ERROR oslo_service.service 
>2018-06-26 08:53:16.849 1 CRITICAL cinder [req-26e1be78-efe1-43e6-ad80-69088420bf22 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 08:53:16.849 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 08:53:16.849 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 08:53:16.849 1 ERROR cinder     sys.exit(main())
>2018-06-26 08:53:16.849 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 08:53:16.849 1 ERROR cinder     service.wait()
>2018-06-26 08:53:16.849 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 08:53:16.849 1 ERROR cinder     _launcher.wait()
>2018-06-26 08:53:16.849 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 08:53:16.849 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 08:53:16.849 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 08:53:16.849 1 ERROR cinder     self.services.wait()
>2018-06-26 08:53:16.849 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 08:53:16.849 1 ERROR cinder     service.wait()
>2018-06-26 08:53:16.849 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 08:53:16.849 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 08:53:16.849 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 08:53:16.849 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 08:53:16.849 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 08:53:16.849 1 ERROR cinder     post_fn = fn()
>2018-06-26 08:53:16.849 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 08:53:16.849 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 08:53:16.849 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 08:53:16.849 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 08:53:16.849 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 08:53:16.849 1 ERROR cinder 
>2018-06-26 08:53:19.373 1 WARNING cinder.scheduler.host_manager [req-9f25787a-7490-4fff-a440-8cc03b2558e1 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 08:53:19.379 1 INFO cinder.rpc [req-9f25787a-7490-4fff-a440-8cc03b2558e1 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 08:53:19.386 1 INFO cinder.rpc [req-9f25787a-7490-4fff-a440-8cc03b2558e1 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 08:53:19.407 1 INFO cinder.rpc [req-9f25787a-7490-4fff-a440-8cc03b2558e1 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 08:53:19.415 1 INFO cinder.rpc [req-9f25787a-7490-4fff-a440-8cc03b2558e1 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 08:53:19.441 1 WARNING oslo_config.cfg [req-9f25787a-7490-4fff-a440-8cc03b2558e1 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 08:53:19.443 1 WARNING oslo_config.cfg [req-9f25787a-7490-4fff-a440-8cc03b2558e1 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:53:19.443 1 WARNING oslo_config.cfg [req-9f25787a-7490-4fff-a440-8cc03b2558e1 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:53:19.444 1 WARNING oslo_config.cfg [req-9f25787a-7490-4fff-a440-8cc03b2558e1 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:53:19.449 1 WARNING oslo_config.cfg [req-9f25787a-7490-4fff-a440-8cc03b2558e1 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 08:53:19.450 1 WARNING oslo_config.cfg [req-9f25787a-7490-4fff-a440-8cc03b2558e1 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 08:53:19.452 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 08:53:19.460 1 INFO cinder.manager [req-2942065d-0b8b-4a02-9d23-4ba260f9871f - - - - -] Initiating service 5 cleanup
>2018-06-26 08:53:19.464 1 INFO cinder.manager [req-2942065d-0b8b-4a02-9d23-4ba260f9871f - - - - -] Service 5 cleanup completed.
>2018-06-26 08:55:25.705 1 ERROR oslo.messaging._drivers.impl_rabbit [req-2942065d-0b8b-4a02-9d23-4ba260f9871f - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:55:25.707 1 ERROR oslo.messaging._drivers.impl_rabbit [req-2942065d-0b8b-4a02-9d23-4ba260f9871f - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:55:25.707 1 ERROR oslo_service.service [req-2942065d-0b8b-4a02-9d23-4ba260f9871f - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:55:25.707 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 08:55:25.707 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 08:55:25.707 1 ERROR oslo_service.service     service.start()
>2018-06-26 08:55:25.707 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 08:55:25.707 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 08:55:25.707 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 08:55:25.707 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 08:55:25.707 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 08:55:25.707 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 08:55:25.707 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 08:55:25.707 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 08:55:25.707 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 08:55:25.707 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 08:55:25.707 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 08:55:25.707 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 08:55:25.707 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 08:55:25.707 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 08:55:25.707 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 08:55:25.707 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 08:55:25.707 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 08:55:25.707 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 08:55:25.707 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 08:55:25.707 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 08:55:25.707 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 08:55:25.707 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 08:55:25.707 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:55:25.707 1 ERROR oslo_service.service 
>2018-06-26 08:55:25.710 1 CRITICAL cinder [req-9f25787a-7490-4fff-a440-8cc03b2558e1 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 08:55:25.710 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 08:55:25.710 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 08:55:25.710 1 ERROR cinder     sys.exit(main())
>2018-06-26 08:55:25.710 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 08:55:25.710 1 ERROR cinder     service.wait()
>2018-06-26 08:55:25.710 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 08:55:25.710 1 ERROR cinder     _launcher.wait()
>2018-06-26 08:55:25.710 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 08:55:25.710 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 08:55:25.710 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 08:55:25.710 1 ERROR cinder     self.services.wait()
>2018-06-26 08:55:25.710 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 08:55:25.710 1 ERROR cinder     service.wait()
>2018-06-26 08:55:25.710 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 08:55:25.710 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 08:55:25.710 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 08:55:25.710 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 08:55:25.710 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 08:55:25.710 1 ERROR cinder     post_fn = fn()
>2018-06-26 08:55:25.710 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 08:55:25.710 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 08:55:25.710 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 08:55:25.710 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 08:55:25.710 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 08:55:25.710 1 ERROR cinder 
>2018-06-26 08:55:28.485 1 WARNING cinder.scheduler.host_manager [req-cf0296a9-f5fc-40a0-a24a-3ff90528b442 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 08:55:28.492 1 INFO cinder.rpc [req-cf0296a9-f5fc-40a0-a24a-3ff90528b442 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 08:55:28.499 1 INFO cinder.rpc [req-cf0296a9-f5fc-40a0-a24a-3ff90528b442 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 08:55:28.518 1 INFO cinder.rpc [req-cf0296a9-f5fc-40a0-a24a-3ff90528b442 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 08:55:28.527 1 INFO cinder.rpc [req-cf0296a9-f5fc-40a0-a24a-3ff90528b442 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 08:55:28.554 1 WARNING oslo_config.cfg [req-cf0296a9-f5fc-40a0-a24a-3ff90528b442 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 08:55:28.557 1 WARNING oslo_config.cfg [req-cf0296a9-f5fc-40a0-a24a-3ff90528b442 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:55:28.557 1 WARNING oslo_config.cfg [req-cf0296a9-f5fc-40a0-a24a-3ff90528b442 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:55:28.558 1 WARNING oslo_config.cfg [req-cf0296a9-f5fc-40a0-a24a-3ff90528b442 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:55:28.564 1 WARNING oslo_config.cfg [req-cf0296a9-f5fc-40a0-a24a-3ff90528b442 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 08:55:28.566 1 WARNING oslo_config.cfg [req-cf0296a9-f5fc-40a0-a24a-3ff90528b442 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 08:55:28.569 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 08:55:28.576 1 INFO cinder.manager [req-1fc87d73-9c4a-431a-a758-d64ac82b2540 - - - - -] Initiating service 5 cleanup
>2018-06-26 08:55:28.581 1 INFO cinder.manager [req-1fc87d73-9c4a-431a-a758-d64ac82b2540 - - - - -] Service 5 cleanup completed.
>2018-06-26 08:57:41.839 1 ERROR oslo.messaging._drivers.impl_rabbit [req-1fc87d73-9c4a-431a-a758-d64ac82b2540 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:57:41.842 1 ERROR oslo.messaging._drivers.impl_rabbit [req-1fc87d73-9c4a-431a-a758-d64ac82b2540 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:57:41.842 1 ERROR oslo_service.service [req-1fc87d73-9c4a-431a-a758-d64ac82b2540 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:57:41.842 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 08:57:41.842 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 08:57:41.842 1 ERROR oslo_service.service     service.start()
>2018-06-26 08:57:41.842 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 08:57:41.842 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 08:57:41.842 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 08:57:41.842 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 08:57:41.842 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 08:57:41.842 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 08:57:41.842 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 08:57:41.842 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 08:57:41.842 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 08:57:41.842 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 08:57:41.842 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 08:57:41.842 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 08:57:41.842 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 08:57:41.842 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 08:57:41.842 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 08:57:41.842 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 08:57:41.842 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 08:57:41.842 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 08:57:41.842 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 08:57:41.842 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 08:57:41.842 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 08:57:41.842 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 08:57:41.842 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:57:41.842 1 ERROR oslo_service.service 
>2018-06-26 08:57:41.845 1 CRITICAL cinder [req-cf0296a9-f5fc-40a0-a24a-3ff90528b442 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 08:57:41.845 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 08:57:41.845 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 08:57:41.845 1 ERROR cinder     sys.exit(main())
>2018-06-26 08:57:41.845 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 08:57:41.845 1 ERROR cinder     service.wait()
>2018-06-26 08:57:41.845 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 08:57:41.845 1 ERROR cinder     _launcher.wait()
>2018-06-26 08:57:41.845 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 08:57:41.845 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 08:57:41.845 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 08:57:41.845 1 ERROR cinder     self.services.wait()
>2018-06-26 08:57:41.845 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 08:57:41.845 1 ERROR cinder     service.wait()
>2018-06-26 08:57:41.845 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 08:57:41.845 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 08:57:41.845 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 08:57:41.845 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 08:57:41.845 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 08:57:41.845 1 ERROR cinder     post_fn = fn()
>2018-06-26 08:57:41.845 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 08:57:41.845 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 08:57:41.845 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 08:57:41.845 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 08:57:41.845 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 08:57:41.845 1 ERROR cinder 
>2018-06-26 08:57:44.431 1 WARNING cinder.scheduler.host_manager [req-dee07465-4751-44fe-8857-ebd17124ba45 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 08:57:44.437 1 INFO cinder.rpc [req-dee07465-4751-44fe-8857-ebd17124ba45 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 08:57:44.443 1 INFO cinder.rpc [req-dee07465-4751-44fe-8857-ebd17124ba45 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 08:57:44.456 1 INFO cinder.rpc [req-dee07465-4751-44fe-8857-ebd17124ba45 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 08:57:44.462 1 INFO cinder.rpc [req-dee07465-4751-44fe-8857-ebd17124ba45 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 08:57:44.484 1 WARNING oslo_config.cfg [req-dee07465-4751-44fe-8857-ebd17124ba45 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 08:57:44.486 1 WARNING oslo_config.cfg [req-dee07465-4751-44fe-8857-ebd17124ba45 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:57:44.487 1 WARNING oslo_config.cfg [req-dee07465-4751-44fe-8857-ebd17124ba45 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:57:44.487 1 WARNING oslo_config.cfg [req-dee07465-4751-44fe-8857-ebd17124ba45 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:57:44.492 1 WARNING oslo_config.cfg [req-dee07465-4751-44fe-8857-ebd17124ba45 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 08:57:44.494 1 WARNING oslo_config.cfg [req-dee07465-4751-44fe-8857-ebd17124ba45 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 08:57:44.496 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 08:57:44.502 1 INFO cinder.manager [req-437896c1-b529-4a92-8896-e9fcb5b09bc0 - - - - -] Initiating service 5 cleanup
>2018-06-26 08:57:44.507 1 INFO cinder.manager [req-437896c1-b529-4a92-8896-e9fcb5b09bc0 - - - - -] Service 5 cleanup completed.
>2018-06-26 08:59:48.924 1 ERROR oslo.messaging._drivers.impl_rabbit [req-437896c1-b529-4a92-8896-e9fcb5b09bc0 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:59:48.926 1 ERROR oslo.messaging._drivers.impl_rabbit [req-437896c1-b529-4a92-8896-e9fcb5b09bc0 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:59:48.927 1 ERROR oslo_service.service [req-437896c1-b529-4a92-8896-e9fcb5b09bc0 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:59:48.927 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 08:59:48.927 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 08:59:48.927 1 ERROR oslo_service.service     service.start()
>2018-06-26 08:59:48.927 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 08:59:48.927 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 08:59:48.927 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 08:59:48.927 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 08:59:48.927 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 08:59:48.927 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 08:59:48.927 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 08:59:48.927 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 08:59:48.927 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 08:59:48.927 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 08:59:48.927 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 08:59:48.927 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 08:59:48.927 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 08:59:48.927 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 08:59:48.927 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 08:59:48.927 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 08:59:48.927 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 08:59:48.927 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 08:59:48.927 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 08:59:48.927 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 08:59:48.927 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 08:59:48.927 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 08:59:48.927 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 08:59:48.927 1 ERROR oslo_service.service 
>2018-06-26 08:59:48.929 1 CRITICAL cinder [req-dee07465-4751-44fe-8857-ebd17124ba45 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 08:59:48.929 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 08:59:48.929 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 08:59:48.929 1 ERROR cinder     sys.exit(main())
>2018-06-26 08:59:48.929 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 08:59:48.929 1 ERROR cinder     service.wait()
>2018-06-26 08:59:48.929 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 08:59:48.929 1 ERROR cinder     _launcher.wait()
>2018-06-26 08:59:48.929 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 08:59:48.929 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 08:59:48.929 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 08:59:48.929 1 ERROR cinder     self.services.wait()
>2018-06-26 08:59:48.929 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 08:59:48.929 1 ERROR cinder     service.wait()
>2018-06-26 08:59:48.929 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 08:59:48.929 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 08:59:48.929 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 08:59:48.929 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 08:59:48.929 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 08:59:48.929 1 ERROR cinder     post_fn = fn()
>2018-06-26 08:59:48.929 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 08:59:48.929 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 08:59:48.929 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 08:59:48.929 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 08:59:48.929 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 08:59:48.929 1 ERROR cinder 
>2018-06-26 08:59:51.623 1 WARNING cinder.scheduler.host_manager [req-5155db51-2bc2-4632-8e3b-2c54d7c4e121 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 08:59:51.630 1 INFO cinder.rpc [req-5155db51-2bc2-4632-8e3b-2c54d7c4e121 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 08:59:51.635 1 INFO cinder.rpc [req-5155db51-2bc2-4632-8e3b-2c54d7c4e121 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 08:59:51.646 1 INFO cinder.rpc [req-5155db51-2bc2-4632-8e3b-2c54d7c4e121 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 08:59:51.652 1 INFO cinder.rpc [req-5155db51-2bc2-4632-8e3b-2c54d7c4e121 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 08:59:51.677 1 WARNING oslo_config.cfg [req-5155db51-2bc2-4632-8e3b-2c54d7c4e121 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 08:59:51.680 1 WARNING oslo_config.cfg [req-5155db51-2bc2-4632-8e3b-2c54d7c4e121 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:59:51.680 1 WARNING oslo_config.cfg [req-5155db51-2bc2-4632-8e3b-2c54d7c4e121 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:59:51.681 1 WARNING oslo_config.cfg [req-5155db51-2bc2-4632-8e3b-2c54d7c4e121 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 08:59:51.686 1 WARNING oslo_config.cfg [req-5155db51-2bc2-4632-8e3b-2c54d7c4e121 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 08:59:51.687 1 WARNING oslo_config.cfg [req-5155db51-2bc2-4632-8e3b-2c54d7c4e121 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 08:59:51.690 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 08:59:51.696 1 INFO cinder.manager [req-837d7c5d-a7c5-49b8-ae9b-9535b6e20ab4 - - - - -] Initiating service 5 cleanup
>2018-06-26 08:59:51.700 1 INFO cinder.manager [req-837d7c5d-a7c5-49b8-ae9b-9535b6e20ab4 - - - - -] Service 5 cleanup completed.
>2018-06-26 09:01:58.283 1 ERROR oslo.messaging._drivers.impl_rabbit [req-837d7c5d-a7c5-49b8-ae9b-9535b6e20ab4 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:01:58.285 1 ERROR oslo.messaging._drivers.impl_rabbit [req-837d7c5d-a7c5-49b8-ae9b-9535b6e20ab4 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:01:58.286 1 ERROR oslo_service.service [req-837d7c5d-a7c5-49b8-ae9b-9535b6e20ab4 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:01:58.286 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 09:01:58.286 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 09:01:58.286 1 ERROR oslo_service.service     service.start()
>2018-06-26 09:01:58.286 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 09:01:58.286 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 09:01:58.286 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 09:01:58.286 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 09:01:58.286 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 09:01:58.286 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 09:01:58.286 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 09:01:58.286 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 09:01:58.286 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 09:01:58.286 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 09:01:58.286 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 09:01:58.286 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 09:01:58.286 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 09:01:58.286 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 09:01:58.286 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 09:01:58.286 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 09:01:58.286 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 09:01:58.286 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 09:01:58.286 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 09:01:58.286 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 09:01:58.286 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 09:01:58.286 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 09:01:58.286 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:01:58.286 1 ERROR oslo_service.service 
>2018-06-26 09:01:58.289 1 CRITICAL cinder [req-5155db51-2bc2-4632-8e3b-2c54d7c4e121 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 09:01:58.289 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 09:01:58.289 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 09:01:58.289 1 ERROR cinder     sys.exit(main())
>2018-06-26 09:01:58.289 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 09:01:58.289 1 ERROR cinder     service.wait()
>2018-06-26 09:01:58.289 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 09:01:58.289 1 ERROR cinder     _launcher.wait()
>2018-06-26 09:01:58.289 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 09:01:58.289 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 09:01:58.289 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 09:01:58.289 1 ERROR cinder     self.services.wait()
>2018-06-26 09:01:58.289 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 09:01:58.289 1 ERROR cinder     service.wait()
>2018-06-26 09:01:58.289 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 09:01:58.289 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 09:01:58.289 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 09:01:58.289 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 09:01:58.289 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 09:01:58.289 1 ERROR cinder     post_fn = fn()
>2018-06-26 09:01:58.289 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 09:01:58.289 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 09:01:58.289 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 09:01:58.289 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 09:01:58.289 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 09:01:58.289 1 ERROR cinder 
>2018-06-26 09:02:00.944 1 WARNING cinder.scheduler.host_manager [req-0002bb60-bd65-48e4-bbfb-99ece34ec3a0 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 09:02:00.951 1 INFO cinder.rpc [req-0002bb60-bd65-48e4-bbfb-99ece34ec3a0 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 09:02:00.956 1 INFO cinder.rpc [req-0002bb60-bd65-48e4-bbfb-99ece34ec3a0 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 09:02:00.967 1 INFO cinder.rpc [req-0002bb60-bd65-48e4-bbfb-99ece34ec3a0 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 09:02:00.973 1 INFO cinder.rpc [req-0002bb60-bd65-48e4-bbfb-99ece34ec3a0 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 09:02:01.000 1 WARNING oslo_config.cfg [req-0002bb60-bd65-48e4-bbfb-99ece34ec3a0 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 09:02:01.002 1 WARNING oslo_config.cfg [req-0002bb60-bd65-48e4-bbfb-99ece34ec3a0 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:02:01.003 1 WARNING oslo_config.cfg [req-0002bb60-bd65-48e4-bbfb-99ece34ec3a0 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:02:01.004 1 WARNING oslo_config.cfg [req-0002bb60-bd65-48e4-bbfb-99ece34ec3a0 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:02:01.009 1 WARNING oslo_config.cfg [req-0002bb60-bd65-48e4-bbfb-99ece34ec3a0 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 09:02:01.010 1 WARNING oslo_config.cfg [req-0002bb60-bd65-48e4-bbfb-99ece34ec3a0 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 09:02:01.013 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 09:02:01.020 1 INFO cinder.manager [req-a8af5dc5-0c22-4cda-9031-e7863722ca10 - - - - -] Initiating service 5 cleanup
>2018-06-26 09:02:01.025 1 INFO cinder.manager [req-a8af5dc5-0c22-4cda-9031-e7863722ca10 - - - - -] Service 5 cleanup completed.
>2018-06-26 09:04:05.430 1 ERROR oslo.messaging._drivers.impl_rabbit [req-a8af5dc5-0c22-4cda-9031-e7863722ca10 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:04:05.432 1 ERROR oslo.messaging._drivers.impl_rabbit [req-a8af5dc5-0c22-4cda-9031-e7863722ca10 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:04:05.433 1 ERROR oslo_service.service [req-a8af5dc5-0c22-4cda-9031-e7863722ca10 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:04:05.433 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 09:04:05.433 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 09:04:05.433 1 ERROR oslo_service.service     service.start()
>2018-06-26 09:04:05.433 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 09:04:05.433 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 09:04:05.433 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 09:04:05.433 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 09:04:05.433 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 09:04:05.433 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 09:04:05.433 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 09:04:05.433 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 09:04:05.433 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 09:04:05.433 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 09:04:05.433 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 09:04:05.433 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 09:04:05.433 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 09:04:05.433 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 09:04:05.433 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 09:04:05.433 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 09:04:05.433 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 09:04:05.433 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 09:04:05.433 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 09:04:05.433 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 09:04:05.433 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 09:04:05.433 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 09:04:05.433 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:04:05.433 1 ERROR oslo_service.service 
>2018-06-26 09:04:05.436 1 CRITICAL cinder [req-0002bb60-bd65-48e4-bbfb-99ece34ec3a0 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 09:04:05.436 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 09:04:05.436 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 09:04:05.436 1 ERROR cinder     sys.exit(main())
>2018-06-26 09:04:05.436 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 09:04:05.436 1 ERROR cinder     service.wait()
>2018-06-26 09:04:05.436 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 09:04:05.436 1 ERROR cinder     _launcher.wait()
>2018-06-26 09:04:05.436 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 09:04:05.436 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 09:04:05.436 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 09:04:05.436 1 ERROR cinder     self.services.wait()
>2018-06-26 09:04:05.436 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 09:04:05.436 1 ERROR cinder     service.wait()
>2018-06-26 09:04:05.436 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 09:04:05.436 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 09:04:05.436 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 09:04:05.436 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 09:04:05.436 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 09:04:05.436 1 ERROR cinder     post_fn = fn()
>2018-06-26 09:04:05.436 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 09:04:05.436 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 09:04:05.436 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 09:04:05.436 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 09:04:05.436 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 09:04:05.436 1 ERROR cinder 
>2018-06-26 09:04:08.071 1 WARNING cinder.scheduler.host_manager [req-59738755-347a-402d-8681-fe0cffb8f950 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 09:04:08.077 1 INFO cinder.rpc [req-59738755-347a-402d-8681-fe0cffb8f950 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 09:04:08.082 1 INFO cinder.rpc [req-59738755-347a-402d-8681-fe0cffb8f950 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 09:04:08.092 1 INFO cinder.rpc [req-59738755-347a-402d-8681-fe0cffb8f950 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 09:04:08.098 1 INFO cinder.rpc [req-59738755-347a-402d-8681-fe0cffb8f950 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 09:04:08.130 1 WARNING oslo_config.cfg [req-59738755-347a-402d-8681-fe0cffb8f950 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 09:04:08.132 1 WARNING oslo_config.cfg [req-59738755-347a-402d-8681-fe0cffb8f950 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:04:08.133 1 WARNING oslo_config.cfg [req-59738755-347a-402d-8681-fe0cffb8f950 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:04:08.133 1 WARNING oslo_config.cfg [req-59738755-347a-402d-8681-fe0cffb8f950 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:04:08.138 1 WARNING oslo_config.cfg [req-59738755-347a-402d-8681-fe0cffb8f950 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 09:04:08.139 1 WARNING oslo_config.cfg [req-59738755-347a-402d-8681-fe0cffb8f950 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 09:04:08.141 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 09:04:08.149 1 INFO cinder.manager [req-34ca2740-8f6a-4ef9-87d4-341449a2936c - - - - -] Initiating service 5 cleanup
>2018-06-26 09:04:08.155 1 INFO cinder.manager [req-34ca2740-8f6a-4ef9-87d4-341449a2936c - - - - -] Service 5 cleanup completed.
>2018-06-26 09:06:12.558 1 ERROR oslo.messaging._drivers.impl_rabbit [req-34ca2740-8f6a-4ef9-87d4-341449a2936c - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:06:12.560 1 ERROR oslo.messaging._drivers.impl_rabbit [req-34ca2740-8f6a-4ef9-87d4-341449a2936c - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:06:12.561 1 ERROR oslo_service.service [req-34ca2740-8f6a-4ef9-87d4-341449a2936c - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:06:12.561 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 09:06:12.561 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 09:06:12.561 1 ERROR oslo_service.service     service.start()
>2018-06-26 09:06:12.561 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 09:06:12.561 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 09:06:12.561 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 09:06:12.561 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 09:06:12.561 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 09:06:12.561 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 09:06:12.561 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 09:06:12.561 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 09:06:12.561 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 09:06:12.561 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 09:06:12.561 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 09:06:12.561 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 09:06:12.561 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 09:06:12.561 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 09:06:12.561 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 09:06:12.561 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 09:06:12.561 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 09:06:12.561 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 09:06:12.561 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 09:06:12.561 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 09:06:12.561 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 09:06:12.561 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 09:06:12.561 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:06:12.561 1 ERROR oslo_service.service 
>2018-06-26 09:06:12.563 1 CRITICAL cinder [req-59738755-347a-402d-8681-fe0cffb8f950 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 09:06:12.563 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 09:06:12.563 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 09:06:12.563 1 ERROR cinder     sys.exit(main())
>2018-06-26 09:06:12.563 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 09:06:12.563 1 ERROR cinder     service.wait()
>2018-06-26 09:06:12.563 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 09:06:12.563 1 ERROR cinder     _launcher.wait()
>2018-06-26 09:06:12.563 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 09:06:12.563 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 09:06:12.563 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 09:06:12.563 1 ERROR cinder     self.services.wait()
>2018-06-26 09:06:12.563 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 09:06:12.563 1 ERROR cinder     service.wait()
>2018-06-26 09:06:12.563 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 09:06:12.563 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 09:06:12.563 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 09:06:12.563 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 09:06:12.563 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 09:06:12.563 1 ERROR cinder     post_fn = fn()
>2018-06-26 09:06:12.563 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 09:06:12.563 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 09:06:12.563 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 09:06:12.563 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 09:06:12.563 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 09:06:12.563 1 ERROR cinder 
>2018-06-26 09:06:15.067 1 WARNING cinder.scheduler.host_manager [req-3a28b8b4-70a3-4ee7-b555-3a4c1c54fd88 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 09:06:15.074 1 INFO cinder.rpc [req-3a28b8b4-70a3-4ee7-b555-3a4c1c54fd88 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 09:06:15.083 1 INFO cinder.rpc [req-3a28b8b4-70a3-4ee7-b555-3a4c1c54fd88 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 09:06:15.103 1 INFO cinder.rpc [req-3a28b8b4-70a3-4ee7-b555-3a4c1c54fd88 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 09:06:15.112 1 INFO cinder.rpc [req-3a28b8b4-70a3-4ee7-b555-3a4c1c54fd88 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 09:06:15.140 1 WARNING oslo_config.cfg [req-3a28b8b4-70a3-4ee7-b555-3a4c1c54fd88 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 09:06:15.142 1 WARNING oslo_config.cfg [req-3a28b8b4-70a3-4ee7-b555-3a4c1c54fd88 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:06:15.143 1 WARNING oslo_config.cfg [req-3a28b8b4-70a3-4ee7-b555-3a4c1c54fd88 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:06:15.144 1 WARNING oslo_config.cfg [req-3a28b8b4-70a3-4ee7-b555-3a4c1c54fd88 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:06:15.149 1 WARNING oslo_config.cfg [req-3a28b8b4-70a3-4ee7-b555-3a4c1c54fd88 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 09:06:15.150 1 WARNING oslo_config.cfg [req-3a28b8b4-70a3-4ee7-b555-3a4c1c54fd88 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 09:06:15.153 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 09:06:15.159 1 INFO cinder.manager [req-e9e9f8bb-ff11-4881-91a0-8afcde15a00f - - - - -] Initiating service 5 cleanup
>2018-06-26 09:06:15.163 1 INFO cinder.manager [req-e9e9f8bb-ff11-4881-91a0-8afcde15a00f - - - - -] Service 5 cleanup completed.
>2018-06-26 09:08:27.279 1 ERROR oslo.messaging._drivers.impl_rabbit [req-e9e9f8bb-ff11-4881-91a0-8afcde15a00f - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:08:27.282 1 ERROR oslo.messaging._drivers.impl_rabbit [req-e9e9f8bb-ff11-4881-91a0-8afcde15a00f - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:08:27.282 1 ERROR oslo_service.service [req-e9e9f8bb-ff11-4881-91a0-8afcde15a00f - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:08:27.282 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 09:08:27.282 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 09:08:27.282 1 ERROR oslo_service.service     service.start()
>2018-06-26 09:08:27.282 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 09:08:27.282 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 09:08:27.282 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 09:08:27.282 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 09:08:27.282 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 09:08:27.282 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 09:08:27.282 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 09:08:27.282 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 09:08:27.282 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 09:08:27.282 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 09:08:27.282 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 09:08:27.282 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 09:08:27.282 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 09:08:27.282 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 09:08:27.282 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 09:08:27.282 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 09:08:27.282 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 09:08:27.282 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 09:08:27.282 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 09:08:27.282 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 09:08:27.282 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 09:08:27.282 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 09:08:27.282 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:08:27.282 1 ERROR oslo_service.service 
>2018-06-26 09:08:27.285 1 CRITICAL cinder [req-3a28b8b4-70a3-4ee7-b555-3a4c1c54fd88 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 09:08:27.285 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 09:08:27.285 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 09:08:27.285 1 ERROR cinder     sys.exit(main())
>2018-06-26 09:08:27.285 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 09:08:27.285 1 ERROR cinder     service.wait()
>2018-06-26 09:08:27.285 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 09:08:27.285 1 ERROR cinder     _launcher.wait()
>2018-06-26 09:08:27.285 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 09:08:27.285 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 09:08:27.285 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 09:08:27.285 1 ERROR cinder     self.services.wait()
>2018-06-26 09:08:27.285 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 09:08:27.285 1 ERROR cinder     service.wait()
>2018-06-26 09:08:27.285 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 09:08:27.285 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 09:08:27.285 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 09:08:27.285 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 09:08:27.285 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 09:08:27.285 1 ERROR cinder     post_fn = fn()
>2018-06-26 09:08:27.285 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 09:08:27.285 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 09:08:27.285 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 09:08:27.285 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 09:08:27.285 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 09:08:27.285 1 ERROR cinder 
>2018-06-26 09:08:29.876 1 WARNING cinder.scheduler.host_manager [req-034e61cf-f396-4d0a-868d-2030acd45267 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 09:08:29.881 1 INFO cinder.rpc [req-034e61cf-f396-4d0a-868d-2030acd45267 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 09:08:29.887 1 INFO cinder.rpc [req-034e61cf-f396-4d0a-868d-2030acd45267 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 09:08:29.898 1 INFO cinder.rpc [req-034e61cf-f396-4d0a-868d-2030acd45267 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 09:08:29.904 1 INFO cinder.rpc [req-034e61cf-f396-4d0a-868d-2030acd45267 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 09:08:29.930 1 WARNING oslo_config.cfg [req-034e61cf-f396-4d0a-868d-2030acd45267 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 09:08:29.932 1 WARNING oslo_config.cfg [req-034e61cf-f396-4d0a-868d-2030acd45267 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:08:29.933 1 WARNING oslo_config.cfg [req-034e61cf-f396-4d0a-868d-2030acd45267 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:08:29.933 1 WARNING oslo_config.cfg [req-034e61cf-f396-4d0a-868d-2030acd45267 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:08:29.939 1 WARNING oslo_config.cfg [req-034e61cf-f396-4d0a-868d-2030acd45267 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 09:08:29.940 1 WARNING oslo_config.cfg [req-034e61cf-f396-4d0a-868d-2030acd45267 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 09:08:29.942 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 09:08:29.948 1 INFO cinder.manager [req-8d255507-e7fd-4417-8ff3-850ec3cc8008 - - - - -] Initiating service 5 cleanup
>2018-06-26 09:08:29.953 1 INFO cinder.manager [req-8d255507-e7fd-4417-8ff3-850ec3cc8008 - - - - -] Service 5 cleanup completed.
>2018-06-26 09:10:42.812 1 ERROR oslo.messaging._drivers.impl_rabbit [req-8d255507-e7fd-4417-8ff3-850ec3cc8008 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:10:42.815 1 ERROR oslo.messaging._drivers.impl_rabbit [req-8d255507-e7fd-4417-8ff3-850ec3cc8008 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:10:42.815 1 ERROR oslo_service.service [req-8d255507-e7fd-4417-8ff3-850ec3cc8008 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:10:42.815 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 09:10:42.815 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 09:10:42.815 1 ERROR oslo_service.service     service.start()
>2018-06-26 09:10:42.815 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 09:10:42.815 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 09:10:42.815 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 09:10:42.815 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 09:10:42.815 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 09:10:42.815 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 09:10:42.815 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 09:10:42.815 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 09:10:42.815 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 09:10:42.815 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 09:10:42.815 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 09:10:42.815 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 09:10:42.815 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 09:10:42.815 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 09:10:42.815 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 09:10:42.815 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 09:10:42.815 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 09:10:42.815 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 09:10:42.815 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 09:10:42.815 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 09:10:42.815 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 09:10:42.815 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 09:10:42.815 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:10:42.815 1 ERROR oslo_service.service 
>2018-06-26 09:10:42.818 1 CRITICAL cinder [req-034e61cf-f396-4d0a-868d-2030acd45267 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 09:10:42.818 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 09:10:42.818 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 09:10:42.818 1 ERROR cinder     sys.exit(main())
>2018-06-26 09:10:42.818 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 09:10:42.818 1 ERROR cinder     service.wait()
>2018-06-26 09:10:42.818 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 09:10:42.818 1 ERROR cinder     _launcher.wait()
>2018-06-26 09:10:42.818 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 09:10:42.818 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 09:10:42.818 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 09:10:42.818 1 ERROR cinder     self.services.wait()
>2018-06-26 09:10:42.818 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 09:10:42.818 1 ERROR cinder     service.wait()
>2018-06-26 09:10:42.818 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 09:10:42.818 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 09:10:42.818 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 09:10:42.818 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 09:10:42.818 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 09:10:42.818 1 ERROR cinder     post_fn = fn()
>2018-06-26 09:10:42.818 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 09:10:42.818 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 09:10:42.818 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 09:10:42.818 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 09:10:42.818 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 09:10:42.818 1 ERROR cinder 
>2018-06-26 09:10:45.560 1 WARNING cinder.scheduler.host_manager [req-3e879ab5-c2e8-45ea-b606-dd908860b476 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 09:10:45.566 1 INFO cinder.rpc [req-3e879ab5-c2e8-45ea-b606-dd908860b476 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 09:10:45.571 1 INFO cinder.rpc [req-3e879ab5-c2e8-45ea-b606-dd908860b476 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 09:10:45.582 1 INFO cinder.rpc [req-3e879ab5-c2e8-45ea-b606-dd908860b476 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 09:10:45.587 1 INFO cinder.rpc [req-3e879ab5-c2e8-45ea-b606-dd908860b476 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 09:10:45.609 1 WARNING oslo_config.cfg [req-3e879ab5-c2e8-45ea-b606-dd908860b476 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 09:10:45.611 1 WARNING oslo_config.cfg [req-3e879ab5-c2e8-45ea-b606-dd908860b476 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:10:45.612 1 WARNING oslo_config.cfg [req-3e879ab5-c2e8-45ea-b606-dd908860b476 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:10:45.612 1 WARNING oslo_config.cfg [req-3e879ab5-c2e8-45ea-b606-dd908860b476 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:10:45.617 1 WARNING oslo_config.cfg [req-3e879ab5-c2e8-45ea-b606-dd908860b476 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 09:10:45.619 1 WARNING oslo_config.cfg [req-3e879ab5-c2e8-45ea-b606-dd908860b476 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 09:10:45.621 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 09:10:45.628 1 INFO cinder.manager [req-34220972-9afc-4b4f-aeb9-f34a001ada66 - - - - -] Initiating service 5 cleanup
>2018-06-26 09:10:45.632 1 INFO cinder.manager [req-34220972-9afc-4b4f-aeb9-f34a001ada66 - - - - -] Service 5 cleanup completed.
>2018-06-26 09:12:57.679 1 ERROR oslo.messaging._drivers.impl_rabbit [req-34220972-9afc-4b4f-aeb9-f34a001ada66 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:12:57.681 1 ERROR oslo.messaging._drivers.impl_rabbit [req-34220972-9afc-4b4f-aeb9-f34a001ada66 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:12:57.681 1 ERROR oslo_service.service [req-34220972-9afc-4b4f-aeb9-f34a001ada66 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:12:57.681 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 09:12:57.681 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 09:12:57.681 1 ERROR oslo_service.service     service.start()
>2018-06-26 09:12:57.681 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 09:12:57.681 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 09:12:57.681 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 09:12:57.681 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 09:12:57.681 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 09:12:57.681 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 09:12:57.681 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 09:12:57.681 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 09:12:57.681 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 09:12:57.681 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 09:12:57.681 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 09:12:57.681 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 09:12:57.681 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 09:12:57.681 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 09:12:57.681 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 09:12:57.681 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 09:12:57.681 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 09:12:57.681 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 09:12:57.681 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 09:12:57.681 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 09:12:57.681 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 09:12:57.681 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 09:12:57.681 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:12:57.681 1 ERROR oslo_service.service 
>2018-06-26 09:12:57.683 1 CRITICAL cinder [req-3e879ab5-c2e8-45ea-b606-dd908860b476 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 09:12:57.683 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 09:12:57.683 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 09:12:57.683 1 ERROR cinder     sys.exit(main())
>2018-06-26 09:12:57.683 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 09:12:57.683 1 ERROR cinder     service.wait()
>2018-06-26 09:12:57.683 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 09:12:57.683 1 ERROR cinder     _launcher.wait()
>2018-06-26 09:12:57.683 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 09:12:57.683 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 09:12:57.683 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 09:12:57.683 1 ERROR cinder     self.services.wait()
>2018-06-26 09:12:57.683 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 09:12:57.683 1 ERROR cinder     service.wait()
>2018-06-26 09:12:57.683 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 09:12:57.683 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 09:12:57.683 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 09:12:57.683 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 09:12:57.683 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 09:12:57.683 1 ERROR cinder     post_fn = fn()
>2018-06-26 09:12:57.683 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 09:12:57.683 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 09:12:57.683 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 09:12:57.683 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 09:12:57.683 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 09:12:57.683 1 ERROR cinder 
>2018-06-26 09:13:00.356 1 WARNING cinder.scheduler.host_manager [req-6a4c0671-ab27-4e0b-ab21-3b537433ba90 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 09:13:00.364 1 INFO cinder.rpc [req-6a4c0671-ab27-4e0b-ab21-3b537433ba90 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 09:13:00.371 1 INFO cinder.rpc [req-6a4c0671-ab27-4e0b-ab21-3b537433ba90 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 09:13:00.384 1 INFO cinder.rpc [req-6a4c0671-ab27-4e0b-ab21-3b537433ba90 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 09:13:00.392 1 INFO cinder.rpc [req-6a4c0671-ab27-4e0b-ab21-3b537433ba90 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 09:13:00.421 1 WARNING oslo_config.cfg [req-6a4c0671-ab27-4e0b-ab21-3b537433ba90 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 09:13:00.423 1 WARNING oslo_config.cfg [req-6a4c0671-ab27-4e0b-ab21-3b537433ba90 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:13:00.424 1 WARNING oslo_config.cfg [req-6a4c0671-ab27-4e0b-ab21-3b537433ba90 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:13:00.424 1 WARNING oslo_config.cfg [req-6a4c0671-ab27-4e0b-ab21-3b537433ba90 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:13:00.430 1 WARNING oslo_config.cfg [req-6a4c0671-ab27-4e0b-ab21-3b537433ba90 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 09:13:00.431 1 WARNING oslo_config.cfg [req-6a4c0671-ab27-4e0b-ab21-3b537433ba90 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 09:13:00.434 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 09:13:00.443 1 INFO cinder.manager [req-30b40483-5db8-4594-9c24-ad2782c65d7c - - - - -] Initiating service 5 cleanup
>2018-06-26 09:13:00.451 1 INFO cinder.manager [req-30b40483-5db8-4594-9c24-ad2782c65d7c - - - - -] Service 5 cleanup completed.
>2018-06-26 09:15:06.979 1 ERROR oslo.messaging._drivers.impl_rabbit [req-30b40483-5db8-4594-9c24-ad2782c65d7c - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:15:06.981 1 ERROR oslo.messaging._drivers.impl_rabbit [req-30b40483-5db8-4594-9c24-ad2782c65d7c - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:15:06.981 1 ERROR oslo_service.service [req-30b40483-5db8-4594-9c24-ad2782c65d7c - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:15:06.981 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 09:15:06.981 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 09:15:06.981 1 ERROR oslo_service.service     service.start()
>2018-06-26 09:15:06.981 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 09:15:06.981 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 09:15:06.981 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 09:15:06.981 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 09:15:06.981 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 09:15:06.981 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 09:15:06.981 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 09:15:06.981 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 09:15:06.981 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 09:15:06.981 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 09:15:06.981 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 09:15:06.981 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 09:15:06.981 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 09:15:06.981 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 09:15:06.981 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 09:15:06.981 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 09:15:06.981 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 09:15:06.981 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 09:15:06.981 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 09:15:06.981 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 09:15:06.981 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 09:15:06.981 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 09:15:06.981 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:15:06.981 1 ERROR oslo_service.service 
>2018-06-26 09:15:06.984 1 CRITICAL cinder [req-6a4c0671-ab27-4e0b-ab21-3b537433ba90 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 09:15:06.984 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 09:15:06.984 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 09:15:06.984 1 ERROR cinder     sys.exit(main())
>2018-06-26 09:15:06.984 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 09:15:06.984 1 ERROR cinder     service.wait()
>2018-06-26 09:15:06.984 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 09:15:06.984 1 ERROR cinder     _launcher.wait()
>2018-06-26 09:15:06.984 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 09:15:06.984 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 09:15:06.984 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 09:15:06.984 1 ERROR cinder     self.services.wait()
>2018-06-26 09:15:06.984 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 09:15:06.984 1 ERROR cinder     service.wait()
>2018-06-26 09:15:06.984 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 09:15:06.984 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 09:15:06.984 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 09:15:06.984 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 09:15:06.984 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 09:15:06.984 1 ERROR cinder     post_fn = fn()
>2018-06-26 09:15:06.984 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 09:15:06.984 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 09:15:06.984 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 09:15:06.984 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 09:15:06.984 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 09:15:06.984 1 ERROR cinder 
>2018-06-26 09:15:09.682 1 WARNING cinder.scheduler.host_manager [req-6e737538-ccdc-43eb-a58f-52fb07f6c2c8 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 09:15:09.688 1 INFO cinder.rpc [req-6e737538-ccdc-43eb-a58f-52fb07f6c2c8 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 09:15:09.694 1 INFO cinder.rpc [req-6e737538-ccdc-43eb-a58f-52fb07f6c2c8 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 09:15:09.704 1 INFO cinder.rpc [req-6e737538-ccdc-43eb-a58f-52fb07f6c2c8 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 09:15:09.711 1 INFO cinder.rpc [req-6e737538-ccdc-43eb-a58f-52fb07f6c2c8 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 09:15:09.735 1 WARNING oslo_config.cfg [req-6e737538-ccdc-43eb-a58f-52fb07f6c2c8 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 09:15:09.738 1 WARNING oslo_config.cfg [req-6e737538-ccdc-43eb-a58f-52fb07f6c2c8 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:15:09.738 1 WARNING oslo_config.cfg [req-6e737538-ccdc-43eb-a58f-52fb07f6c2c8 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:15:09.739 1 WARNING oslo_config.cfg [req-6e737538-ccdc-43eb-a58f-52fb07f6c2c8 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:15:09.743 1 WARNING oslo_config.cfg [req-6e737538-ccdc-43eb-a58f-52fb07f6c2c8 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 09:15:09.745 1 WARNING oslo_config.cfg [req-6e737538-ccdc-43eb-a58f-52fb07f6c2c8 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 09:15:09.747 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 09:15:09.753 1 INFO cinder.manager [req-5fcbf905-1540-46f5-a7ee-f0f6d55db172 - - - - -] Initiating service 5 cleanup
>2018-06-26 09:15:09.759 1 INFO cinder.manager [req-5fcbf905-1540-46f5-a7ee-f0f6d55db172 - - - - -] Service 5 cleanup completed.
>2018-06-26 09:17:21.608 1 ERROR oslo.messaging._drivers.impl_rabbit [req-5fcbf905-1540-46f5-a7ee-f0f6d55db172 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:17:21.610 1 ERROR oslo.messaging._drivers.impl_rabbit [req-5fcbf905-1540-46f5-a7ee-f0f6d55db172 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:17:21.611 1 ERROR oslo_service.service [req-5fcbf905-1540-46f5-a7ee-f0f6d55db172 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:17:21.611 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 09:17:21.611 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 09:17:21.611 1 ERROR oslo_service.service     service.start()
>2018-06-26 09:17:21.611 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 09:17:21.611 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 09:17:21.611 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 09:17:21.611 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 09:17:21.611 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 09:17:21.611 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 09:17:21.611 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 09:17:21.611 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 09:17:21.611 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 09:17:21.611 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 09:17:21.611 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 09:17:21.611 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 09:17:21.611 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 09:17:21.611 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 09:17:21.611 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 09:17:21.611 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 09:17:21.611 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 09:17:21.611 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 09:17:21.611 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 09:17:21.611 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 09:17:21.611 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 09:17:21.611 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 09:17:21.611 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:17:21.611 1 ERROR oslo_service.service 
>2018-06-26 09:17:21.614 1 CRITICAL cinder [req-6e737538-ccdc-43eb-a58f-52fb07f6c2c8 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 09:17:21.614 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 09:17:21.614 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 09:17:21.614 1 ERROR cinder     sys.exit(main())
>2018-06-26 09:17:21.614 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 09:17:21.614 1 ERROR cinder     service.wait()
>2018-06-26 09:17:21.614 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 09:17:21.614 1 ERROR cinder     _launcher.wait()
>2018-06-26 09:17:21.614 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 09:17:21.614 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 09:17:21.614 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 09:17:21.614 1 ERROR cinder     self.services.wait()
>2018-06-26 09:17:21.614 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 09:17:21.614 1 ERROR cinder     service.wait()
>2018-06-26 09:17:21.614 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 09:17:21.614 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 09:17:21.614 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 09:17:21.614 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 09:17:21.614 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 09:17:21.614 1 ERROR cinder     post_fn = fn()
>2018-06-26 09:17:21.614 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 09:17:21.614 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 09:17:21.614 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 09:17:21.614 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 09:17:21.614 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 09:17:21.614 1 ERROR cinder 
>2018-06-26 09:17:24.172 1 WARNING cinder.scheduler.host_manager [req-72ae494e-ada2-4fba-8ae5-277c9e6bf9d2 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 09:17:24.179 1 INFO cinder.rpc [req-72ae494e-ada2-4fba-8ae5-277c9e6bf9d2 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 09:17:24.185 1 INFO cinder.rpc [req-72ae494e-ada2-4fba-8ae5-277c9e6bf9d2 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 09:17:24.197 1 INFO cinder.rpc [req-72ae494e-ada2-4fba-8ae5-277c9e6bf9d2 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 09:17:24.202 1 INFO cinder.rpc [req-72ae494e-ada2-4fba-8ae5-277c9e6bf9d2 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 09:17:24.226 1 WARNING oslo_config.cfg [req-72ae494e-ada2-4fba-8ae5-277c9e6bf9d2 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 09:17:24.228 1 WARNING oslo_config.cfg [req-72ae494e-ada2-4fba-8ae5-277c9e6bf9d2 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:17:24.228 1 WARNING oslo_config.cfg [req-72ae494e-ada2-4fba-8ae5-277c9e6bf9d2 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:17:24.229 1 WARNING oslo_config.cfg [req-72ae494e-ada2-4fba-8ae5-277c9e6bf9d2 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:17:24.234 1 WARNING oslo_config.cfg [req-72ae494e-ada2-4fba-8ae5-277c9e6bf9d2 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 09:17:24.235 1 WARNING oslo_config.cfg [req-72ae494e-ada2-4fba-8ae5-277c9e6bf9d2 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 09:17:24.238 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 09:17:24.245 1 INFO cinder.manager [req-ea4034bc-2e8e-4721-a702-41708c23dd5d - - - - -] Initiating service 5 cleanup
>2018-06-26 09:17:24.251 1 INFO cinder.manager [req-ea4034bc-2e8e-4721-a702-41708c23dd5d - - - - -] Service 5 cleanup completed.
>2018-06-26 09:19:30.572 1 ERROR oslo.messaging._drivers.impl_rabbit [req-ea4034bc-2e8e-4721-a702-41708c23dd5d - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:19:30.576 1 ERROR oslo.messaging._drivers.impl_rabbit [req-ea4034bc-2e8e-4721-a702-41708c23dd5d - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:19:30.576 1 ERROR oslo_service.service [req-ea4034bc-2e8e-4721-a702-41708c23dd5d - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:19:30.576 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 09:19:30.576 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 09:19:30.576 1 ERROR oslo_service.service     service.start()
>2018-06-26 09:19:30.576 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 09:19:30.576 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 09:19:30.576 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 09:19:30.576 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 09:19:30.576 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 09:19:30.576 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 09:19:30.576 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 09:19:30.576 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 09:19:30.576 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 09:19:30.576 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 09:19:30.576 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 09:19:30.576 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 09:19:30.576 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 09:19:30.576 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 09:19:30.576 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 09:19:30.576 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 09:19:30.576 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 09:19:30.576 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 09:19:30.576 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 09:19:30.576 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 09:19:30.576 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 09:19:30.576 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 09:19:30.576 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:19:30.576 1 ERROR oslo_service.service 
>2018-06-26 09:19:30.580 1 CRITICAL cinder [req-72ae494e-ada2-4fba-8ae5-277c9e6bf9d2 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 09:19:30.580 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 09:19:30.580 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 09:19:30.580 1 ERROR cinder     sys.exit(main())
>2018-06-26 09:19:30.580 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 09:19:30.580 1 ERROR cinder     service.wait()
>2018-06-26 09:19:30.580 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 09:19:30.580 1 ERROR cinder     _launcher.wait()
>2018-06-26 09:19:30.580 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 09:19:30.580 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 09:19:30.580 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 09:19:30.580 1 ERROR cinder     self.services.wait()
>2018-06-26 09:19:30.580 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 09:19:30.580 1 ERROR cinder     service.wait()
>2018-06-26 09:19:30.580 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 09:19:30.580 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 09:19:30.580 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 09:19:30.580 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 09:19:30.580 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 09:19:30.580 1 ERROR cinder     post_fn = fn()
>2018-06-26 09:19:30.580 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 09:19:30.580 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 09:19:30.580 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 09:19:30.580 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 09:19:30.580 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 09:19:30.580 1 ERROR cinder 
>2018-06-26 09:19:33.508 1 WARNING cinder.scheduler.host_manager [req-bb1e67b9-3c74-430b-9e72-1fdad3877469 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 09:19:33.517 1 INFO cinder.rpc [req-bb1e67b9-3c74-430b-9e72-1fdad3877469 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 09:19:33.524 1 INFO cinder.rpc [req-bb1e67b9-3c74-430b-9e72-1fdad3877469 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 09:19:33.538 1 INFO cinder.rpc [req-bb1e67b9-3c74-430b-9e72-1fdad3877469 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 09:19:33.544 1 INFO cinder.rpc [req-bb1e67b9-3c74-430b-9e72-1fdad3877469 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 09:19:33.571 1 WARNING oslo_config.cfg [req-bb1e67b9-3c74-430b-9e72-1fdad3877469 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 09:19:33.574 1 WARNING oslo_config.cfg [req-bb1e67b9-3c74-430b-9e72-1fdad3877469 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:19:33.574 1 WARNING oslo_config.cfg [req-bb1e67b9-3c74-430b-9e72-1fdad3877469 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:19:33.575 1 WARNING oslo_config.cfg [req-bb1e67b9-3c74-430b-9e72-1fdad3877469 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:19:33.580 1 WARNING oslo_config.cfg [req-bb1e67b9-3c74-430b-9e72-1fdad3877469 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 09:19:33.581 1 WARNING oslo_config.cfg [req-bb1e67b9-3c74-430b-9e72-1fdad3877469 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 09:19:33.584 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 09:19:33.592 1 INFO cinder.manager [req-ee9284e5-57ec-47be-a6e7-2954d0512fc6 - - - - -] Initiating service 5 cleanup
>2018-06-26 09:19:33.600 1 INFO cinder.manager [req-ee9284e5-57ec-47be-a6e7-2954d0512fc6 - - - - -] Service 5 cleanup completed.
>2018-06-26 09:21:37.978 1 ERROR oslo.messaging._drivers.impl_rabbit [req-ee9284e5-57ec-47be-a6e7-2954d0512fc6 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:21:37.980 1 ERROR oslo.messaging._drivers.impl_rabbit [req-ee9284e5-57ec-47be-a6e7-2954d0512fc6 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:21:37.980 1 ERROR oslo_service.service [req-ee9284e5-57ec-47be-a6e7-2954d0512fc6 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:21:37.980 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 09:21:37.980 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 09:21:37.980 1 ERROR oslo_service.service     service.start()
>2018-06-26 09:21:37.980 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 09:21:37.980 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 09:21:37.980 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 09:21:37.980 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 09:21:37.980 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 09:21:37.980 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 09:21:37.980 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 09:21:37.980 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 09:21:37.980 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 09:21:37.980 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 09:21:37.980 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 09:21:37.980 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 09:21:37.980 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 09:21:37.980 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 09:21:37.980 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 09:21:37.980 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 09:21:37.980 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 09:21:37.980 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 09:21:37.980 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 09:21:37.980 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 09:21:37.980 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 09:21:37.980 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 09:21:37.980 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:21:37.980 1 ERROR oslo_service.service 
>2018-06-26 09:21:37.984 1 CRITICAL cinder [req-bb1e67b9-3c74-430b-9e72-1fdad3877469 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 09:21:37.984 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 09:21:37.984 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 09:21:37.984 1 ERROR cinder     sys.exit(main())
>2018-06-26 09:21:37.984 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 09:21:37.984 1 ERROR cinder     service.wait()
>2018-06-26 09:21:37.984 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 09:21:37.984 1 ERROR cinder     _launcher.wait()
>2018-06-26 09:21:37.984 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 09:21:37.984 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 09:21:37.984 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 09:21:37.984 1 ERROR cinder     self.services.wait()
>2018-06-26 09:21:37.984 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 09:21:37.984 1 ERROR cinder     service.wait()
>2018-06-26 09:21:37.984 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 09:21:37.984 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 09:21:37.984 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 09:21:37.984 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 09:21:37.984 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 09:21:37.984 1 ERROR cinder     post_fn = fn()
>2018-06-26 09:21:37.984 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 09:21:37.984 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 09:21:37.984 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 09:21:37.984 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 09:21:37.984 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 09:21:37.984 1 ERROR cinder 
>2018-06-26 09:21:40.639 1 WARNING cinder.scheduler.host_manager [req-aa4424ce-b13b-485d-a4fe-96358e6c16f8 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 09:21:40.649 1 INFO cinder.rpc [req-aa4424ce-b13b-485d-a4fe-96358e6c16f8 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 09:21:40.654 1 INFO cinder.rpc [req-aa4424ce-b13b-485d-a4fe-96358e6c16f8 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 09:21:40.665 1 INFO cinder.rpc [req-aa4424ce-b13b-485d-a4fe-96358e6c16f8 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 09:21:40.670 1 INFO cinder.rpc [req-aa4424ce-b13b-485d-a4fe-96358e6c16f8 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 09:21:40.704 1 WARNING oslo_config.cfg [req-aa4424ce-b13b-485d-a4fe-96358e6c16f8 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 09:21:40.706 1 WARNING oslo_config.cfg [req-aa4424ce-b13b-485d-a4fe-96358e6c16f8 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:21:40.707 1 WARNING oslo_config.cfg [req-aa4424ce-b13b-485d-a4fe-96358e6c16f8 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:21:40.707 1 WARNING oslo_config.cfg [req-aa4424ce-b13b-485d-a4fe-96358e6c16f8 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:21:40.712 1 WARNING oslo_config.cfg [req-aa4424ce-b13b-485d-a4fe-96358e6c16f8 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 09:21:40.713 1 WARNING oslo_config.cfg [req-aa4424ce-b13b-485d-a4fe-96358e6c16f8 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 09:21:40.715 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 09:21:40.721 1 INFO cinder.manager [req-32d24835-0295-468e-90b4-de998b77e5bb - - - - -] Initiating service 5 cleanup
>2018-06-26 09:21:40.726 1 INFO cinder.manager [req-32d24835-0295-468e-90b4-de998b77e5bb - - - - -] Service 5 cleanup completed.
>2018-06-26 09:23:53.753 1 ERROR oslo.messaging._drivers.impl_rabbit [req-32d24835-0295-468e-90b4-de998b77e5bb - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:23:53.755 1 ERROR oslo.messaging._drivers.impl_rabbit [req-32d24835-0295-468e-90b4-de998b77e5bb - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:23:53.755 1 ERROR oslo_service.service [req-32d24835-0295-468e-90b4-de998b77e5bb - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:23:53.755 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 09:23:53.755 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 09:23:53.755 1 ERROR oslo_service.service     service.start()
>2018-06-26 09:23:53.755 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 09:23:53.755 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 09:23:53.755 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 09:23:53.755 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 09:23:53.755 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 09:23:53.755 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 09:23:53.755 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 09:23:53.755 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 09:23:53.755 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 09:23:53.755 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 09:23:53.755 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 09:23:53.755 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 09:23:53.755 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 09:23:53.755 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 09:23:53.755 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 09:23:53.755 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 09:23:53.755 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 09:23:53.755 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 09:23:53.755 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 09:23:53.755 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 09:23:53.755 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 09:23:53.755 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 09:23:53.755 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:23:53.755 1 ERROR oslo_service.service 
>2018-06-26 09:23:53.758 1 CRITICAL cinder [req-aa4424ce-b13b-485d-a4fe-96358e6c16f8 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 09:23:53.758 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 09:23:53.758 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 09:23:53.758 1 ERROR cinder     sys.exit(main())
>2018-06-26 09:23:53.758 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 09:23:53.758 1 ERROR cinder     service.wait()
>2018-06-26 09:23:53.758 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 09:23:53.758 1 ERROR cinder     _launcher.wait()
>2018-06-26 09:23:53.758 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 09:23:53.758 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 09:23:53.758 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 09:23:53.758 1 ERROR cinder     self.services.wait()
>2018-06-26 09:23:53.758 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 09:23:53.758 1 ERROR cinder     service.wait()
>2018-06-26 09:23:53.758 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 09:23:53.758 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 09:23:53.758 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 09:23:53.758 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 09:23:53.758 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 09:23:53.758 1 ERROR cinder     post_fn = fn()
>2018-06-26 09:23:53.758 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 09:23:53.758 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 09:23:53.758 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 09:23:53.758 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 09:23:53.758 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 09:23:53.758 1 ERROR cinder 
>2018-06-26 09:23:56.340 1 WARNING cinder.scheduler.host_manager [req-8654ffa9-2b1b-40ba-a0c0-2c63ec95cecf - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 09:23:56.346 1 INFO cinder.rpc [req-8654ffa9-2b1b-40ba-a0c0-2c63ec95cecf - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 09:23:56.353 1 INFO cinder.rpc [req-8654ffa9-2b1b-40ba-a0c0-2c63ec95cecf - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 09:23:56.367 1 INFO cinder.rpc [req-8654ffa9-2b1b-40ba-a0c0-2c63ec95cecf - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 09:23:56.376 1 INFO cinder.rpc [req-8654ffa9-2b1b-40ba-a0c0-2c63ec95cecf - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 09:23:56.406 1 WARNING oslo_config.cfg [req-8654ffa9-2b1b-40ba-a0c0-2c63ec95cecf - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 09:23:56.408 1 WARNING oslo_config.cfg [req-8654ffa9-2b1b-40ba-a0c0-2c63ec95cecf - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:23:56.408 1 WARNING oslo_config.cfg [req-8654ffa9-2b1b-40ba-a0c0-2c63ec95cecf - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:23:56.409 1 WARNING oslo_config.cfg [req-8654ffa9-2b1b-40ba-a0c0-2c63ec95cecf - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:23:56.414 1 WARNING oslo_config.cfg [req-8654ffa9-2b1b-40ba-a0c0-2c63ec95cecf - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 09:23:56.415 1 WARNING oslo_config.cfg [req-8654ffa9-2b1b-40ba-a0c0-2c63ec95cecf - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 09:23:56.418 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 09:23:56.425 1 INFO cinder.manager [req-13fcd9cf-4a29-4ae5-94b8-0ca39b5ef290 - - - - -] Initiating service 5 cleanup
>2018-06-26 09:23:56.430 1 INFO cinder.manager [req-13fcd9cf-4a29-4ae5-94b8-0ca39b5ef290 - - - - -] Service 5 cleanup completed.
>2018-06-26 09:26:09.521 1 ERROR oslo.messaging._drivers.impl_rabbit [req-13fcd9cf-4a29-4ae5-94b8-0ca39b5ef290 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:26:09.523 1 ERROR oslo.messaging._drivers.impl_rabbit [req-13fcd9cf-4a29-4ae5-94b8-0ca39b5ef290 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:26:09.523 1 ERROR oslo_service.service [req-13fcd9cf-4a29-4ae5-94b8-0ca39b5ef290 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:26:09.523 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 09:26:09.523 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 09:26:09.523 1 ERROR oslo_service.service     service.start()
>2018-06-26 09:26:09.523 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 09:26:09.523 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 09:26:09.523 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 09:26:09.523 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 09:26:09.523 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 09:26:09.523 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 09:26:09.523 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 09:26:09.523 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 09:26:09.523 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 09:26:09.523 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 09:26:09.523 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 09:26:09.523 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 09:26:09.523 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 09:26:09.523 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 09:26:09.523 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 09:26:09.523 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 09:26:09.523 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 09:26:09.523 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 09:26:09.523 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 09:26:09.523 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 09:26:09.523 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 09:26:09.523 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 09:26:09.523 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:26:09.523 1 ERROR oslo_service.service 
>2018-06-26 09:26:09.526 1 CRITICAL cinder [req-8654ffa9-2b1b-40ba-a0c0-2c63ec95cecf - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 09:26:09.526 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 09:26:09.526 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 09:26:09.526 1 ERROR cinder     sys.exit(main())
>2018-06-26 09:26:09.526 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 09:26:09.526 1 ERROR cinder     service.wait()
>2018-06-26 09:26:09.526 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 09:26:09.526 1 ERROR cinder     _launcher.wait()
>2018-06-26 09:26:09.526 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 09:26:09.526 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 09:26:09.526 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 09:26:09.526 1 ERROR cinder     self.services.wait()
>2018-06-26 09:26:09.526 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 09:26:09.526 1 ERROR cinder     service.wait()
>2018-06-26 09:26:09.526 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 09:26:09.526 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 09:26:09.526 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 09:26:09.526 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 09:26:09.526 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 09:26:09.526 1 ERROR cinder     post_fn = fn()
>2018-06-26 09:26:09.526 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 09:26:09.526 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 09:26:09.526 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 09:26:09.526 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 09:26:09.526 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 09:26:09.526 1 ERROR cinder 
>2018-06-26 09:26:12.033 1 WARNING cinder.scheduler.host_manager [req-4b1a95c6-7a52-4f3d-9287-d808321349a2 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 09:26:12.038 1 INFO cinder.rpc [req-4b1a95c6-7a52-4f3d-9287-d808321349a2 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 09:26:12.044 1 INFO cinder.rpc [req-4b1a95c6-7a52-4f3d-9287-d808321349a2 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 09:26:12.055 1 INFO cinder.rpc [req-4b1a95c6-7a52-4f3d-9287-d808321349a2 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 09:26:12.061 1 INFO cinder.rpc [req-4b1a95c6-7a52-4f3d-9287-d808321349a2 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 09:26:12.087 1 WARNING oslo_config.cfg [req-4b1a95c6-7a52-4f3d-9287-d808321349a2 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 09:26:12.089 1 WARNING oslo_config.cfg [req-4b1a95c6-7a52-4f3d-9287-d808321349a2 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:26:12.089 1 WARNING oslo_config.cfg [req-4b1a95c6-7a52-4f3d-9287-d808321349a2 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:26:12.090 1 WARNING oslo_config.cfg [req-4b1a95c6-7a52-4f3d-9287-d808321349a2 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:26:12.095 1 WARNING oslo_config.cfg [req-4b1a95c6-7a52-4f3d-9287-d808321349a2 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 09:26:12.096 1 WARNING oslo_config.cfg [req-4b1a95c6-7a52-4f3d-9287-d808321349a2 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 09:26:12.098 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 09:26:12.108 1 INFO cinder.manager [req-d9cb4eae-a767-412a-b8b0-4f190e77d893 - - - - -] Initiating service 5 cleanup
>2018-06-26 09:26:12.114 1 INFO cinder.manager [req-d9cb4eae-a767-412a-b8b0-4f190e77d893 - - - - -] Service 5 cleanup completed.
>2018-06-26 09:28:24.751 1 ERROR oslo.messaging._drivers.impl_rabbit [req-d9cb4eae-a767-412a-b8b0-4f190e77d893 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:28:24.753 1 ERROR oslo.messaging._drivers.impl_rabbit [req-d9cb4eae-a767-412a-b8b0-4f190e77d893 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:28:24.754 1 ERROR oslo_service.service [req-d9cb4eae-a767-412a-b8b0-4f190e77d893 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:28:24.754 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 09:28:24.754 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 09:28:24.754 1 ERROR oslo_service.service     service.start()
>2018-06-26 09:28:24.754 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 09:28:24.754 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 09:28:24.754 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 09:28:24.754 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 09:28:24.754 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 09:28:24.754 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 09:28:24.754 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 09:28:24.754 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 09:28:24.754 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 09:28:24.754 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 09:28:24.754 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 09:28:24.754 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 09:28:24.754 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 09:28:24.754 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 09:28:24.754 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 09:28:24.754 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 09:28:24.754 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 09:28:24.754 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 09:28:24.754 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 09:28:24.754 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 09:28:24.754 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 09:28:24.754 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 09:28:24.754 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:28:24.754 1 ERROR oslo_service.service 
>2018-06-26 09:28:24.757 1 CRITICAL cinder [req-4b1a95c6-7a52-4f3d-9287-d808321349a2 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 09:28:24.757 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 09:28:24.757 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 09:28:24.757 1 ERROR cinder     sys.exit(main())
>2018-06-26 09:28:24.757 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 09:28:24.757 1 ERROR cinder     service.wait()
>2018-06-26 09:28:24.757 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 09:28:24.757 1 ERROR cinder     _launcher.wait()
>2018-06-26 09:28:24.757 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 09:28:24.757 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 09:28:24.757 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 09:28:24.757 1 ERROR cinder     self.services.wait()
>2018-06-26 09:28:24.757 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 09:28:24.757 1 ERROR cinder     service.wait()
>2018-06-26 09:28:24.757 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 09:28:24.757 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 09:28:24.757 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 09:28:24.757 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 09:28:24.757 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 09:28:24.757 1 ERROR cinder     post_fn = fn()
>2018-06-26 09:28:24.757 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 09:28:24.757 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 09:28:24.757 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 09:28:24.757 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 09:28:24.757 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 09:28:24.757 1 ERROR cinder 
>2018-06-26 09:28:27.355 1 WARNING cinder.scheduler.host_manager [req-11fa9478-c87e-49e8-be16-1f0f8c7fa843 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 09:28:27.361 1 INFO cinder.rpc [req-11fa9478-c87e-49e8-be16-1f0f8c7fa843 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 09:28:27.367 1 INFO cinder.rpc [req-11fa9478-c87e-49e8-be16-1f0f8c7fa843 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 09:28:27.377 1 INFO cinder.rpc [req-11fa9478-c87e-49e8-be16-1f0f8c7fa843 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 09:28:27.383 1 INFO cinder.rpc [req-11fa9478-c87e-49e8-be16-1f0f8c7fa843 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 09:28:27.405 1 WARNING oslo_config.cfg [req-11fa9478-c87e-49e8-be16-1f0f8c7fa843 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 09:28:27.407 1 WARNING oslo_config.cfg [req-11fa9478-c87e-49e8-be16-1f0f8c7fa843 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:28:27.407 1 WARNING oslo_config.cfg [req-11fa9478-c87e-49e8-be16-1f0f8c7fa843 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:28:27.408 1 WARNING oslo_config.cfg [req-11fa9478-c87e-49e8-be16-1f0f8c7fa843 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:28:27.412 1 WARNING oslo_config.cfg [req-11fa9478-c87e-49e8-be16-1f0f8c7fa843 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 09:28:27.413 1 WARNING oslo_config.cfg [req-11fa9478-c87e-49e8-be16-1f0f8c7fa843 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 09:28:27.416 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 09:28:27.422 1 INFO cinder.manager [req-af31a0da-cc55-4d15-a8a3-d512dba7ee54 - - - - -] Initiating service 5 cleanup
>2018-06-26 09:28:27.426 1 INFO cinder.manager [req-af31a0da-cc55-4d15-a8a3-d512dba7ee54 - - - - -] Service 5 cleanup completed.
>2018-06-26 09:30:39.433 1 ERROR oslo.messaging._drivers.impl_rabbit [req-af31a0da-cc55-4d15-a8a3-d512dba7ee54 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:30:39.434 1 ERROR oslo.messaging._drivers.impl_rabbit [req-af31a0da-cc55-4d15-a8a3-d512dba7ee54 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:30:39.435 1 ERROR oslo_service.service [req-af31a0da-cc55-4d15-a8a3-d512dba7ee54 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:30:39.435 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 09:30:39.435 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 09:30:39.435 1 ERROR oslo_service.service     service.start()
>2018-06-26 09:30:39.435 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 09:30:39.435 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 09:30:39.435 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 09:30:39.435 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 09:30:39.435 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 09:30:39.435 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 09:30:39.435 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 09:30:39.435 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 09:30:39.435 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 09:30:39.435 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 09:30:39.435 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 09:30:39.435 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 09:30:39.435 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 09:30:39.435 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 09:30:39.435 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 09:30:39.435 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 09:30:39.435 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 09:30:39.435 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 09:30:39.435 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 09:30:39.435 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 09:30:39.435 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 09:30:39.435 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 09:30:39.435 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:30:39.435 1 ERROR oslo_service.service 
>2018-06-26 09:30:39.438 1 CRITICAL cinder [req-11fa9478-c87e-49e8-be16-1f0f8c7fa843 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 09:30:39.438 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 09:30:39.438 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 09:30:39.438 1 ERROR cinder     sys.exit(main())
>2018-06-26 09:30:39.438 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 09:30:39.438 1 ERROR cinder     service.wait()
>2018-06-26 09:30:39.438 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 09:30:39.438 1 ERROR cinder     _launcher.wait()
>2018-06-26 09:30:39.438 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 09:30:39.438 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 09:30:39.438 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 09:30:39.438 1 ERROR cinder     self.services.wait()
>2018-06-26 09:30:39.438 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 09:30:39.438 1 ERROR cinder     service.wait()
>2018-06-26 09:30:39.438 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 09:30:39.438 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 09:30:39.438 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 09:30:39.438 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 09:30:39.438 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 09:30:39.438 1 ERROR cinder     post_fn = fn()
>2018-06-26 09:30:39.438 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 09:30:39.438 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 09:30:39.438 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 09:30:39.438 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 09:30:39.438 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 09:30:39.438 1 ERROR cinder 
>2018-06-26 09:30:42.113 1 WARNING cinder.scheduler.host_manager [req-4fcbf888-c20c-4a74-9447-b6fe315f8b98 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 09:30:42.118 1 INFO cinder.rpc [req-4fcbf888-c20c-4a74-9447-b6fe315f8b98 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 09:30:42.124 1 INFO cinder.rpc [req-4fcbf888-c20c-4a74-9447-b6fe315f8b98 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 09:30:42.136 1 INFO cinder.rpc [req-4fcbf888-c20c-4a74-9447-b6fe315f8b98 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 09:30:42.142 1 INFO cinder.rpc [req-4fcbf888-c20c-4a74-9447-b6fe315f8b98 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 09:30:42.164 1 WARNING oslo_config.cfg [req-4fcbf888-c20c-4a74-9447-b6fe315f8b98 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 09:30:42.166 1 WARNING oslo_config.cfg [req-4fcbf888-c20c-4a74-9447-b6fe315f8b98 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:30:42.167 1 WARNING oslo_config.cfg [req-4fcbf888-c20c-4a74-9447-b6fe315f8b98 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:30:42.167 1 WARNING oslo_config.cfg [req-4fcbf888-c20c-4a74-9447-b6fe315f8b98 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:30:42.172 1 WARNING oslo_config.cfg [req-4fcbf888-c20c-4a74-9447-b6fe315f8b98 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 09:30:42.174 1 WARNING oslo_config.cfg [req-4fcbf888-c20c-4a74-9447-b6fe315f8b98 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 09:30:42.176 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 09:30:42.182 1 INFO cinder.manager [req-832ed90d-c802-4db1-9a9e-60e9f3d5a8ed - - - - -] Initiating service 5 cleanup
>2018-06-26 09:30:42.186 1 INFO cinder.manager [req-832ed90d-c802-4db1-9a9e-60e9f3d5a8ed - - - - -] Service 5 cleanup completed.
>2018-06-26 09:32:46.616 1 ERROR oslo.messaging._drivers.impl_rabbit [req-832ed90d-c802-4db1-9a9e-60e9f3d5a8ed - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:32:46.618 1 ERROR oslo.messaging._drivers.impl_rabbit [req-832ed90d-c802-4db1-9a9e-60e9f3d5a8ed - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:32:46.618 1 ERROR oslo_service.service [req-832ed90d-c802-4db1-9a9e-60e9f3d5a8ed - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:32:46.618 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 09:32:46.618 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 09:32:46.618 1 ERROR oslo_service.service     service.start()
>2018-06-26 09:32:46.618 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 09:32:46.618 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 09:32:46.618 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 09:32:46.618 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 09:32:46.618 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 09:32:46.618 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 09:32:46.618 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 09:32:46.618 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 09:32:46.618 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 09:32:46.618 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 09:32:46.618 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 09:32:46.618 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 09:32:46.618 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 09:32:46.618 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 09:32:46.618 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 09:32:46.618 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 09:32:46.618 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 09:32:46.618 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 09:32:46.618 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 09:32:46.618 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 09:32:46.618 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 09:32:46.618 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 09:32:46.618 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:32:46.618 1 ERROR oslo_service.service 
>2018-06-26 09:32:46.621 1 CRITICAL cinder [req-4fcbf888-c20c-4a74-9447-b6fe315f8b98 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 09:32:46.621 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 09:32:46.621 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 09:32:46.621 1 ERROR cinder     sys.exit(main())
>2018-06-26 09:32:46.621 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 09:32:46.621 1 ERROR cinder     service.wait()
>2018-06-26 09:32:46.621 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 09:32:46.621 1 ERROR cinder     _launcher.wait()
>2018-06-26 09:32:46.621 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 09:32:46.621 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 09:32:46.621 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 09:32:46.621 1 ERROR cinder     self.services.wait()
>2018-06-26 09:32:46.621 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 09:32:46.621 1 ERROR cinder     service.wait()
>2018-06-26 09:32:46.621 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 09:32:46.621 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 09:32:46.621 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 09:32:46.621 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 09:32:46.621 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 09:32:46.621 1 ERROR cinder     post_fn = fn()
>2018-06-26 09:32:46.621 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 09:32:46.621 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 09:32:46.621 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 09:32:46.621 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 09:32:46.621 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 09:32:46.621 1 ERROR cinder 
>2018-06-26 09:32:49.369 1 WARNING cinder.scheduler.host_manager [req-769841af-27e6-4975-ba0c-1088b94b132e - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 09:32:49.376 1 INFO cinder.rpc [req-769841af-27e6-4975-ba0c-1088b94b132e - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 09:32:49.384 1 INFO cinder.rpc [req-769841af-27e6-4975-ba0c-1088b94b132e - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 09:32:49.406 1 INFO cinder.rpc [req-769841af-27e6-4975-ba0c-1088b94b132e - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 09:32:49.415 1 INFO cinder.rpc [req-769841af-27e6-4975-ba0c-1088b94b132e - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 09:32:49.444 1 WARNING oslo_config.cfg [req-769841af-27e6-4975-ba0c-1088b94b132e - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 09:32:49.446 1 WARNING oslo_config.cfg [req-769841af-27e6-4975-ba0c-1088b94b132e - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:32:49.446 1 WARNING oslo_config.cfg [req-769841af-27e6-4975-ba0c-1088b94b132e - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:32:49.447 1 WARNING oslo_config.cfg [req-769841af-27e6-4975-ba0c-1088b94b132e - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:32:49.452 1 WARNING oslo_config.cfg [req-769841af-27e6-4975-ba0c-1088b94b132e - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 09:32:49.453 1 WARNING oslo_config.cfg [req-769841af-27e6-4975-ba0c-1088b94b132e - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 09:32:49.456 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 09:32:49.466 1 INFO cinder.manager [req-299235a1-4776-4222-913a-978db7a18c45 - - - - -] Initiating service 5 cleanup
>2018-06-26 09:32:49.473 1 INFO cinder.manager [req-299235a1-4776-4222-913a-978db7a18c45 - - - - -] Service 5 cleanup completed.
>2018-06-26 09:35:01.436 1 ERROR oslo.messaging._drivers.impl_rabbit [req-299235a1-4776-4222-913a-978db7a18c45 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:35:01.439 1 ERROR oslo.messaging._drivers.impl_rabbit [req-299235a1-4776-4222-913a-978db7a18c45 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:35:01.439 1 ERROR oslo_service.service [req-299235a1-4776-4222-913a-978db7a18c45 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:35:01.439 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 09:35:01.439 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 09:35:01.439 1 ERROR oslo_service.service     service.start()
>2018-06-26 09:35:01.439 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 09:35:01.439 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 09:35:01.439 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 09:35:01.439 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 09:35:01.439 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 09:35:01.439 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 09:35:01.439 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 09:35:01.439 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 09:35:01.439 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 09:35:01.439 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 09:35:01.439 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 09:35:01.439 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 09:35:01.439 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 09:35:01.439 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 09:35:01.439 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 09:35:01.439 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 09:35:01.439 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 09:35:01.439 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 09:35:01.439 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 09:35:01.439 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 09:35:01.439 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 09:35:01.439 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 09:35:01.439 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:35:01.439 1 ERROR oslo_service.service 
>2018-06-26 09:35:01.443 1 CRITICAL cinder [req-769841af-27e6-4975-ba0c-1088b94b132e - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 09:35:01.443 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 09:35:01.443 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 09:35:01.443 1 ERROR cinder     sys.exit(main())
>2018-06-26 09:35:01.443 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 09:35:01.443 1 ERROR cinder     service.wait()
>2018-06-26 09:35:01.443 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 09:35:01.443 1 ERROR cinder     _launcher.wait()
>2018-06-26 09:35:01.443 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 09:35:01.443 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 09:35:01.443 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 09:35:01.443 1 ERROR cinder     self.services.wait()
>2018-06-26 09:35:01.443 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 09:35:01.443 1 ERROR cinder     service.wait()
>2018-06-26 09:35:01.443 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 09:35:01.443 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 09:35:01.443 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 09:35:01.443 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 09:35:01.443 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 09:35:01.443 1 ERROR cinder     post_fn = fn()
>2018-06-26 09:35:01.443 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 09:35:01.443 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 09:35:01.443 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 09:35:01.443 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 09:35:01.443 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 09:35:01.443 1 ERROR cinder 
>2018-06-26 09:35:04.048 1 WARNING cinder.scheduler.host_manager [req-bca74d52-0b59-4a8b-8d41-30bb247ff535 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 09:35:04.053 1 INFO cinder.rpc [req-bca74d52-0b59-4a8b-8d41-30bb247ff535 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 09:35:04.059 1 INFO cinder.rpc [req-bca74d52-0b59-4a8b-8d41-30bb247ff535 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 09:35:04.075 1 INFO cinder.rpc [req-bca74d52-0b59-4a8b-8d41-30bb247ff535 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 09:35:04.081 1 INFO cinder.rpc [req-bca74d52-0b59-4a8b-8d41-30bb247ff535 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 09:35:04.107 1 WARNING oslo_config.cfg [req-bca74d52-0b59-4a8b-8d41-30bb247ff535 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 09:35:04.110 1 WARNING oslo_config.cfg [req-bca74d52-0b59-4a8b-8d41-30bb247ff535 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:35:04.110 1 WARNING oslo_config.cfg [req-bca74d52-0b59-4a8b-8d41-30bb247ff535 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:35:04.111 1 WARNING oslo_config.cfg [req-bca74d52-0b59-4a8b-8d41-30bb247ff535 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:35:04.117 1 WARNING oslo_config.cfg [req-bca74d52-0b59-4a8b-8d41-30bb247ff535 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 09:35:04.118 1 WARNING oslo_config.cfg [req-bca74d52-0b59-4a8b-8d41-30bb247ff535 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 09:35:04.121 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 09:35:04.128 1 INFO cinder.manager [req-1ac051ab-f413-4abd-bdb9-85fa340800d6 - - - - -] Initiating service 5 cleanup
>2018-06-26 09:35:04.133 1 INFO cinder.manager [req-1ac051ab-f413-4abd-bdb9-85fa340800d6 - - - - -] Service 5 cleanup completed.
>2018-06-26 09:37:08.518 1 ERROR oslo.messaging._drivers.impl_rabbit [req-1ac051ab-f413-4abd-bdb9-85fa340800d6 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:37:08.521 1 ERROR oslo.messaging._drivers.impl_rabbit [req-1ac051ab-f413-4abd-bdb9-85fa340800d6 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:37:08.521 1 ERROR oslo_service.service [req-1ac051ab-f413-4abd-bdb9-85fa340800d6 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:37:08.521 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 09:37:08.521 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 09:37:08.521 1 ERROR oslo_service.service     service.start()
>2018-06-26 09:37:08.521 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 09:37:08.521 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 09:37:08.521 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 09:37:08.521 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 09:37:08.521 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 09:37:08.521 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 09:37:08.521 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 09:37:08.521 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 09:37:08.521 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 09:37:08.521 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 09:37:08.521 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 09:37:08.521 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 09:37:08.521 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 09:37:08.521 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 09:37:08.521 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 09:37:08.521 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 09:37:08.521 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 09:37:08.521 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 09:37:08.521 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 09:37:08.521 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 09:37:08.521 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 09:37:08.521 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 09:37:08.521 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:37:08.521 1 ERROR oslo_service.service 
>2018-06-26 09:37:08.524 1 CRITICAL cinder [req-bca74d52-0b59-4a8b-8d41-30bb247ff535 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 09:37:08.524 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 09:37:08.524 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 09:37:08.524 1 ERROR cinder     sys.exit(main())
>2018-06-26 09:37:08.524 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 09:37:08.524 1 ERROR cinder     service.wait()
>2018-06-26 09:37:08.524 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 09:37:08.524 1 ERROR cinder     _launcher.wait()
>2018-06-26 09:37:08.524 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 09:37:08.524 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 09:37:08.524 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 09:37:08.524 1 ERROR cinder     self.services.wait()
>2018-06-26 09:37:08.524 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 09:37:08.524 1 ERROR cinder     service.wait()
>2018-06-26 09:37:08.524 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 09:37:08.524 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 09:37:08.524 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 09:37:08.524 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 09:37:08.524 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 09:37:08.524 1 ERROR cinder     post_fn = fn()
>2018-06-26 09:37:08.524 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 09:37:08.524 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 09:37:08.524 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 09:37:08.524 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 09:37:08.524 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 09:37:08.524 1 ERROR cinder 
>2018-06-26 09:37:11.146 1 WARNING cinder.scheduler.host_manager [req-01fba82d-ea4a-4728-8042-42cd4982e37c - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 09:37:11.154 1 INFO cinder.rpc [req-01fba82d-ea4a-4728-8042-42cd4982e37c - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 09:37:11.161 1 INFO cinder.rpc [req-01fba82d-ea4a-4728-8042-42cd4982e37c - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 09:37:11.193 1 INFO cinder.rpc [req-01fba82d-ea4a-4728-8042-42cd4982e37c - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 09:37:11.206 1 INFO cinder.rpc [req-01fba82d-ea4a-4728-8042-42cd4982e37c - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 09:37:11.240 1 WARNING oslo_config.cfg [req-01fba82d-ea4a-4728-8042-42cd4982e37c - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 09:37:11.242 1 WARNING oslo_config.cfg [req-01fba82d-ea4a-4728-8042-42cd4982e37c - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:37:11.243 1 WARNING oslo_config.cfg [req-01fba82d-ea4a-4728-8042-42cd4982e37c - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:37:11.243 1 WARNING oslo_config.cfg [req-01fba82d-ea4a-4728-8042-42cd4982e37c - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:37:11.248 1 WARNING oslo_config.cfg [req-01fba82d-ea4a-4728-8042-42cd4982e37c - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 09:37:11.249 1 WARNING oslo_config.cfg [req-01fba82d-ea4a-4728-8042-42cd4982e37c - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 09:37:11.252 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 09:37:11.260 1 INFO cinder.manager [req-fb542d46-bc29-423e-9246-35578da9a924 - - - - -] Initiating service 5 cleanup
>2018-06-26 09:37:11.268 1 INFO cinder.manager [req-fb542d46-bc29-423e-9246-35578da9a924 - - - - -] Service 5 cleanup completed.
>2018-06-26 09:39:23.687 1 ERROR oslo.messaging._drivers.impl_rabbit [req-fb542d46-bc29-423e-9246-35578da9a924 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:39:23.689 1 ERROR oslo.messaging._drivers.impl_rabbit [req-fb542d46-bc29-423e-9246-35578da9a924 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:39:23.690 1 ERROR oslo_service.service [req-fb542d46-bc29-423e-9246-35578da9a924 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:39:23.690 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 09:39:23.690 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 09:39:23.690 1 ERROR oslo_service.service     service.start()
>2018-06-26 09:39:23.690 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 09:39:23.690 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 09:39:23.690 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 09:39:23.690 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 09:39:23.690 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 09:39:23.690 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 09:39:23.690 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 09:39:23.690 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 09:39:23.690 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 09:39:23.690 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 09:39:23.690 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 09:39:23.690 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 09:39:23.690 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 09:39:23.690 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 09:39:23.690 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 09:39:23.690 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 09:39:23.690 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 09:39:23.690 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 09:39:23.690 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 09:39:23.690 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 09:39:23.690 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 09:39:23.690 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 09:39:23.690 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:39:23.690 1 ERROR oslo_service.service 
>2018-06-26 09:39:23.693 1 CRITICAL cinder [req-01fba82d-ea4a-4728-8042-42cd4982e37c - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 09:39:23.693 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 09:39:23.693 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 09:39:23.693 1 ERROR cinder     sys.exit(main())
>2018-06-26 09:39:23.693 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 09:39:23.693 1 ERROR cinder     service.wait()
>2018-06-26 09:39:23.693 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 09:39:23.693 1 ERROR cinder     _launcher.wait()
>2018-06-26 09:39:23.693 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 09:39:23.693 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 09:39:23.693 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 09:39:23.693 1 ERROR cinder     self.services.wait()
>2018-06-26 09:39:23.693 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 09:39:23.693 1 ERROR cinder     service.wait()
>2018-06-26 09:39:23.693 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 09:39:23.693 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 09:39:23.693 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 09:39:23.693 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 09:39:23.693 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 09:39:23.693 1 ERROR cinder     post_fn = fn()
>2018-06-26 09:39:23.693 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 09:39:23.693 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 09:39:23.693 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 09:39:23.693 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 09:39:23.693 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 09:39:23.693 1 ERROR cinder 
>2018-06-26 09:39:26.372 1 WARNING cinder.scheduler.host_manager [req-6f9ac0e5-432c-4926-b7c5-a4a1fa3a5c76 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 09:39:26.378 1 INFO cinder.rpc [req-6f9ac0e5-432c-4926-b7c5-a4a1fa3a5c76 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 09:39:26.383 1 INFO cinder.rpc [req-6f9ac0e5-432c-4926-b7c5-a4a1fa3a5c76 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 09:39:26.394 1 INFO cinder.rpc [req-6f9ac0e5-432c-4926-b7c5-a4a1fa3a5c76 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 09:39:26.400 1 INFO cinder.rpc [req-6f9ac0e5-432c-4926-b7c5-a4a1fa3a5c76 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 09:39:26.423 1 WARNING oslo_config.cfg [req-6f9ac0e5-432c-4926-b7c5-a4a1fa3a5c76 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 09:39:26.425 1 WARNING oslo_config.cfg [req-6f9ac0e5-432c-4926-b7c5-a4a1fa3a5c76 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:39:26.425 1 WARNING oslo_config.cfg [req-6f9ac0e5-432c-4926-b7c5-a4a1fa3a5c76 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:39:26.426 1 WARNING oslo_config.cfg [req-6f9ac0e5-432c-4926-b7c5-a4a1fa3a5c76 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:39:26.431 1 WARNING oslo_config.cfg [req-6f9ac0e5-432c-4926-b7c5-a4a1fa3a5c76 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 09:39:26.432 1 WARNING oslo_config.cfg [req-6f9ac0e5-432c-4926-b7c5-a4a1fa3a5c76 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 09:39:26.435 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 09:39:26.441 1 INFO cinder.manager [req-b1633105-874f-410d-b531-26f3dd31995a - - - - -] Initiating service 5 cleanup
>2018-06-26 09:39:26.446 1 INFO cinder.manager [req-b1633105-874f-410d-b531-26f3dd31995a - - - - -] Service 5 cleanup completed.
>2018-06-26 09:41:32.638 1 ERROR oslo.messaging._drivers.impl_rabbit [req-b1633105-874f-410d-b531-26f3dd31995a - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:41:32.640 1 ERROR oslo.messaging._drivers.impl_rabbit [req-b1633105-874f-410d-b531-26f3dd31995a - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:41:32.640 1 ERROR oslo_service.service [req-b1633105-874f-410d-b531-26f3dd31995a - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:41:32.640 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 09:41:32.640 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 09:41:32.640 1 ERROR oslo_service.service     service.start()
>2018-06-26 09:41:32.640 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 09:41:32.640 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 09:41:32.640 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 09:41:32.640 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 09:41:32.640 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 09:41:32.640 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 09:41:32.640 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 09:41:32.640 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 09:41:32.640 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 09:41:32.640 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 09:41:32.640 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 09:41:32.640 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 09:41:32.640 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 09:41:32.640 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 09:41:32.640 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 09:41:32.640 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 09:41:32.640 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 09:41:32.640 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 09:41:32.640 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 09:41:32.640 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 09:41:32.640 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 09:41:32.640 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 09:41:32.640 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:41:32.640 1 ERROR oslo_service.service 
>2018-06-26 09:41:32.643 1 CRITICAL cinder [req-6f9ac0e5-432c-4926-b7c5-a4a1fa3a5c76 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 09:41:32.643 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 09:41:32.643 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 09:41:32.643 1 ERROR cinder     sys.exit(main())
>2018-06-26 09:41:32.643 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 09:41:32.643 1 ERROR cinder     service.wait()
>2018-06-26 09:41:32.643 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 09:41:32.643 1 ERROR cinder     _launcher.wait()
>2018-06-26 09:41:32.643 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 09:41:32.643 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 09:41:32.643 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 09:41:32.643 1 ERROR cinder     self.services.wait()
>2018-06-26 09:41:32.643 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 09:41:32.643 1 ERROR cinder     service.wait()
>2018-06-26 09:41:32.643 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 09:41:32.643 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 09:41:32.643 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 09:41:32.643 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 09:41:32.643 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 09:41:32.643 1 ERROR cinder     post_fn = fn()
>2018-06-26 09:41:32.643 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 09:41:32.643 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 09:41:32.643 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 09:41:32.643 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 09:41:32.643 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 09:41:32.643 1 ERROR cinder 
>2018-06-26 09:41:35.288 1 WARNING cinder.scheduler.host_manager [req-7357768e-c8ba-4435-b6b5-462374a36f1b - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 09:41:35.294 1 INFO cinder.rpc [req-7357768e-c8ba-4435-b6b5-462374a36f1b - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 09:41:35.299 1 INFO cinder.rpc [req-7357768e-c8ba-4435-b6b5-462374a36f1b - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 09:41:35.310 1 INFO cinder.rpc [req-7357768e-c8ba-4435-b6b5-462374a36f1b - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 09:41:35.316 1 INFO cinder.rpc [req-7357768e-c8ba-4435-b6b5-462374a36f1b - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 09:41:35.342 1 WARNING oslo_config.cfg [req-7357768e-c8ba-4435-b6b5-462374a36f1b - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 09:41:35.344 1 WARNING oslo_config.cfg [req-7357768e-c8ba-4435-b6b5-462374a36f1b - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:41:35.345 1 WARNING oslo_config.cfg [req-7357768e-c8ba-4435-b6b5-462374a36f1b - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:41:35.345 1 WARNING oslo_config.cfg [req-7357768e-c8ba-4435-b6b5-462374a36f1b - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:41:35.350 1 WARNING oslo_config.cfg [req-7357768e-c8ba-4435-b6b5-462374a36f1b - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 09:41:35.352 1 WARNING oslo_config.cfg [req-7357768e-c8ba-4435-b6b5-462374a36f1b - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 09:41:35.354 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 09:41:35.360 1 INFO cinder.manager [req-4edaf81e-5d0e-416d-b98d-e41eb663b282 - - - - -] Initiating service 5 cleanup
>2018-06-26 09:41:35.365 1 INFO cinder.manager [req-4edaf81e-5d0e-416d-b98d-e41eb663b282 - - - - -] Service 5 cleanup completed.
>2018-06-26 09:43:39.767 1 ERROR oslo.messaging._drivers.impl_rabbit [req-4edaf81e-5d0e-416d-b98d-e41eb663b282 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:43:39.768 1 ERROR oslo.messaging._drivers.impl_rabbit [req-4edaf81e-5d0e-416d-b98d-e41eb663b282 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:43:39.769 1 ERROR oslo_service.service [req-4edaf81e-5d0e-416d-b98d-e41eb663b282 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:43:39.769 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 09:43:39.769 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 09:43:39.769 1 ERROR oslo_service.service     service.start()
>2018-06-26 09:43:39.769 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 09:43:39.769 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 09:43:39.769 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 09:43:39.769 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 09:43:39.769 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 09:43:39.769 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 09:43:39.769 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 09:43:39.769 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 09:43:39.769 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 09:43:39.769 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 09:43:39.769 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 09:43:39.769 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 09:43:39.769 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 09:43:39.769 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 09:43:39.769 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 09:43:39.769 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 09:43:39.769 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 09:43:39.769 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 09:43:39.769 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 09:43:39.769 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 09:43:39.769 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 09:43:39.769 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 09:43:39.769 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:43:39.769 1 ERROR oslo_service.service 
>2018-06-26 09:43:39.772 1 CRITICAL cinder [req-7357768e-c8ba-4435-b6b5-462374a36f1b - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 09:43:39.772 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 09:43:39.772 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 09:43:39.772 1 ERROR cinder     sys.exit(main())
>2018-06-26 09:43:39.772 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 09:43:39.772 1 ERROR cinder     service.wait()
>2018-06-26 09:43:39.772 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 09:43:39.772 1 ERROR cinder     _launcher.wait()
>2018-06-26 09:43:39.772 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 09:43:39.772 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 09:43:39.772 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 09:43:39.772 1 ERROR cinder     self.services.wait()
>2018-06-26 09:43:39.772 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 09:43:39.772 1 ERROR cinder     service.wait()
>2018-06-26 09:43:39.772 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 09:43:39.772 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 09:43:39.772 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 09:43:39.772 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 09:43:39.772 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 09:43:39.772 1 ERROR cinder     post_fn = fn()
>2018-06-26 09:43:39.772 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 09:43:39.772 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 09:43:39.772 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 09:43:39.772 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 09:43:39.772 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 09:43:39.772 1 ERROR cinder 
>2018-06-26 09:43:42.436 1 WARNING cinder.scheduler.host_manager [req-664eca92-3606-4394-9f47-ebae089d9226 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 09:43:42.442 1 INFO cinder.rpc [req-664eca92-3606-4394-9f47-ebae089d9226 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 09:43:42.452 1 INFO cinder.rpc [req-664eca92-3606-4394-9f47-ebae089d9226 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 09:43:42.471 1 INFO cinder.rpc [req-664eca92-3606-4394-9f47-ebae089d9226 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 09:43:42.482 1 INFO cinder.rpc [req-664eca92-3606-4394-9f47-ebae089d9226 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 09:43:42.526 1 WARNING oslo_config.cfg [req-664eca92-3606-4394-9f47-ebae089d9226 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 09:43:42.529 1 WARNING oslo_config.cfg [req-664eca92-3606-4394-9f47-ebae089d9226 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:43:42.530 1 WARNING oslo_config.cfg [req-664eca92-3606-4394-9f47-ebae089d9226 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:43:42.531 1 WARNING oslo_config.cfg [req-664eca92-3606-4394-9f47-ebae089d9226 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:43:42.536 1 WARNING oslo_config.cfg [req-664eca92-3606-4394-9f47-ebae089d9226 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 09:43:42.537 1 WARNING oslo_config.cfg [req-664eca92-3606-4394-9f47-ebae089d9226 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 09:43:42.540 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 09:43:42.564 1 INFO cinder.manager [req-8294ae26-79c5-4156-b378-8f008a96a2a8 - - - - -] Initiating service 5 cleanup
>2018-06-26 09:43:42.587 1 INFO cinder.manager [req-8294ae26-79c5-4156-b378-8f008a96a2a8 - - - - -] Service 5 cleanup completed.
>2018-06-26 09:45:53.808 1 ERROR oslo.messaging._drivers.impl_rabbit [req-8294ae26-79c5-4156-b378-8f008a96a2a8 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:45:53.810 1 ERROR oslo.messaging._drivers.impl_rabbit [req-8294ae26-79c5-4156-b378-8f008a96a2a8 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:45:53.810 1 ERROR oslo_service.service [req-8294ae26-79c5-4156-b378-8f008a96a2a8 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:45:53.810 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 09:45:53.810 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 09:45:53.810 1 ERROR oslo_service.service     service.start()
>2018-06-26 09:45:53.810 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 09:45:53.810 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 09:45:53.810 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 09:45:53.810 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 09:45:53.810 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 09:45:53.810 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 09:45:53.810 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 09:45:53.810 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 09:45:53.810 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 09:45:53.810 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 09:45:53.810 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 09:45:53.810 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 09:45:53.810 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 09:45:53.810 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 09:45:53.810 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 09:45:53.810 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 09:45:53.810 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 09:45:53.810 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 09:45:53.810 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 09:45:53.810 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 09:45:53.810 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 09:45:53.810 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 09:45:53.810 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:45:53.810 1 ERROR oslo_service.service 
>2018-06-26 09:45:53.813 1 CRITICAL cinder [req-664eca92-3606-4394-9f47-ebae089d9226 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 09:45:53.813 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 09:45:53.813 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 09:45:53.813 1 ERROR cinder     sys.exit(main())
>2018-06-26 09:45:53.813 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 09:45:53.813 1 ERROR cinder     service.wait()
>2018-06-26 09:45:53.813 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 09:45:53.813 1 ERROR cinder     _launcher.wait()
>2018-06-26 09:45:53.813 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 09:45:53.813 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 09:45:53.813 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 09:45:53.813 1 ERROR cinder     self.services.wait()
>2018-06-26 09:45:53.813 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 09:45:53.813 1 ERROR cinder     service.wait()
>2018-06-26 09:45:53.813 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 09:45:53.813 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 09:45:53.813 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 09:45:53.813 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 09:45:53.813 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 09:45:53.813 1 ERROR cinder     post_fn = fn()
>2018-06-26 09:45:53.813 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 09:45:53.813 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 09:45:53.813 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 09:45:53.813 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 09:45:53.813 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 09:45:53.813 1 ERROR cinder 
>2018-06-26 09:45:56.478 1 WARNING cinder.scheduler.host_manager [req-54d42ff3-94cb-448f-87af-a304cd426a29 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 09:45:56.485 1 INFO cinder.rpc [req-54d42ff3-94cb-448f-87af-a304cd426a29 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 09:45:56.491 1 INFO cinder.rpc [req-54d42ff3-94cb-448f-87af-a304cd426a29 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 09:45:56.502 1 INFO cinder.rpc [req-54d42ff3-94cb-448f-87af-a304cd426a29 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 09:45:56.509 1 INFO cinder.rpc [req-54d42ff3-94cb-448f-87af-a304cd426a29 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 09:45:56.536 1 WARNING oslo_config.cfg [req-54d42ff3-94cb-448f-87af-a304cd426a29 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 09:45:56.539 1 WARNING oslo_config.cfg [req-54d42ff3-94cb-448f-87af-a304cd426a29 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:45:56.540 1 WARNING oslo_config.cfg [req-54d42ff3-94cb-448f-87af-a304cd426a29 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:45:56.540 1 WARNING oslo_config.cfg [req-54d42ff3-94cb-448f-87af-a304cd426a29 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:45:56.546 1 WARNING oslo_config.cfg [req-54d42ff3-94cb-448f-87af-a304cd426a29 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 09:45:56.547 1 WARNING oslo_config.cfg [req-54d42ff3-94cb-448f-87af-a304cd426a29 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 09:45:56.550 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 09:45:56.556 1 INFO cinder.manager [req-bbbd1042-35c9-4936-9b1f-e2e8168f8744 - - - - -] Initiating service 5 cleanup
>2018-06-26 09:45:56.561 1 INFO cinder.manager [req-bbbd1042-35c9-4936-9b1f-e2e8168f8744 - - - - -] Service 5 cleanup completed.
>2018-06-26 09:48:00.920 1 ERROR oslo.messaging._drivers.impl_rabbit [req-bbbd1042-35c9-4936-9b1f-e2e8168f8744 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:48:00.922 1 ERROR oslo.messaging._drivers.impl_rabbit [req-bbbd1042-35c9-4936-9b1f-e2e8168f8744 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:48:00.922 1 ERROR oslo_service.service [req-bbbd1042-35c9-4936-9b1f-e2e8168f8744 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:48:00.922 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 09:48:00.922 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 09:48:00.922 1 ERROR oslo_service.service     service.start()
>2018-06-26 09:48:00.922 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 09:48:00.922 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 09:48:00.922 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 09:48:00.922 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 09:48:00.922 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 09:48:00.922 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 09:48:00.922 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 09:48:00.922 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 09:48:00.922 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 09:48:00.922 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 09:48:00.922 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 09:48:00.922 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 09:48:00.922 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 09:48:00.922 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 09:48:00.922 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 09:48:00.922 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 09:48:00.922 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 09:48:00.922 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 09:48:00.922 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 09:48:00.922 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 09:48:00.922 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 09:48:00.922 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 09:48:00.922 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:48:00.922 1 ERROR oslo_service.service 
>2018-06-26 09:48:00.925 1 CRITICAL cinder [req-54d42ff3-94cb-448f-87af-a304cd426a29 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 09:48:00.925 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 09:48:00.925 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 09:48:00.925 1 ERROR cinder     sys.exit(main())
>2018-06-26 09:48:00.925 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 09:48:00.925 1 ERROR cinder     service.wait()
>2018-06-26 09:48:00.925 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 09:48:00.925 1 ERROR cinder     _launcher.wait()
>2018-06-26 09:48:00.925 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 09:48:00.925 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 09:48:00.925 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 09:48:00.925 1 ERROR cinder     self.services.wait()
>2018-06-26 09:48:00.925 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 09:48:00.925 1 ERROR cinder     service.wait()
>2018-06-26 09:48:00.925 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 09:48:00.925 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 09:48:00.925 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 09:48:00.925 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 09:48:00.925 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 09:48:00.925 1 ERROR cinder     post_fn = fn()
>2018-06-26 09:48:00.925 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 09:48:00.925 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 09:48:00.925 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 09:48:00.925 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 09:48:00.925 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 09:48:00.925 1 ERROR cinder 
>2018-06-26 09:48:03.646 1 WARNING cinder.scheduler.host_manager [req-b64aff75-a9ba-4953-9022-9c6f198e62a7 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 09:48:03.652 1 INFO cinder.rpc [req-b64aff75-a9ba-4953-9022-9c6f198e62a7 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 09:48:03.657 1 INFO cinder.rpc [req-b64aff75-a9ba-4953-9022-9c6f198e62a7 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 09:48:03.668 1 INFO cinder.rpc [req-b64aff75-a9ba-4953-9022-9c6f198e62a7 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 09:48:03.673 1 INFO cinder.rpc [req-b64aff75-a9ba-4953-9022-9c6f198e62a7 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 09:48:03.698 1 WARNING oslo_config.cfg [req-b64aff75-a9ba-4953-9022-9c6f198e62a7 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 09:48:03.700 1 WARNING oslo_config.cfg [req-b64aff75-a9ba-4953-9022-9c6f198e62a7 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:48:03.700 1 WARNING oslo_config.cfg [req-b64aff75-a9ba-4953-9022-9c6f198e62a7 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:48:03.701 1 WARNING oslo_config.cfg [req-b64aff75-a9ba-4953-9022-9c6f198e62a7 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:48:03.705 1 WARNING oslo_config.cfg [req-b64aff75-a9ba-4953-9022-9c6f198e62a7 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 09:48:03.706 1 WARNING oslo_config.cfg [req-b64aff75-a9ba-4953-9022-9c6f198e62a7 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 09:48:03.709 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 09:48:03.715 1 INFO cinder.manager [req-3ec6d010-8c54-485f-8b07-12544ca78f25 - - - - -] Initiating service 5 cleanup
>2018-06-26 09:48:03.721 1 INFO cinder.manager [req-3ec6d010-8c54-485f-8b07-12544ca78f25 - - - - -] Service 5 cleanup completed.
>2018-06-26 09:50:15.989 1 ERROR oslo.messaging._drivers.impl_rabbit [req-3ec6d010-8c54-485f-8b07-12544ca78f25 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:50:15.991 1 ERROR oslo.messaging._drivers.impl_rabbit [req-3ec6d010-8c54-485f-8b07-12544ca78f25 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:50:15.991 1 ERROR oslo_service.service [req-3ec6d010-8c54-485f-8b07-12544ca78f25 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:50:15.991 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 09:50:15.991 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 09:50:15.991 1 ERROR oslo_service.service     service.start()
>2018-06-26 09:50:15.991 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 09:50:15.991 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 09:50:15.991 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 09:50:15.991 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 09:50:15.991 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 09:50:15.991 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 09:50:15.991 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 09:50:15.991 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 09:50:15.991 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 09:50:15.991 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 09:50:15.991 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 09:50:15.991 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 09:50:15.991 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 09:50:15.991 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 09:50:15.991 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 09:50:15.991 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 09:50:15.991 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 09:50:15.991 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 09:50:15.991 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 09:50:15.991 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 09:50:15.991 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 09:50:15.991 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 09:50:15.991 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:50:15.991 1 ERROR oslo_service.service 
>2018-06-26 09:50:15.994 1 CRITICAL cinder [req-b64aff75-a9ba-4953-9022-9c6f198e62a7 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 09:50:15.994 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 09:50:15.994 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 09:50:15.994 1 ERROR cinder     sys.exit(main())
>2018-06-26 09:50:15.994 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 09:50:15.994 1 ERROR cinder     service.wait()
>2018-06-26 09:50:15.994 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 09:50:15.994 1 ERROR cinder     _launcher.wait()
>2018-06-26 09:50:15.994 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 09:50:15.994 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 09:50:15.994 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 09:50:15.994 1 ERROR cinder     self.services.wait()
>2018-06-26 09:50:15.994 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 09:50:15.994 1 ERROR cinder     service.wait()
>2018-06-26 09:50:15.994 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 09:50:15.994 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 09:50:15.994 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 09:50:15.994 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 09:50:15.994 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 09:50:15.994 1 ERROR cinder     post_fn = fn()
>2018-06-26 09:50:15.994 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 09:50:15.994 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 09:50:15.994 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 09:50:15.994 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 09:50:15.994 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 09:50:15.994 1 ERROR cinder 
>2018-06-26 09:50:18.633 1 WARNING cinder.scheduler.host_manager [req-d67c7e31-eb64-4f31-ab49-8e5a53478494 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 09:50:18.641 1 INFO cinder.rpc [req-d67c7e31-eb64-4f31-ab49-8e5a53478494 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 09:50:18.647 1 INFO cinder.rpc [req-d67c7e31-eb64-4f31-ab49-8e5a53478494 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 09:50:18.672 1 INFO cinder.rpc [req-d67c7e31-eb64-4f31-ab49-8e5a53478494 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 09:50:18.678 1 INFO cinder.rpc [req-d67c7e31-eb64-4f31-ab49-8e5a53478494 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 09:50:18.719 1 WARNING oslo_config.cfg [req-d67c7e31-eb64-4f31-ab49-8e5a53478494 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 09:50:18.721 1 WARNING oslo_config.cfg [req-d67c7e31-eb64-4f31-ab49-8e5a53478494 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:50:18.722 1 WARNING oslo_config.cfg [req-d67c7e31-eb64-4f31-ab49-8e5a53478494 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:50:18.722 1 WARNING oslo_config.cfg [req-d67c7e31-eb64-4f31-ab49-8e5a53478494 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:50:18.728 1 WARNING oslo_config.cfg [req-d67c7e31-eb64-4f31-ab49-8e5a53478494 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 09:50:18.729 1 WARNING oslo_config.cfg [req-d67c7e31-eb64-4f31-ab49-8e5a53478494 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 09:50:18.732 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 09:50:18.742 1 INFO cinder.manager [req-32413ed3-1ee2-4ee7-b3bc-aaf7c9be6af6 - - - - -] Initiating service 5 cleanup
>2018-06-26 09:50:18.749 1 INFO cinder.manager [req-32413ed3-1ee2-4ee7-b3bc-aaf7c9be6af6 - - - - -] Service 5 cleanup completed.
>2018-06-26 09:52:31.312 1 ERROR oslo.messaging._drivers.impl_rabbit [req-32413ed3-1ee2-4ee7-b3bc-aaf7c9be6af6 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:52:31.314 1 ERROR oslo.messaging._drivers.impl_rabbit [req-32413ed3-1ee2-4ee7-b3bc-aaf7c9be6af6 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:52:31.315 1 ERROR oslo_service.service [req-32413ed3-1ee2-4ee7-b3bc-aaf7c9be6af6 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:52:31.315 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 09:52:31.315 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 09:52:31.315 1 ERROR oslo_service.service     service.start()
>2018-06-26 09:52:31.315 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 09:52:31.315 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 09:52:31.315 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 09:52:31.315 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 09:52:31.315 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 09:52:31.315 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 09:52:31.315 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 09:52:31.315 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 09:52:31.315 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 09:52:31.315 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 09:52:31.315 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 09:52:31.315 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 09:52:31.315 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 09:52:31.315 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 09:52:31.315 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 09:52:31.315 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 09:52:31.315 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 09:52:31.315 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 09:52:31.315 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 09:52:31.315 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 09:52:31.315 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 09:52:31.315 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 09:52:31.315 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:52:31.315 1 ERROR oslo_service.service 
>2018-06-26 09:52:31.318 1 CRITICAL cinder [req-d67c7e31-eb64-4f31-ab49-8e5a53478494 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 09:52:31.318 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 09:52:31.318 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 09:52:31.318 1 ERROR cinder     sys.exit(main())
>2018-06-26 09:52:31.318 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 09:52:31.318 1 ERROR cinder     service.wait()
>2018-06-26 09:52:31.318 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 09:52:31.318 1 ERROR cinder     _launcher.wait()
>2018-06-26 09:52:31.318 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 09:52:31.318 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 09:52:31.318 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 09:52:31.318 1 ERROR cinder     self.services.wait()
>2018-06-26 09:52:31.318 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 09:52:31.318 1 ERROR cinder     service.wait()
>2018-06-26 09:52:31.318 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 09:52:31.318 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 09:52:31.318 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 09:52:31.318 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 09:52:31.318 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 09:52:31.318 1 ERROR cinder     post_fn = fn()
>2018-06-26 09:52:31.318 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 09:52:31.318 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 09:52:31.318 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 09:52:31.318 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 09:52:31.318 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 09:52:31.318 1 ERROR cinder 
>2018-06-26 09:52:33.949 1 WARNING cinder.scheduler.host_manager [req-074dcebe-d947-4e1a-872b-ccc0e6b3aef2 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 09:52:33.955 1 INFO cinder.rpc [req-074dcebe-d947-4e1a-872b-ccc0e6b3aef2 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 09:52:33.960 1 INFO cinder.rpc [req-074dcebe-d947-4e1a-872b-ccc0e6b3aef2 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 09:52:33.971 1 INFO cinder.rpc [req-074dcebe-d947-4e1a-872b-ccc0e6b3aef2 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 09:52:33.976 1 INFO cinder.rpc [req-074dcebe-d947-4e1a-872b-ccc0e6b3aef2 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 09:52:34.006 1 WARNING oslo_config.cfg [req-074dcebe-d947-4e1a-872b-ccc0e6b3aef2 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 09:52:34.008 1 WARNING oslo_config.cfg [req-074dcebe-d947-4e1a-872b-ccc0e6b3aef2 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:52:34.009 1 WARNING oslo_config.cfg [req-074dcebe-d947-4e1a-872b-ccc0e6b3aef2 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:52:34.009 1 WARNING oslo_config.cfg [req-074dcebe-d947-4e1a-872b-ccc0e6b3aef2 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:52:34.014 1 WARNING oslo_config.cfg [req-074dcebe-d947-4e1a-872b-ccc0e6b3aef2 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 09:52:34.015 1 WARNING oslo_config.cfg [req-074dcebe-d947-4e1a-872b-ccc0e6b3aef2 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 09:52:34.018 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 09:52:34.024 1 INFO cinder.manager [req-54cf217d-ade7-44af-a49e-a683f64cf92b - - - - -] Initiating service 5 cleanup
>2018-06-26 09:52:34.030 1 INFO cinder.manager [req-54cf217d-ade7-44af-a49e-a683f64cf92b - - - - -] Service 5 cleanup completed.
>2018-06-26 09:54:46.138 1 ERROR oslo.messaging._drivers.impl_rabbit [req-54cf217d-ade7-44af-a49e-a683f64cf92b - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:54:46.140 1 ERROR oslo.messaging._drivers.impl_rabbit [req-54cf217d-ade7-44af-a49e-a683f64cf92b - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:54:46.141 1 ERROR oslo_service.service [req-54cf217d-ade7-44af-a49e-a683f64cf92b - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:54:46.141 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 09:54:46.141 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 09:54:46.141 1 ERROR oslo_service.service     service.start()
>2018-06-26 09:54:46.141 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 09:54:46.141 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 09:54:46.141 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 09:54:46.141 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 09:54:46.141 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 09:54:46.141 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 09:54:46.141 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 09:54:46.141 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 09:54:46.141 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 09:54:46.141 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 09:54:46.141 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 09:54:46.141 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 09:54:46.141 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 09:54:46.141 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 09:54:46.141 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 09:54:46.141 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 09:54:46.141 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 09:54:46.141 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 09:54:46.141 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 09:54:46.141 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 09:54:46.141 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 09:54:46.141 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 09:54:46.141 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:54:46.141 1 ERROR oslo_service.service 
>2018-06-26 09:54:46.143 1 CRITICAL cinder [req-074dcebe-d947-4e1a-872b-ccc0e6b3aef2 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 09:54:46.143 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 09:54:46.143 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 09:54:46.143 1 ERROR cinder     sys.exit(main())
>2018-06-26 09:54:46.143 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 09:54:46.143 1 ERROR cinder     service.wait()
>2018-06-26 09:54:46.143 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 09:54:46.143 1 ERROR cinder     _launcher.wait()
>2018-06-26 09:54:46.143 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 09:54:46.143 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 09:54:46.143 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 09:54:46.143 1 ERROR cinder     self.services.wait()
>2018-06-26 09:54:46.143 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 09:54:46.143 1 ERROR cinder     service.wait()
>2018-06-26 09:54:46.143 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 09:54:46.143 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 09:54:46.143 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 09:54:46.143 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 09:54:46.143 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 09:54:46.143 1 ERROR cinder     post_fn = fn()
>2018-06-26 09:54:46.143 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 09:54:46.143 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 09:54:46.143 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 09:54:46.143 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 09:54:46.143 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 09:54:46.143 1 ERROR cinder 
>2018-06-26 09:54:48.739 1 WARNING cinder.scheduler.host_manager [req-2cff282f-d52b-4f5f-90bc-f0d7a65da994 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 09:54:48.747 1 INFO cinder.rpc [req-2cff282f-d52b-4f5f-90bc-f0d7a65da994 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 09:54:48.754 1 INFO cinder.rpc [req-2cff282f-d52b-4f5f-90bc-f0d7a65da994 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 09:54:48.780 1 INFO cinder.rpc [req-2cff282f-d52b-4f5f-90bc-f0d7a65da994 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 09:54:48.791 1 INFO cinder.rpc [req-2cff282f-d52b-4f5f-90bc-f0d7a65da994 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 09:54:48.820 1 WARNING oslo_config.cfg [req-2cff282f-d52b-4f5f-90bc-f0d7a65da994 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 09:54:48.822 1 WARNING oslo_config.cfg [req-2cff282f-d52b-4f5f-90bc-f0d7a65da994 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:54:48.823 1 WARNING oslo_config.cfg [req-2cff282f-d52b-4f5f-90bc-f0d7a65da994 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:54:48.823 1 WARNING oslo_config.cfg [req-2cff282f-d52b-4f5f-90bc-f0d7a65da994 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:54:48.828 1 WARNING oslo_config.cfg [req-2cff282f-d52b-4f5f-90bc-f0d7a65da994 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 09:54:48.830 1 WARNING oslo_config.cfg [req-2cff282f-d52b-4f5f-90bc-f0d7a65da994 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 09:54:48.832 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 09:54:48.841 1 INFO cinder.manager [req-1ef056c2-54dc-4a04-926f-3896b2a9ed10 - - - - -] Initiating service 5 cleanup
>2018-06-26 09:54:48.849 1 INFO cinder.manager [req-1ef056c2-54dc-4a04-926f-3896b2a9ed10 - - - - -] Service 5 cleanup completed.
>2018-06-26 09:57:00.894 1 ERROR oslo.messaging._drivers.impl_rabbit [req-1ef056c2-54dc-4a04-926f-3896b2a9ed10 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:57:00.897 1 ERROR oslo.messaging._drivers.impl_rabbit [req-1ef056c2-54dc-4a04-926f-3896b2a9ed10 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:57:00.898 1 ERROR oslo_service.service [req-1ef056c2-54dc-4a04-926f-3896b2a9ed10 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:57:00.898 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 09:57:00.898 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 09:57:00.898 1 ERROR oslo_service.service     service.start()
>2018-06-26 09:57:00.898 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 09:57:00.898 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 09:57:00.898 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 09:57:00.898 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 09:57:00.898 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 09:57:00.898 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 09:57:00.898 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 09:57:00.898 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 09:57:00.898 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 09:57:00.898 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 09:57:00.898 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 09:57:00.898 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 09:57:00.898 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 09:57:00.898 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 09:57:00.898 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 09:57:00.898 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 09:57:00.898 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 09:57:00.898 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 09:57:00.898 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 09:57:00.898 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 09:57:00.898 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 09:57:00.898 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 09:57:00.898 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:57:00.898 1 ERROR oslo_service.service 
>2018-06-26 09:57:00.902 1 CRITICAL cinder [req-2cff282f-d52b-4f5f-90bc-f0d7a65da994 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 09:57:00.902 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 09:57:00.902 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 09:57:00.902 1 ERROR cinder     sys.exit(main())
>2018-06-26 09:57:00.902 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 09:57:00.902 1 ERROR cinder     service.wait()
>2018-06-26 09:57:00.902 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 09:57:00.902 1 ERROR cinder     _launcher.wait()
>2018-06-26 09:57:00.902 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 09:57:00.902 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 09:57:00.902 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 09:57:00.902 1 ERROR cinder     self.services.wait()
>2018-06-26 09:57:00.902 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 09:57:00.902 1 ERROR cinder     service.wait()
>2018-06-26 09:57:00.902 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 09:57:00.902 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 09:57:00.902 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 09:57:00.902 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 09:57:00.902 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 09:57:00.902 1 ERROR cinder     post_fn = fn()
>2018-06-26 09:57:00.902 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 09:57:00.902 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 09:57:00.902 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 09:57:00.902 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 09:57:00.902 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 09:57:00.902 1 ERROR cinder 
>2018-06-26 09:57:03.718 1 WARNING cinder.scheduler.host_manager [req-3126a1cd-f656-46c9-9a6c-7a8fc134bf19 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 09:57:03.724 1 INFO cinder.rpc [req-3126a1cd-f656-46c9-9a6c-7a8fc134bf19 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 09:57:03.731 1 INFO cinder.rpc [req-3126a1cd-f656-46c9-9a6c-7a8fc134bf19 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 09:57:03.746 1 INFO cinder.rpc [req-3126a1cd-f656-46c9-9a6c-7a8fc134bf19 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 09:57:03.753 1 INFO cinder.rpc [req-3126a1cd-f656-46c9-9a6c-7a8fc134bf19 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 09:57:03.779 1 WARNING oslo_config.cfg [req-3126a1cd-f656-46c9-9a6c-7a8fc134bf19 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 09:57:03.781 1 WARNING oslo_config.cfg [req-3126a1cd-f656-46c9-9a6c-7a8fc134bf19 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:57:03.782 1 WARNING oslo_config.cfg [req-3126a1cd-f656-46c9-9a6c-7a8fc134bf19 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:57:03.782 1 WARNING oslo_config.cfg [req-3126a1cd-f656-46c9-9a6c-7a8fc134bf19 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:57:03.787 1 WARNING oslo_config.cfg [req-3126a1cd-f656-46c9-9a6c-7a8fc134bf19 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 09:57:03.788 1 WARNING oslo_config.cfg [req-3126a1cd-f656-46c9-9a6c-7a8fc134bf19 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 09:57:03.791 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 09:57:03.797 1 INFO cinder.manager [req-fa1f2d61-5b41-472b-8626-638efd1f7284 - - - - -] Initiating service 5 cleanup
>2018-06-26 09:57:03.803 1 INFO cinder.manager [req-fa1f2d61-5b41-472b-8626-638efd1f7284 - - - - -] Service 5 cleanup completed.
>2018-06-26 09:59:16.742 1 ERROR oslo.messaging._drivers.impl_rabbit [req-fa1f2d61-5b41-472b-8626-638efd1f7284 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:59:16.744 1 ERROR oslo.messaging._drivers.impl_rabbit [req-fa1f2d61-5b41-472b-8626-638efd1f7284 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:59:16.745 1 ERROR oslo_service.service [req-fa1f2d61-5b41-472b-8626-638efd1f7284 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:59:16.745 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 09:59:16.745 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 09:59:16.745 1 ERROR oslo_service.service     service.start()
>2018-06-26 09:59:16.745 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 09:59:16.745 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 09:59:16.745 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 09:59:16.745 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 09:59:16.745 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 09:59:16.745 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 09:59:16.745 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 09:59:16.745 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 09:59:16.745 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 09:59:16.745 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 09:59:16.745 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 09:59:16.745 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 09:59:16.745 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 09:59:16.745 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 09:59:16.745 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 09:59:16.745 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 09:59:16.745 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 09:59:16.745 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 09:59:16.745 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 09:59:16.745 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 09:59:16.745 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 09:59:16.745 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 09:59:16.745 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 09:59:16.745 1 ERROR oslo_service.service 
>2018-06-26 09:59:16.748 1 CRITICAL cinder [req-3126a1cd-f656-46c9-9a6c-7a8fc134bf19 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 09:59:16.748 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 09:59:16.748 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 09:59:16.748 1 ERROR cinder     sys.exit(main())
>2018-06-26 09:59:16.748 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 09:59:16.748 1 ERROR cinder     service.wait()
>2018-06-26 09:59:16.748 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 09:59:16.748 1 ERROR cinder     _launcher.wait()
>2018-06-26 09:59:16.748 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 09:59:16.748 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 09:59:16.748 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 09:59:16.748 1 ERROR cinder     self.services.wait()
>2018-06-26 09:59:16.748 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 09:59:16.748 1 ERROR cinder     service.wait()
>2018-06-26 09:59:16.748 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 09:59:16.748 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 09:59:16.748 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 09:59:16.748 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 09:59:16.748 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 09:59:16.748 1 ERROR cinder     post_fn = fn()
>2018-06-26 09:59:16.748 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 09:59:16.748 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 09:59:16.748 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 09:59:16.748 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 09:59:16.748 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 09:59:16.748 1 ERROR cinder 
>2018-06-26 09:59:19.404 1 WARNING cinder.scheduler.host_manager [req-1393cb85-353f-4d78-94f1-94731aae76a7 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 09:59:19.411 1 INFO cinder.rpc [req-1393cb85-353f-4d78-94f1-94731aae76a7 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 09:59:19.418 1 INFO cinder.rpc [req-1393cb85-353f-4d78-94f1-94731aae76a7 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 09:59:19.428 1 INFO cinder.rpc [req-1393cb85-353f-4d78-94f1-94731aae76a7 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 09:59:19.436 1 INFO cinder.rpc [req-1393cb85-353f-4d78-94f1-94731aae76a7 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 09:59:19.465 1 WARNING oslo_config.cfg [req-1393cb85-353f-4d78-94f1-94731aae76a7 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 09:59:19.467 1 WARNING oslo_config.cfg [req-1393cb85-353f-4d78-94f1-94731aae76a7 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:59:19.468 1 WARNING oslo_config.cfg [req-1393cb85-353f-4d78-94f1-94731aae76a7 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:59:19.469 1 WARNING oslo_config.cfg [req-1393cb85-353f-4d78-94f1-94731aae76a7 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 09:59:19.475 1 WARNING oslo_config.cfg [req-1393cb85-353f-4d78-94f1-94731aae76a7 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 09:59:19.477 1 WARNING oslo_config.cfg [req-1393cb85-353f-4d78-94f1-94731aae76a7 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 09:59:19.480 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 09:59:19.486 1 INFO cinder.manager [req-61c90f75-f664-4375-9034-33e4f8e67efd - - - - -] Initiating service 5 cleanup
>2018-06-26 09:59:19.491 1 INFO cinder.manager [req-61c90f75-f664-4375-9034-33e4f8e67efd - - - - -] Service 5 cleanup completed.
>2018-06-26 10:01:26.171 1 ERROR oslo.messaging._drivers.impl_rabbit [req-61c90f75-f664-4375-9034-33e4f8e67efd - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:01:26.173 1 ERROR oslo.messaging._drivers.impl_rabbit [req-61c90f75-f664-4375-9034-33e4f8e67efd - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:01:26.173 1 ERROR oslo_service.service [req-61c90f75-f664-4375-9034-33e4f8e67efd - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:01:26.173 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 10:01:26.173 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 10:01:26.173 1 ERROR oslo_service.service     service.start()
>2018-06-26 10:01:26.173 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 10:01:26.173 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 10:01:26.173 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 10:01:26.173 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 10:01:26.173 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 10:01:26.173 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 10:01:26.173 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 10:01:26.173 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 10:01:26.173 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 10:01:26.173 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 10:01:26.173 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 10:01:26.173 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 10:01:26.173 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 10:01:26.173 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 10:01:26.173 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 10:01:26.173 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 10:01:26.173 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 10:01:26.173 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 10:01:26.173 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 10:01:26.173 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 10:01:26.173 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 10:01:26.173 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 10:01:26.173 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:01:26.173 1 ERROR oslo_service.service 
>2018-06-26 10:01:26.176 1 CRITICAL cinder [req-1393cb85-353f-4d78-94f1-94731aae76a7 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 10:01:26.176 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 10:01:26.176 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 10:01:26.176 1 ERROR cinder     sys.exit(main())
>2018-06-26 10:01:26.176 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 10:01:26.176 1 ERROR cinder     service.wait()
>2018-06-26 10:01:26.176 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 10:01:26.176 1 ERROR cinder     _launcher.wait()
>2018-06-26 10:01:26.176 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 10:01:26.176 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 10:01:26.176 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 10:01:26.176 1 ERROR cinder     self.services.wait()
>2018-06-26 10:01:26.176 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 10:01:26.176 1 ERROR cinder     service.wait()
>2018-06-26 10:01:26.176 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 10:01:26.176 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 10:01:26.176 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 10:01:26.176 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 10:01:26.176 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 10:01:26.176 1 ERROR cinder     post_fn = fn()
>2018-06-26 10:01:26.176 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 10:01:26.176 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 10:01:26.176 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 10:01:26.176 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 10:01:26.176 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 10:01:26.176 1 ERROR cinder 
>2018-06-26 10:01:28.783 1 WARNING cinder.scheduler.host_manager [req-1807c993-ce5f-48ff-8af3-65bec16e0297 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 10:01:28.788 1 INFO cinder.rpc [req-1807c993-ce5f-48ff-8af3-65bec16e0297 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 10:01:28.795 1 INFO cinder.rpc [req-1807c993-ce5f-48ff-8af3-65bec16e0297 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 10:01:28.812 1 INFO cinder.rpc [req-1807c993-ce5f-48ff-8af3-65bec16e0297 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 10:01:28.818 1 INFO cinder.rpc [req-1807c993-ce5f-48ff-8af3-65bec16e0297 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 10:01:28.843 1 WARNING oslo_config.cfg [req-1807c993-ce5f-48ff-8af3-65bec16e0297 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 10:01:28.845 1 WARNING oslo_config.cfg [req-1807c993-ce5f-48ff-8af3-65bec16e0297 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:01:28.846 1 WARNING oslo_config.cfg [req-1807c993-ce5f-48ff-8af3-65bec16e0297 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:01:28.846 1 WARNING oslo_config.cfg [req-1807c993-ce5f-48ff-8af3-65bec16e0297 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:01:28.851 1 WARNING oslo_config.cfg [req-1807c993-ce5f-48ff-8af3-65bec16e0297 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 10:01:28.852 1 WARNING oslo_config.cfg [req-1807c993-ce5f-48ff-8af3-65bec16e0297 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 10:01:28.855 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 10:01:28.863 1 INFO cinder.manager [req-e17835d8-6505-4e13-baf0-1a62952b3407 - - - - -] Initiating service 5 cleanup
>2018-06-26 10:01:28.867 1 INFO cinder.manager [req-e17835d8-6505-4e13-baf0-1a62952b3407 - - - - -] Service 5 cleanup completed.
>2018-06-26 10:03:33.251 1 ERROR oslo.messaging._drivers.impl_rabbit [req-e17835d8-6505-4e13-baf0-1a62952b3407 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:03:33.253 1 ERROR oslo.messaging._drivers.impl_rabbit [req-e17835d8-6505-4e13-baf0-1a62952b3407 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:03:33.254 1 ERROR oslo_service.service [req-e17835d8-6505-4e13-baf0-1a62952b3407 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:03:33.254 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 10:03:33.254 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 10:03:33.254 1 ERROR oslo_service.service     service.start()
>2018-06-26 10:03:33.254 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 10:03:33.254 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 10:03:33.254 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 10:03:33.254 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 10:03:33.254 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 10:03:33.254 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 10:03:33.254 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 10:03:33.254 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 10:03:33.254 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 10:03:33.254 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 10:03:33.254 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 10:03:33.254 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 10:03:33.254 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 10:03:33.254 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 10:03:33.254 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 10:03:33.254 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 10:03:33.254 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 10:03:33.254 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 10:03:33.254 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 10:03:33.254 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 10:03:33.254 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 10:03:33.254 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 10:03:33.254 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:03:33.254 1 ERROR oslo_service.service 
>2018-06-26 10:03:33.257 1 CRITICAL cinder [req-1807c993-ce5f-48ff-8af3-65bec16e0297 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 10:03:33.257 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 10:03:33.257 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 10:03:33.257 1 ERROR cinder     sys.exit(main())
>2018-06-26 10:03:33.257 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 10:03:33.257 1 ERROR cinder     service.wait()
>2018-06-26 10:03:33.257 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 10:03:33.257 1 ERROR cinder     _launcher.wait()
>2018-06-26 10:03:33.257 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 10:03:33.257 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 10:03:33.257 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 10:03:33.257 1 ERROR cinder     self.services.wait()
>2018-06-26 10:03:33.257 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 10:03:33.257 1 ERROR cinder     service.wait()
>2018-06-26 10:03:33.257 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 10:03:33.257 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 10:03:33.257 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 10:03:33.257 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 10:03:33.257 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 10:03:33.257 1 ERROR cinder     post_fn = fn()
>2018-06-26 10:03:33.257 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 10:03:33.257 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 10:03:33.257 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 10:03:33.257 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 10:03:33.257 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 10:03:33.257 1 ERROR cinder 
>2018-06-26 10:03:35.954 1 WARNING cinder.scheduler.host_manager [req-b468e792-aeb2-4fba-a793-5e1708f7eadb - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 10:03:35.960 1 INFO cinder.rpc [req-b468e792-aeb2-4fba-a793-5e1708f7eadb - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 10:03:35.965 1 INFO cinder.rpc [req-b468e792-aeb2-4fba-a793-5e1708f7eadb - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 10:03:35.981 1 INFO cinder.rpc [req-b468e792-aeb2-4fba-a793-5e1708f7eadb - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 10:03:35.992 1 INFO cinder.rpc [req-b468e792-aeb2-4fba-a793-5e1708f7eadb - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 10:03:36.014 1 WARNING oslo_config.cfg [req-b468e792-aeb2-4fba-a793-5e1708f7eadb - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 10:03:36.016 1 WARNING oslo_config.cfg [req-b468e792-aeb2-4fba-a793-5e1708f7eadb - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:03:36.017 1 WARNING oslo_config.cfg [req-b468e792-aeb2-4fba-a793-5e1708f7eadb - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:03:36.017 1 WARNING oslo_config.cfg [req-b468e792-aeb2-4fba-a793-5e1708f7eadb - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:03:36.022 1 WARNING oslo_config.cfg [req-b468e792-aeb2-4fba-a793-5e1708f7eadb - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 10:03:36.023 1 WARNING oslo_config.cfg [req-b468e792-aeb2-4fba-a793-5e1708f7eadb - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 10:03:36.026 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 10:03:36.032 1 INFO cinder.manager [req-45357b03-16a3-4f53-ab2a-45d8f296192c - - - - -] Initiating service 5 cleanup
>2018-06-26 10:03:36.037 1 INFO cinder.manager [req-45357b03-16a3-4f53-ab2a-45d8f296192c - - - - -] Service 5 cleanup completed.
>2018-06-26 10:05:40.567 1 ERROR oslo.messaging._drivers.impl_rabbit [req-45357b03-16a3-4f53-ab2a-45d8f296192c - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:05:40.569 1 ERROR oslo.messaging._drivers.impl_rabbit [req-45357b03-16a3-4f53-ab2a-45d8f296192c - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:05:40.569 1 ERROR oslo_service.service [req-45357b03-16a3-4f53-ab2a-45d8f296192c - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:05:40.569 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 10:05:40.569 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 10:05:40.569 1 ERROR oslo_service.service     service.start()
>2018-06-26 10:05:40.569 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 10:05:40.569 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 10:05:40.569 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 10:05:40.569 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 10:05:40.569 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 10:05:40.569 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 10:05:40.569 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 10:05:40.569 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 10:05:40.569 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 10:05:40.569 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 10:05:40.569 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 10:05:40.569 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 10:05:40.569 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 10:05:40.569 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 10:05:40.569 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 10:05:40.569 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 10:05:40.569 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 10:05:40.569 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 10:05:40.569 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 10:05:40.569 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 10:05:40.569 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 10:05:40.569 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 10:05:40.569 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:05:40.569 1 ERROR oslo_service.service 
>2018-06-26 10:05:40.572 1 CRITICAL cinder [req-b468e792-aeb2-4fba-a793-5e1708f7eadb - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 10:05:40.572 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 10:05:40.572 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 10:05:40.572 1 ERROR cinder     sys.exit(main())
>2018-06-26 10:05:40.572 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 10:05:40.572 1 ERROR cinder     service.wait()
>2018-06-26 10:05:40.572 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 10:05:40.572 1 ERROR cinder     _launcher.wait()
>2018-06-26 10:05:40.572 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 10:05:40.572 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 10:05:40.572 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 10:05:40.572 1 ERROR cinder     self.services.wait()
>2018-06-26 10:05:40.572 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 10:05:40.572 1 ERROR cinder     service.wait()
>2018-06-26 10:05:40.572 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 10:05:40.572 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 10:05:40.572 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 10:05:40.572 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 10:05:40.572 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 10:05:40.572 1 ERROR cinder     post_fn = fn()
>2018-06-26 10:05:40.572 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 10:05:40.572 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 10:05:40.572 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 10:05:40.572 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 10:05:40.572 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 10:05:40.572 1 ERROR cinder 
>2018-06-26 10:05:43.233 1 WARNING cinder.scheduler.host_manager [req-1e4cab6c-1db9-4be7-add1-c478facf7737 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 10:05:43.239 1 INFO cinder.rpc [req-1e4cab6c-1db9-4be7-add1-c478facf7737 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 10:05:43.247 1 INFO cinder.rpc [req-1e4cab6c-1db9-4be7-add1-c478facf7737 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 10:05:43.262 1 INFO cinder.rpc [req-1e4cab6c-1db9-4be7-add1-c478facf7737 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 10:05:43.271 1 INFO cinder.rpc [req-1e4cab6c-1db9-4be7-add1-c478facf7737 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 10:05:43.311 1 WARNING oslo_config.cfg [req-1e4cab6c-1db9-4be7-add1-c478facf7737 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 10:05:43.314 1 WARNING oslo_config.cfg [req-1e4cab6c-1db9-4be7-add1-c478facf7737 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:05:43.315 1 WARNING oslo_config.cfg [req-1e4cab6c-1db9-4be7-add1-c478facf7737 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:05:43.315 1 WARNING oslo_config.cfg [req-1e4cab6c-1db9-4be7-add1-c478facf7737 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:05:43.324 1 WARNING oslo_config.cfg [req-1e4cab6c-1db9-4be7-add1-c478facf7737 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 10:05:43.325 1 WARNING oslo_config.cfg [req-1e4cab6c-1db9-4be7-add1-c478facf7737 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 10:05:43.329 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 10:05:43.337 1 INFO cinder.manager [req-da6569eb-116c-4ea2-9766-179b192f868a - - - - -] Initiating service 5 cleanup
>2018-06-26 10:05:43.344 1 INFO cinder.manager [req-da6569eb-116c-4ea2-9766-179b192f868a - - - - -] Service 5 cleanup completed.
>2018-06-26 10:07:47.751 1 ERROR oslo.messaging._drivers.impl_rabbit [req-da6569eb-116c-4ea2-9766-179b192f868a - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:07:47.753 1 ERROR oslo.messaging._drivers.impl_rabbit [req-da6569eb-116c-4ea2-9766-179b192f868a - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:07:47.754 1 ERROR oslo_service.service [req-da6569eb-116c-4ea2-9766-179b192f868a - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:07:47.754 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 10:07:47.754 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 10:07:47.754 1 ERROR oslo_service.service     service.start()
>2018-06-26 10:07:47.754 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 10:07:47.754 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 10:07:47.754 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 10:07:47.754 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 10:07:47.754 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 10:07:47.754 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 10:07:47.754 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 10:07:47.754 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 10:07:47.754 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 10:07:47.754 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 10:07:47.754 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 10:07:47.754 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 10:07:47.754 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 10:07:47.754 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 10:07:47.754 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 10:07:47.754 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 10:07:47.754 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 10:07:47.754 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 10:07:47.754 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 10:07:47.754 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 10:07:47.754 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 10:07:47.754 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 10:07:47.754 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:07:47.754 1 ERROR oslo_service.service 
>2018-06-26 10:07:47.757 1 CRITICAL cinder [req-1e4cab6c-1db9-4be7-add1-c478facf7737 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 10:07:47.757 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 10:07:47.757 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 10:07:47.757 1 ERROR cinder     sys.exit(main())
>2018-06-26 10:07:47.757 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 10:07:47.757 1 ERROR cinder     service.wait()
>2018-06-26 10:07:47.757 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 10:07:47.757 1 ERROR cinder     _launcher.wait()
>2018-06-26 10:07:47.757 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 10:07:47.757 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 10:07:47.757 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 10:07:47.757 1 ERROR cinder     self.services.wait()
>2018-06-26 10:07:47.757 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 10:07:47.757 1 ERROR cinder     service.wait()
>2018-06-26 10:07:47.757 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 10:07:47.757 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 10:07:47.757 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 10:07:47.757 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 10:07:47.757 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 10:07:47.757 1 ERROR cinder     post_fn = fn()
>2018-06-26 10:07:47.757 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 10:07:47.757 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 10:07:47.757 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 10:07:47.757 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 10:07:47.757 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 10:07:47.757 1 ERROR cinder 
>2018-06-26 10:07:50.479 1 WARNING cinder.scheduler.host_manager [req-cfca022d-8fb4-4297-a841-df5574f4715c - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 10:07:50.486 1 INFO cinder.rpc [req-cfca022d-8fb4-4297-a841-df5574f4715c - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 10:07:50.493 1 INFO cinder.rpc [req-cfca022d-8fb4-4297-a841-df5574f4715c - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 10:07:50.505 1 INFO cinder.rpc [req-cfca022d-8fb4-4297-a841-df5574f4715c - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 10:07:50.512 1 INFO cinder.rpc [req-cfca022d-8fb4-4297-a841-df5574f4715c - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 10:07:50.542 1 WARNING oslo_config.cfg [req-cfca022d-8fb4-4297-a841-df5574f4715c - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 10:07:50.544 1 WARNING oslo_config.cfg [req-cfca022d-8fb4-4297-a841-df5574f4715c - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:07:50.545 1 WARNING oslo_config.cfg [req-cfca022d-8fb4-4297-a841-df5574f4715c - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:07:50.545 1 WARNING oslo_config.cfg [req-cfca022d-8fb4-4297-a841-df5574f4715c - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:07:50.550 1 WARNING oslo_config.cfg [req-cfca022d-8fb4-4297-a841-df5574f4715c - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 10:07:50.552 1 WARNING oslo_config.cfg [req-cfca022d-8fb4-4297-a841-df5574f4715c - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 10:07:50.554 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 10:07:50.560 1 INFO cinder.manager [req-10193033-6a27-485d-adf9-93af93207834 - - - - -] Initiating service 5 cleanup
>2018-06-26 10:07:50.564 1 INFO cinder.manager [req-10193033-6a27-485d-adf9-93af93207834 - - - - -] Service 5 cleanup completed.
>2018-06-26 10:09:56.985 1 ERROR oslo.messaging._drivers.impl_rabbit [req-10193033-6a27-485d-adf9-93af93207834 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:09:56.988 1 ERROR oslo.messaging._drivers.impl_rabbit [req-10193033-6a27-485d-adf9-93af93207834 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:09:56.988 1 ERROR oslo_service.service [req-10193033-6a27-485d-adf9-93af93207834 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:09:56.988 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 10:09:56.988 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 10:09:56.988 1 ERROR oslo_service.service     service.start()
>2018-06-26 10:09:56.988 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 10:09:56.988 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 10:09:56.988 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 10:09:56.988 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 10:09:56.988 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 10:09:56.988 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 10:09:56.988 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 10:09:56.988 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 10:09:56.988 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 10:09:56.988 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 10:09:56.988 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 10:09:56.988 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 10:09:56.988 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 10:09:56.988 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 10:09:56.988 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 10:09:56.988 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 10:09:56.988 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 10:09:56.988 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 10:09:56.988 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 10:09:56.988 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 10:09:56.988 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 10:09:56.988 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 10:09:56.988 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:09:56.988 1 ERROR oslo_service.service 
>2018-06-26 10:09:56.991 1 CRITICAL cinder [req-cfca022d-8fb4-4297-a841-df5574f4715c - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 10:09:56.991 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 10:09:56.991 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 10:09:56.991 1 ERROR cinder     sys.exit(main())
>2018-06-26 10:09:56.991 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 10:09:56.991 1 ERROR cinder     service.wait()
>2018-06-26 10:09:56.991 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 10:09:56.991 1 ERROR cinder     _launcher.wait()
>2018-06-26 10:09:56.991 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 10:09:56.991 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 10:09:56.991 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 10:09:56.991 1 ERROR cinder     self.services.wait()
>2018-06-26 10:09:56.991 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 10:09:56.991 1 ERROR cinder     service.wait()
>2018-06-26 10:09:56.991 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 10:09:56.991 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 10:09:56.991 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 10:09:56.991 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 10:09:56.991 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 10:09:56.991 1 ERROR cinder     post_fn = fn()
>2018-06-26 10:09:56.991 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 10:09:56.991 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 10:09:56.991 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 10:09:56.991 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 10:09:56.991 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 10:09:56.991 1 ERROR cinder 
>2018-06-26 10:09:59.597 1 WARNING cinder.scheduler.host_manager [req-ee84d1d7-615f-43fc-a6ea-ba4405d3235d - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 10:09:59.604 1 INFO cinder.rpc [req-ee84d1d7-615f-43fc-a6ea-ba4405d3235d - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 10:09:59.610 1 INFO cinder.rpc [req-ee84d1d7-615f-43fc-a6ea-ba4405d3235d - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 10:09:59.623 1 INFO cinder.rpc [req-ee84d1d7-615f-43fc-a6ea-ba4405d3235d - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 10:09:59.630 1 INFO cinder.rpc [req-ee84d1d7-615f-43fc-a6ea-ba4405d3235d - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 10:09:59.656 1 WARNING oslo_config.cfg [req-ee84d1d7-615f-43fc-a6ea-ba4405d3235d - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 10:09:59.658 1 WARNING oslo_config.cfg [req-ee84d1d7-615f-43fc-a6ea-ba4405d3235d - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:09:59.659 1 WARNING oslo_config.cfg [req-ee84d1d7-615f-43fc-a6ea-ba4405d3235d - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:09:59.659 1 WARNING oslo_config.cfg [req-ee84d1d7-615f-43fc-a6ea-ba4405d3235d - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:09:59.665 1 WARNING oslo_config.cfg [req-ee84d1d7-615f-43fc-a6ea-ba4405d3235d - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 10:09:59.667 1 WARNING oslo_config.cfg [req-ee84d1d7-615f-43fc-a6ea-ba4405d3235d - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 10:09:59.669 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 10:09:59.676 1 INFO cinder.manager [req-c3831e41-5f74-4f21-b698-b3b2b86e6795 - - - - -] Initiating service 5 cleanup
>2018-06-26 10:09:59.680 1 INFO cinder.manager [req-c3831e41-5f74-4f21-b698-b3b2b86e6795 - - - - -] Service 5 cleanup completed.
>2018-06-26 10:12:11.180 1 ERROR oslo.messaging._drivers.impl_rabbit [req-c3831e41-5f74-4f21-b698-b3b2b86e6795 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:12:11.183 1 ERROR oslo.messaging._drivers.impl_rabbit [req-c3831e41-5f74-4f21-b698-b3b2b86e6795 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:12:11.183 1 ERROR oslo_service.service [req-c3831e41-5f74-4f21-b698-b3b2b86e6795 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:12:11.183 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 10:12:11.183 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 10:12:11.183 1 ERROR oslo_service.service     service.start()
>2018-06-26 10:12:11.183 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 10:12:11.183 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 10:12:11.183 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 10:12:11.183 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 10:12:11.183 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 10:12:11.183 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 10:12:11.183 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 10:12:11.183 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 10:12:11.183 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 10:12:11.183 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 10:12:11.183 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 10:12:11.183 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 10:12:11.183 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 10:12:11.183 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 10:12:11.183 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 10:12:11.183 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 10:12:11.183 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 10:12:11.183 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 10:12:11.183 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 10:12:11.183 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 10:12:11.183 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 10:12:11.183 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 10:12:11.183 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:12:11.183 1 ERROR oslo_service.service 
>2018-06-26 10:12:11.187 1 CRITICAL cinder [req-ee84d1d7-615f-43fc-a6ea-ba4405d3235d - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 10:12:11.187 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 10:12:11.187 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 10:12:11.187 1 ERROR cinder     sys.exit(main())
>2018-06-26 10:12:11.187 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 10:12:11.187 1 ERROR cinder     service.wait()
>2018-06-26 10:12:11.187 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 10:12:11.187 1 ERROR cinder     _launcher.wait()
>2018-06-26 10:12:11.187 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 10:12:11.187 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 10:12:11.187 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 10:12:11.187 1 ERROR cinder     self.services.wait()
>2018-06-26 10:12:11.187 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 10:12:11.187 1 ERROR cinder     service.wait()
>2018-06-26 10:12:11.187 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 10:12:11.187 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 10:12:11.187 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 10:12:11.187 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 10:12:11.187 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 10:12:11.187 1 ERROR cinder     post_fn = fn()
>2018-06-26 10:12:11.187 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 10:12:11.187 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 10:12:11.187 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 10:12:11.187 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 10:12:11.187 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 10:12:11.187 1 ERROR cinder 
>2018-06-26 10:12:13.895 1 WARNING cinder.scheduler.host_manager [req-0d537422-329b-4b2b-9c0a-fddea146a215 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 10:12:13.901 1 INFO cinder.rpc [req-0d537422-329b-4b2b-9c0a-fddea146a215 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 10:12:13.905 1 INFO cinder.rpc [req-0d537422-329b-4b2b-9c0a-fddea146a215 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 10:12:13.917 1 INFO cinder.rpc [req-0d537422-329b-4b2b-9c0a-fddea146a215 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 10:12:13.923 1 INFO cinder.rpc [req-0d537422-329b-4b2b-9c0a-fddea146a215 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 10:12:13.947 1 WARNING oslo_config.cfg [req-0d537422-329b-4b2b-9c0a-fddea146a215 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 10:12:13.950 1 WARNING oslo_config.cfg [req-0d537422-329b-4b2b-9c0a-fddea146a215 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:12:13.950 1 WARNING oslo_config.cfg [req-0d537422-329b-4b2b-9c0a-fddea146a215 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:12:13.951 1 WARNING oslo_config.cfg [req-0d537422-329b-4b2b-9c0a-fddea146a215 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:12:13.956 1 WARNING oslo_config.cfg [req-0d537422-329b-4b2b-9c0a-fddea146a215 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 10:12:13.957 1 WARNING oslo_config.cfg [req-0d537422-329b-4b2b-9c0a-fddea146a215 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 10:12:13.959 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 10:12:13.965 1 INFO cinder.manager [req-382ea205-4440-4683-9ffd-1e2de8c78c63 - - - - -] Initiating service 5 cleanup
>2018-06-26 10:12:13.969 1 INFO cinder.manager [req-382ea205-4440-4683-9ffd-1e2de8c78c63 - - - - -] Service 5 cleanup completed.
>2018-06-26 10:14:18.570 1 ERROR oslo.messaging._drivers.impl_rabbit [req-382ea205-4440-4683-9ffd-1e2de8c78c63 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:14:18.573 1 ERROR oslo.messaging._drivers.impl_rabbit [req-382ea205-4440-4683-9ffd-1e2de8c78c63 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:14:18.573 1 ERROR oslo_service.service [req-382ea205-4440-4683-9ffd-1e2de8c78c63 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:14:18.573 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 10:14:18.573 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 10:14:18.573 1 ERROR oslo_service.service     service.start()
>2018-06-26 10:14:18.573 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 10:14:18.573 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 10:14:18.573 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 10:14:18.573 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 10:14:18.573 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 10:14:18.573 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 10:14:18.573 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 10:14:18.573 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 10:14:18.573 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 10:14:18.573 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 10:14:18.573 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 10:14:18.573 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 10:14:18.573 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 10:14:18.573 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 10:14:18.573 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 10:14:18.573 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 10:14:18.573 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 10:14:18.573 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 10:14:18.573 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 10:14:18.573 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 10:14:18.573 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 10:14:18.573 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 10:14:18.573 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:14:18.573 1 ERROR oslo_service.service 
>2018-06-26 10:14:18.576 1 CRITICAL cinder [req-0d537422-329b-4b2b-9c0a-fddea146a215 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 10:14:18.576 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 10:14:18.576 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 10:14:18.576 1 ERROR cinder     sys.exit(main())
>2018-06-26 10:14:18.576 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 10:14:18.576 1 ERROR cinder     service.wait()
>2018-06-26 10:14:18.576 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 10:14:18.576 1 ERROR cinder     _launcher.wait()
>2018-06-26 10:14:18.576 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 10:14:18.576 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 10:14:18.576 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 10:14:18.576 1 ERROR cinder     self.services.wait()
>2018-06-26 10:14:18.576 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 10:14:18.576 1 ERROR cinder     service.wait()
>2018-06-26 10:14:18.576 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 10:14:18.576 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 10:14:18.576 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 10:14:18.576 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 10:14:18.576 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 10:14:18.576 1 ERROR cinder     post_fn = fn()
>2018-06-26 10:14:18.576 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 10:14:18.576 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 10:14:18.576 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 10:14:18.576 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 10:14:18.576 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 10:14:18.576 1 ERROR cinder 
>2018-06-26 10:14:21.209 1 WARNING cinder.scheduler.host_manager [req-13bf7609-ff38-4d2d-bfa1-a68ce85d24d8 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 10:14:21.214 1 INFO cinder.rpc [req-13bf7609-ff38-4d2d-bfa1-a68ce85d24d8 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 10:14:21.219 1 INFO cinder.rpc [req-13bf7609-ff38-4d2d-bfa1-a68ce85d24d8 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 10:14:21.231 1 INFO cinder.rpc [req-13bf7609-ff38-4d2d-bfa1-a68ce85d24d8 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 10:14:21.237 1 INFO cinder.rpc [req-13bf7609-ff38-4d2d-bfa1-a68ce85d24d8 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 10:14:21.258 1 WARNING oslo_config.cfg [req-13bf7609-ff38-4d2d-bfa1-a68ce85d24d8 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 10:14:21.260 1 WARNING oslo_config.cfg [req-13bf7609-ff38-4d2d-bfa1-a68ce85d24d8 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:14:21.260 1 WARNING oslo_config.cfg [req-13bf7609-ff38-4d2d-bfa1-a68ce85d24d8 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:14:21.261 1 WARNING oslo_config.cfg [req-13bf7609-ff38-4d2d-bfa1-a68ce85d24d8 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:14:21.266 1 WARNING oslo_config.cfg [req-13bf7609-ff38-4d2d-bfa1-a68ce85d24d8 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 10:14:21.267 1 WARNING oslo_config.cfg [req-13bf7609-ff38-4d2d-bfa1-a68ce85d24d8 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 10:14:21.270 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 10:14:21.275 1 INFO cinder.manager [req-d2901fad-f6bf-4a4a-bdee-be4f2360328c - - - - -] Initiating service 5 cleanup
>2018-06-26 10:14:21.280 1 INFO cinder.manager [req-d2901fad-f6bf-4a4a-bdee-be4f2360328c - - - - -] Service 5 cleanup completed.
>2018-06-26 10:16:27.658 1 ERROR oslo.messaging._drivers.impl_rabbit [req-d2901fad-f6bf-4a4a-bdee-be4f2360328c - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:16:27.660 1 ERROR oslo.messaging._drivers.impl_rabbit [req-d2901fad-f6bf-4a4a-bdee-be4f2360328c - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:16:27.660 1 ERROR oslo_service.service [req-d2901fad-f6bf-4a4a-bdee-be4f2360328c - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:16:27.660 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 10:16:27.660 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 10:16:27.660 1 ERROR oslo_service.service     service.start()
>2018-06-26 10:16:27.660 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 10:16:27.660 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 10:16:27.660 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 10:16:27.660 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 10:16:27.660 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 10:16:27.660 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 10:16:27.660 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 10:16:27.660 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 10:16:27.660 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 10:16:27.660 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 10:16:27.660 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 10:16:27.660 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 10:16:27.660 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 10:16:27.660 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 10:16:27.660 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 10:16:27.660 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 10:16:27.660 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 10:16:27.660 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 10:16:27.660 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 10:16:27.660 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 10:16:27.660 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 10:16:27.660 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 10:16:27.660 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:16:27.660 1 ERROR oslo_service.service 
>2018-06-26 10:16:27.663 1 CRITICAL cinder [req-13bf7609-ff38-4d2d-bfa1-a68ce85d24d8 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 10:16:27.663 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 10:16:27.663 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 10:16:27.663 1 ERROR cinder     sys.exit(main())
>2018-06-26 10:16:27.663 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 10:16:27.663 1 ERROR cinder     service.wait()
>2018-06-26 10:16:27.663 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 10:16:27.663 1 ERROR cinder     _launcher.wait()
>2018-06-26 10:16:27.663 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 10:16:27.663 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 10:16:27.663 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 10:16:27.663 1 ERROR cinder     self.services.wait()
>2018-06-26 10:16:27.663 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 10:16:27.663 1 ERROR cinder     service.wait()
>2018-06-26 10:16:27.663 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 10:16:27.663 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 10:16:27.663 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 10:16:27.663 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 10:16:27.663 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 10:16:27.663 1 ERROR cinder     post_fn = fn()
>2018-06-26 10:16:27.663 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 10:16:27.663 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 10:16:27.663 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 10:16:27.663 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 10:16:27.663 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 10:16:27.663 1 ERROR cinder 
>2018-06-26 10:16:30.337 1 WARNING cinder.scheduler.host_manager [req-ce1bfca9-8616-4dd5-b95f-92577dd097d2 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 10:16:30.344 1 INFO cinder.rpc [req-ce1bfca9-8616-4dd5-b95f-92577dd097d2 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 10:16:30.351 1 INFO cinder.rpc [req-ce1bfca9-8616-4dd5-b95f-92577dd097d2 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 10:16:30.366 1 INFO cinder.rpc [req-ce1bfca9-8616-4dd5-b95f-92577dd097d2 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 10:16:30.374 1 INFO cinder.rpc [req-ce1bfca9-8616-4dd5-b95f-92577dd097d2 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 10:16:30.398 1 WARNING oslo_config.cfg [req-ce1bfca9-8616-4dd5-b95f-92577dd097d2 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 10:16:30.400 1 WARNING oslo_config.cfg [req-ce1bfca9-8616-4dd5-b95f-92577dd097d2 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:16:30.401 1 WARNING oslo_config.cfg [req-ce1bfca9-8616-4dd5-b95f-92577dd097d2 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:16:30.402 1 WARNING oslo_config.cfg [req-ce1bfca9-8616-4dd5-b95f-92577dd097d2 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:16:30.407 1 WARNING oslo_config.cfg [req-ce1bfca9-8616-4dd5-b95f-92577dd097d2 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 10:16:30.409 1 WARNING oslo_config.cfg [req-ce1bfca9-8616-4dd5-b95f-92577dd097d2 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 10:16:30.411 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 10:16:30.418 1 INFO cinder.manager [req-7f0384dc-74c6-4ac4-a2eb-d4d4367eae44 - - - - -] Initiating service 5 cleanup
>2018-06-26 10:16:30.424 1 INFO cinder.manager [req-7f0384dc-74c6-4ac4-a2eb-d4d4367eae44 - - - - -] Service 5 cleanup completed.
>2018-06-26 10:18:42.157 1 ERROR oslo.messaging._drivers.impl_rabbit [req-7f0384dc-74c6-4ac4-a2eb-d4d4367eae44 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:18:42.159 1 ERROR oslo.messaging._drivers.impl_rabbit [req-7f0384dc-74c6-4ac4-a2eb-d4d4367eae44 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:18:42.159 1 ERROR oslo_service.service [req-7f0384dc-74c6-4ac4-a2eb-d4d4367eae44 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:18:42.159 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 10:18:42.159 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 10:18:42.159 1 ERROR oslo_service.service     service.start()
>2018-06-26 10:18:42.159 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 10:18:42.159 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 10:18:42.159 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 10:18:42.159 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 10:18:42.159 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 10:18:42.159 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 10:18:42.159 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 10:18:42.159 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 10:18:42.159 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 10:18:42.159 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 10:18:42.159 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 10:18:42.159 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 10:18:42.159 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 10:18:42.159 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 10:18:42.159 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 10:18:42.159 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 10:18:42.159 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 10:18:42.159 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 10:18:42.159 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 10:18:42.159 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 10:18:42.159 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 10:18:42.159 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 10:18:42.159 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:18:42.159 1 ERROR oslo_service.service 
>2018-06-26 10:18:42.162 1 CRITICAL cinder [req-ce1bfca9-8616-4dd5-b95f-92577dd097d2 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 10:18:42.162 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 10:18:42.162 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 10:18:42.162 1 ERROR cinder     sys.exit(main())
>2018-06-26 10:18:42.162 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 10:18:42.162 1 ERROR cinder     service.wait()
>2018-06-26 10:18:42.162 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 10:18:42.162 1 ERROR cinder     _launcher.wait()
>2018-06-26 10:18:42.162 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 10:18:42.162 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 10:18:42.162 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 10:18:42.162 1 ERROR cinder     self.services.wait()
>2018-06-26 10:18:42.162 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 10:18:42.162 1 ERROR cinder     service.wait()
>2018-06-26 10:18:42.162 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 10:18:42.162 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 10:18:42.162 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 10:18:42.162 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 10:18:42.162 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 10:18:42.162 1 ERROR cinder     post_fn = fn()
>2018-06-26 10:18:42.162 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 10:18:42.162 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 10:18:42.162 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 10:18:42.162 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 10:18:42.162 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 10:18:42.162 1 ERROR cinder 
>2018-06-26 10:18:44.931 1 WARNING cinder.scheduler.host_manager [req-c9cfcbba-4727-4f81-90c9-d7e018bc9d29 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 10:18:44.940 1 INFO cinder.rpc [req-c9cfcbba-4727-4f81-90c9-d7e018bc9d29 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 10:18:44.946 1 INFO cinder.rpc [req-c9cfcbba-4727-4f81-90c9-d7e018bc9d29 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 10:18:44.965 1 INFO cinder.rpc [req-c9cfcbba-4727-4f81-90c9-d7e018bc9d29 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 10:18:44.975 1 INFO cinder.rpc [req-c9cfcbba-4727-4f81-90c9-d7e018bc9d29 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 10:18:45.013 1 WARNING oslo_config.cfg [req-c9cfcbba-4727-4f81-90c9-d7e018bc9d29 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 10:18:45.016 1 WARNING oslo_config.cfg [req-c9cfcbba-4727-4f81-90c9-d7e018bc9d29 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:18:45.016 1 WARNING oslo_config.cfg [req-c9cfcbba-4727-4f81-90c9-d7e018bc9d29 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:18:45.017 1 WARNING oslo_config.cfg [req-c9cfcbba-4727-4f81-90c9-d7e018bc9d29 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:18:45.022 1 WARNING oslo_config.cfg [req-c9cfcbba-4727-4f81-90c9-d7e018bc9d29 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 10:18:45.024 1 WARNING oslo_config.cfg [req-c9cfcbba-4727-4f81-90c9-d7e018bc9d29 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 10:18:45.026 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 10:18:45.033 1 INFO cinder.manager [req-123ffba3-2fed-40b0-a105-4d967badd212 - - - - -] Initiating service 5 cleanup
>2018-06-26 10:18:45.038 1 INFO cinder.manager [req-123ffba3-2fed-40b0-a105-4d967badd212 - - - - -] Service 5 cleanup completed.
>2018-06-26 10:20:51.297 1 ERROR oslo.messaging._drivers.impl_rabbit [req-123ffba3-2fed-40b0-a105-4d967badd212 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:20:51.299 1 ERROR oslo.messaging._drivers.impl_rabbit [req-123ffba3-2fed-40b0-a105-4d967badd212 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:20:51.299 1 ERROR oslo_service.service [req-123ffba3-2fed-40b0-a105-4d967badd212 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:20:51.299 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 10:20:51.299 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 10:20:51.299 1 ERROR oslo_service.service     service.start()
>2018-06-26 10:20:51.299 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 10:20:51.299 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 10:20:51.299 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 10:20:51.299 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 10:20:51.299 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 10:20:51.299 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 10:20:51.299 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 10:20:51.299 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 10:20:51.299 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 10:20:51.299 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 10:20:51.299 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 10:20:51.299 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 10:20:51.299 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 10:20:51.299 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 10:20:51.299 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 10:20:51.299 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 10:20:51.299 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 10:20:51.299 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 10:20:51.299 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 10:20:51.299 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 10:20:51.299 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 10:20:51.299 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 10:20:51.299 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:20:51.299 1 ERROR oslo_service.service 
>2018-06-26 10:20:51.302 1 CRITICAL cinder [req-c9cfcbba-4727-4f81-90c9-d7e018bc9d29 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 10:20:51.302 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 10:20:51.302 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 10:20:51.302 1 ERROR cinder     sys.exit(main())
>2018-06-26 10:20:51.302 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 10:20:51.302 1 ERROR cinder     service.wait()
>2018-06-26 10:20:51.302 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 10:20:51.302 1 ERROR cinder     _launcher.wait()
>2018-06-26 10:20:51.302 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 10:20:51.302 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 10:20:51.302 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 10:20:51.302 1 ERROR cinder     self.services.wait()
>2018-06-26 10:20:51.302 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 10:20:51.302 1 ERROR cinder     service.wait()
>2018-06-26 10:20:51.302 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 10:20:51.302 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 10:20:51.302 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 10:20:51.302 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 10:20:51.302 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 10:20:51.302 1 ERROR cinder     post_fn = fn()
>2018-06-26 10:20:51.302 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 10:20:51.302 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 10:20:51.302 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 10:20:51.302 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 10:20:51.302 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 10:20:51.302 1 ERROR cinder 
>2018-06-26 10:20:54.093 1 WARNING cinder.scheduler.host_manager [req-563ad229-52d2-4fb3-bc11-357392a5ed72 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 10:20:54.101 1 INFO cinder.rpc [req-563ad229-52d2-4fb3-bc11-357392a5ed72 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 10:20:54.113 1 INFO cinder.rpc [req-563ad229-52d2-4fb3-bc11-357392a5ed72 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 10:20:54.130 1 INFO cinder.rpc [req-563ad229-52d2-4fb3-bc11-357392a5ed72 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 10:20:54.136 1 INFO cinder.rpc [req-563ad229-52d2-4fb3-bc11-357392a5ed72 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 10:20:54.161 1 WARNING oslo_config.cfg [req-563ad229-52d2-4fb3-bc11-357392a5ed72 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 10:20:54.164 1 WARNING oslo_config.cfg [req-563ad229-52d2-4fb3-bc11-357392a5ed72 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:20:54.164 1 WARNING oslo_config.cfg [req-563ad229-52d2-4fb3-bc11-357392a5ed72 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:20:54.165 1 WARNING oslo_config.cfg [req-563ad229-52d2-4fb3-bc11-357392a5ed72 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:20:54.172 1 WARNING oslo_config.cfg [req-563ad229-52d2-4fb3-bc11-357392a5ed72 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 10:20:54.173 1 WARNING oslo_config.cfg [req-563ad229-52d2-4fb3-bc11-357392a5ed72 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 10:20:54.176 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 10:20:54.182 1 INFO cinder.manager [req-63c6cb37-bbad-44a1-b52e-6c1d246c5247 - - - - -] Initiating service 5 cleanup
>2018-06-26 10:20:54.187 1 INFO cinder.manager [req-63c6cb37-bbad-44a1-b52e-6c1d246c5247 - - - - -] Service 5 cleanup completed.
>2018-06-26 10:23:05.899 1 ERROR oslo.messaging._drivers.impl_rabbit [req-63c6cb37-bbad-44a1-b52e-6c1d246c5247 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:23:05.901 1 ERROR oslo.messaging._drivers.impl_rabbit [req-63c6cb37-bbad-44a1-b52e-6c1d246c5247 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:23:05.901 1 ERROR oslo_service.service [req-63c6cb37-bbad-44a1-b52e-6c1d246c5247 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:23:05.901 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 10:23:05.901 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 10:23:05.901 1 ERROR oslo_service.service     service.start()
>2018-06-26 10:23:05.901 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 10:23:05.901 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 10:23:05.901 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 10:23:05.901 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 10:23:05.901 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 10:23:05.901 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 10:23:05.901 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 10:23:05.901 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 10:23:05.901 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 10:23:05.901 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 10:23:05.901 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 10:23:05.901 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 10:23:05.901 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 10:23:05.901 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 10:23:05.901 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 10:23:05.901 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 10:23:05.901 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 10:23:05.901 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 10:23:05.901 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 10:23:05.901 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 10:23:05.901 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 10:23:05.901 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 10:23:05.901 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:23:05.901 1 ERROR oslo_service.service 
>2018-06-26 10:23:05.904 1 CRITICAL cinder [req-563ad229-52d2-4fb3-bc11-357392a5ed72 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 10:23:05.904 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 10:23:05.904 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 10:23:05.904 1 ERROR cinder     sys.exit(main())
>2018-06-26 10:23:05.904 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 10:23:05.904 1 ERROR cinder     service.wait()
>2018-06-26 10:23:05.904 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 10:23:05.904 1 ERROR cinder     _launcher.wait()
>2018-06-26 10:23:05.904 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 10:23:05.904 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 10:23:05.904 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 10:23:05.904 1 ERROR cinder     self.services.wait()
>2018-06-26 10:23:05.904 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 10:23:05.904 1 ERROR cinder     service.wait()
>2018-06-26 10:23:05.904 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 10:23:05.904 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 10:23:05.904 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 10:23:05.904 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 10:23:05.904 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 10:23:05.904 1 ERROR cinder     post_fn = fn()
>2018-06-26 10:23:05.904 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 10:23:05.904 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 10:23:05.904 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 10:23:05.904 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 10:23:05.904 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 10:23:05.904 1 ERROR cinder 
>2018-06-26 10:23:08.713 1 WARNING cinder.scheduler.host_manager [req-96ec6463-6910-4aa1-a0d7-8de39ded5170 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 10:23:08.721 1 INFO cinder.rpc [req-96ec6463-6910-4aa1-a0d7-8de39ded5170 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 10:23:08.728 1 INFO cinder.rpc [req-96ec6463-6910-4aa1-a0d7-8de39ded5170 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 10:23:08.744 1 INFO cinder.rpc [req-96ec6463-6910-4aa1-a0d7-8de39ded5170 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 10:23:08.757 1 INFO cinder.rpc [req-96ec6463-6910-4aa1-a0d7-8de39ded5170 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 10:23:08.785 1 WARNING oslo_config.cfg [req-96ec6463-6910-4aa1-a0d7-8de39ded5170 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 10:23:08.787 1 WARNING oslo_config.cfg [req-96ec6463-6910-4aa1-a0d7-8de39ded5170 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:23:08.788 1 WARNING oslo_config.cfg [req-96ec6463-6910-4aa1-a0d7-8de39ded5170 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:23:08.788 1 WARNING oslo_config.cfg [req-96ec6463-6910-4aa1-a0d7-8de39ded5170 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:23:08.795 1 WARNING oslo_config.cfg [req-96ec6463-6910-4aa1-a0d7-8de39ded5170 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 10:23:08.796 1 WARNING oslo_config.cfg [req-96ec6463-6910-4aa1-a0d7-8de39ded5170 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 10:23:08.799 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 10:23:08.808 1 INFO cinder.manager [req-79b4beca-15c8-4cc7-8b23-277ebc0d3467 - - - - -] Initiating service 5 cleanup
>2018-06-26 10:23:08.820 1 INFO cinder.manager [req-79b4beca-15c8-4cc7-8b23-277ebc0d3467 - - - - -] Service 5 cleanup completed.
>2018-06-26 10:25:20.805 1 ERROR oslo.messaging._drivers.impl_rabbit [req-79b4beca-15c8-4cc7-8b23-277ebc0d3467 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:25:20.806 1 ERROR oslo.messaging._drivers.impl_rabbit [req-79b4beca-15c8-4cc7-8b23-277ebc0d3467 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:25:20.807 1 ERROR oslo_service.service [req-79b4beca-15c8-4cc7-8b23-277ebc0d3467 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:25:20.807 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 10:25:20.807 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 10:25:20.807 1 ERROR oslo_service.service     service.start()
>2018-06-26 10:25:20.807 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 10:25:20.807 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 10:25:20.807 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 10:25:20.807 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 10:25:20.807 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 10:25:20.807 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 10:25:20.807 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 10:25:20.807 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 10:25:20.807 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 10:25:20.807 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 10:25:20.807 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 10:25:20.807 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 10:25:20.807 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 10:25:20.807 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 10:25:20.807 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 10:25:20.807 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 10:25:20.807 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 10:25:20.807 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 10:25:20.807 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 10:25:20.807 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 10:25:20.807 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 10:25:20.807 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 10:25:20.807 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:25:20.807 1 ERROR oslo_service.service 
>2018-06-26 10:25:20.809 1 CRITICAL cinder [req-96ec6463-6910-4aa1-a0d7-8de39ded5170 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 10:25:20.809 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 10:25:20.809 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 10:25:20.809 1 ERROR cinder     sys.exit(main())
>2018-06-26 10:25:20.809 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 10:25:20.809 1 ERROR cinder     service.wait()
>2018-06-26 10:25:20.809 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 10:25:20.809 1 ERROR cinder     _launcher.wait()
>2018-06-26 10:25:20.809 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 10:25:20.809 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 10:25:20.809 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 10:25:20.809 1 ERROR cinder     self.services.wait()
>2018-06-26 10:25:20.809 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 10:25:20.809 1 ERROR cinder     service.wait()
>2018-06-26 10:25:20.809 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 10:25:20.809 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 10:25:20.809 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 10:25:20.809 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 10:25:20.809 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 10:25:20.809 1 ERROR cinder     post_fn = fn()
>2018-06-26 10:25:20.809 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 10:25:20.809 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 10:25:20.809 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 10:25:20.809 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 10:25:20.809 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 10:25:20.809 1 ERROR cinder 
>2018-06-26 10:25:23.441 1 WARNING cinder.scheduler.host_manager [req-6790e531-13e6-4321-9fee-b6a85f4cc80a - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 10:25:23.446 1 INFO cinder.rpc [req-6790e531-13e6-4321-9fee-b6a85f4cc80a - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 10:25:23.452 1 INFO cinder.rpc [req-6790e531-13e6-4321-9fee-b6a85f4cc80a - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 10:25:23.482 1 INFO cinder.rpc [req-6790e531-13e6-4321-9fee-b6a85f4cc80a - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 10:25:23.493 1 INFO cinder.rpc [req-6790e531-13e6-4321-9fee-b6a85f4cc80a - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 10:25:23.529 1 WARNING oslo_config.cfg [req-6790e531-13e6-4321-9fee-b6a85f4cc80a - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 10:25:23.532 1 WARNING oslo_config.cfg [req-6790e531-13e6-4321-9fee-b6a85f4cc80a - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:25:23.533 1 WARNING oslo_config.cfg [req-6790e531-13e6-4321-9fee-b6a85f4cc80a - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:25:23.533 1 WARNING oslo_config.cfg [req-6790e531-13e6-4321-9fee-b6a85f4cc80a - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:25:23.538 1 WARNING oslo_config.cfg [req-6790e531-13e6-4321-9fee-b6a85f4cc80a - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 10:25:23.540 1 WARNING oslo_config.cfg [req-6790e531-13e6-4321-9fee-b6a85f4cc80a - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 10:25:23.543 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 10:25:23.551 1 INFO cinder.manager [req-43cb3f7b-7c15-4241-a524-92c538ca4b64 - - - - -] Initiating service 5 cleanup
>2018-06-26 10:25:23.558 1 INFO cinder.manager [req-43cb3f7b-7c15-4241-a524-92c538ca4b64 - - - - -] Service 5 cleanup completed.
>2018-06-26 10:27:27.883 1 ERROR oslo.messaging._drivers.impl_rabbit [req-43cb3f7b-7c15-4241-a524-92c538ca4b64 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:27:27.885 1 ERROR oslo.messaging._drivers.impl_rabbit [req-43cb3f7b-7c15-4241-a524-92c538ca4b64 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:27:27.885 1 ERROR oslo_service.service [req-43cb3f7b-7c15-4241-a524-92c538ca4b64 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:27:27.885 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 10:27:27.885 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 10:27:27.885 1 ERROR oslo_service.service     service.start()
>2018-06-26 10:27:27.885 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 10:27:27.885 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 10:27:27.885 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 10:27:27.885 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 10:27:27.885 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 10:27:27.885 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 10:27:27.885 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 10:27:27.885 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 10:27:27.885 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 10:27:27.885 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 10:27:27.885 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 10:27:27.885 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 10:27:27.885 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 10:27:27.885 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 10:27:27.885 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 10:27:27.885 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 10:27:27.885 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 10:27:27.885 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 10:27:27.885 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 10:27:27.885 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 10:27:27.885 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 10:27:27.885 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 10:27:27.885 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:27:27.885 1 ERROR oslo_service.service 
>2018-06-26 10:27:27.888 1 CRITICAL cinder [req-6790e531-13e6-4321-9fee-b6a85f4cc80a - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 10:27:27.888 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 10:27:27.888 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 10:27:27.888 1 ERROR cinder     sys.exit(main())
>2018-06-26 10:27:27.888 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 10:27:27.888 1 ERROR cinder     service.wait()
>2018-06-26 10:27:27.888 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 10:27:27.888 1 ERROR cinder     _launcher.wait()
>2018-06-26 10:27:27.888 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 10:27:27.888 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 10:27:27.888 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 10:27:27.888 1 ERROR cinder     self.services.wait()
>2018-06-26 10:27:27.888 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 10:27:27.888 1 ERROR cinder     service.wait()
>2018-06-26 10:27:27.888 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 10:27:27.888 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 10:27:27.888 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 10:27:27.888 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 10:27:27.888 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 10:27:27.888 1 ERROR cinder     post_fn = fn()
>2018-06-26 10:27:27.888 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 10:27:27.888 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 10:27:27.888 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 10:27:27.888 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 10:27:27.888 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 10:27:27.888 1 ERROR cinder 
>2018-06-26 10:27:30.472 1 WARNING cinder.scheduler.host_manager [req-20ccda5a-59c1-4920-ab46-eb1200850aaf - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 10:27:30.478 1 INFO cinder.rpc [req-20ccda5a-59c1-4920-ab46-eb1200850aaf - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 10:27:30.484 1 INFO cinder.rpc [req-20ccda5a-59c1-4920-ab46-eb1200850aaf - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 10:27:30.495 1 INFO cinder.rpc [req-20ccda5a-59c1-4920-ab46-eb1200850aaf - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 10:27:30.502 1 INFO cinder.rpc [req-20ccda5a-59c1-4920-ab46-eb1200850aaf - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 10:27:30.524 1 WARNING oslo_config.cfg [req-20ccda5a-59c1-4920-ab46-eb1200850aaf - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 10:27:30.527 1 WARNING oslo_config.cfg [req-20ccda5a-59c1-4920-ab46-eb1200850aaf - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:27:30.527 1 WARNING oslo_config.cfg [req-20ccda5a-59c1-4920-ab46-eb1200850aaf - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:27:30.528 1 WARNING oslo_config.cfg [req-20ccda5a-59c1-4920-ab46-eb1200850aaf - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:27:30.533 1 WARNING oslo_config.cfg [req-20ccda5a-59c1-4920-ab46-eb1200850aaf - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 10:27:30.534 1 WARNING oslo_config.cfg [req-20ccda5a-59c1-4920-ab46-eb1200850aaf - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 10:27:30.537 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 10:27:30.544 1 INFO cinder.manager [req-83bc9766-e957-4e23-8dd9-4c0bbfe53755 - - - - -] Initiating service 5 cleanup
>2018-06-26 10:27:30.548 1 INFO cinder.manager [req-83bc9766-e957-4e23-8dd9-4c0bbfe53755 - - - - -] Service 5 cleanup completed.
>2018-06-26 10:29:35.037 1 ERROR oslo.messaging._drivers.impl_rabbit [req-83bc9766-e957-4e23-8dd9-4c0bbfe53755 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:29:35.045 1 ERROR oslo.messaging._drivers.impl_rabbit [req-83bc9766-e957-4e23-8dd9-4c0bbfe53755 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:29:35.046 1 ERROR oslo_service.service [req-83bc9766-e957-4e23-8dd9-4c0bbfe53755 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:29:35.046 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 10:29:35.046 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 10:29:35.046 1 ERROR oslo_service.service     service.start()
>2018-06-26 10:29:35.046 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 10:29:35.046 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 10:29:35.046 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 10:29:35.046 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 10:29:35.046 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 10:29:35.046 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 10:29:35.046 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 10:29:35.046 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 10:29:35.046 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 10:29:35.046 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 10:29:35.046 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 10:29:35.046 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 10:29:35.046 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 10:29:35.046 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 10:29:35.046 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 10:29:35.046 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 10:29:35.046 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 10:29:35.046 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 10:29:35.046 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 10:29:35.046 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 10:29:35.046 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 10:29:35.046 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 10:29:35.046 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:29:35.046 1 ERROR oslo_service.service 
>2018-06-26 10:29:35.049 1 CRITICAL cinder [req-20ccda5a-59c1-4920-ab46-eb1200850aaf - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 10:29:35.049 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 10:29:35.049 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 10:29:35.049 1 ERROR cinder     sys.exit(main())
>2018-06-26 10:29:35.049 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 10:29:35.049 1 ERROR cinder     service.wait()
>2018-06-26 10:29:35.049 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 10:29:35.049 1 ERROR cinder     _launcher.wait()
>2018-06-26 10:29:35.049 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 10:29:35.049 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 10:29:35.049 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 10:29:35.049 1 ERROR cinder     self.services.wait()
>2018-06-26 10:29:35.049 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 10:29:35.049 1 ERROR cinder     service.wait()
>2018-06-26 10:29:35.049 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 10:29:35.049 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 10:29:35.049 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 10:29:35.049 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 10:29:35.049 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 10:29:35.049 1 ERROR cinder     post_fn = fn()
>2018-06-26 10:29:35.049 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 10:29:35.049 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 10:29:35.049 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 10:29:35.049 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 10:29:35.049 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 10:29:35.049 1 ERROR cinder 
>2018-06-26 10:29:37.860 1 WARNING cinder.scheduler.host_manager [req-ed3ca697-6d5f-4d3d-b07e-55e536989d00 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 10:29:37.865 1 INFO cinder.rpc [req-ed3ca697-6d5f-4d3d-b07e-55e536989d00 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 10:29:37.872 1 INFO cinder.rpc [req-ed3ca697-6d5f-4d3d-b07e-55e536989d00 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 10:29:37.886 1 INFO cinder.rpc [req-ed3ca697-6d5f-4d3d-b07e-55e536989d00 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 10:29:37.892 1 INFO cinder.rpc [req-ed3ca697-6d5f-4d3d-b07e-55e536989d00 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 10:29:37.921 1 WARNING oslo_config.cfg [req-ed3ca697-6d5f-4d3d-b07e-55e536989d00 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 10:29:37.923 1 WARNING oslo_config.cfg [req-ed3ca697-6d5f-4d3d-b07e-55e536989d00 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:29:37.924 1 WARNING oslo_config.cfg [req-ed3ca697-6d5f-4d3d-b07e-55e536989d00 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:29:37.924 1 WARNING oslo_config.cfg [req-ed3ca697-6d5f-4d3d-b07e-55e536989d00 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:29:37.929 1 WARNING oslo_config.cfg [req-ed3ca697-6d5f-4d3d-b07e-55e536989d00 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 10:29:37.931 1 WARNING oslo_config.cfg [req-ed3ca697-6d5f-4d3d-b07e-55e536989d00 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 10:29:37.934 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 10:29:37.940 1 INFO cinder.manager [req-42d05c12-ba26-4bd0-a87d-bf3b8ef0d462 - - - - -] Initiating service 5 cleanup
>2018-06-26 10:29:37.945 1 INFO cinder.manager [req-42d05c12-ba26-4bd0-a87d-bf3b8ef0d462 - - - - -] Service 5 cleanup completed.
>2018-06-26 10:31:43.989 1 ERROR oslo.messaging._drivers.impl_rabbit [req-42d05c12-ba26-4bd0-a87d-bf3b8ef0d462 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:31:43.990 1 ERROR oslo.messaging._drivers.impl_rabbit [req-42d05c12-ba26-4bd0-a87d-bf3b8ef0d462 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:31:43.991 1 ERROR oslo_service.service [req-42d05c12-ba26-4bd0-a87d-bf3b8ef0d462 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:31:43.991 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 10:31:43.991 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 10:31:43.991 1 ERROR oslo_service.service     service.start()
>2018-06-26 10:31:43.991 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 10:31:43.991 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 10:31:43.991 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 10:31:43.991 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 10:31:43.991 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 10:31:43.991 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 10:31:43.991 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 10:31:43.991 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 10:31:43.991 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 10:31:43.991 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 10:31:43.991 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 10:31:43.991 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 10:31:43.991 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 10:31:43.991 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 10:31:43.991 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 10:31:43.991 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 10:31:43.991 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 10:31:43.991 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 10:31:43.991 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 10:31:43.991 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 10:31:43.991 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 10:31:43.991 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 10:31:43.991 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:31:43.991 1 ERROR oslo_service.service 
>2018-06-26 10:31:43.993 1 CRITICAL cinder [req-ed3ca697-6d5f-4d3d-b07e-55e536989d00 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 10:31:43.993 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 10:31:43.993 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 10:31:43.993 1 ERROR cinder     sys.exit(main())
>2018-06-26 10:31:43.993 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 10:31:43.993 1 ERROR cinder     service.wait()
>2018-06-26 10:31:43.993 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 10:31:43.993 1 ERROR cinder     _launcher.wait()
>2018-06-26 10:31:43.993 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 10:31:43.993 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 10:31:43.993 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 10:31:43.993 1 ERROR cinder     self.services.wait()
>2018-06-26 10:31:43.993 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 10:31:43.993 1 ERROR cinder     service.wait()
>2018-06-26 10:31:43.993 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 10:31:43.993 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 10:31:43.993 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 10:31:43.993 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 10:31:43.993 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 10:31:43.993 1 ERROR cinder     post_fn = fn()
>2018-06-26 10:31:43.993 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 10:31:43.993 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 10:31:43.993 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 10:31:43.993 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 10:31:43.993 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 10:31:43.993 1 ERROR cinder 
>2018-06-26 10:31:46.586 1 WARNING cinder.scheduler.host_manager [req-bf8787cd-629b-473b-9bb7-89d3fb59bc6e - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 10:31:46.591 1 INFO cinder.rpc [req-bf8787cd-629b-473b-9bb7-89d3fb59bc6e - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 10:31:46.597 1 INFO cinder.rpc [req-bf8787cd-629b-473b-9bb7-89d3fb59bc6e - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 10:31:46.607 1 INFO cinder.rpc [req-bf8787cd-629b-473b-9bb7-89d3fb59bc6e - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 10:31:46.613 1 INFO cinder.rpc [req-bf8787cd-629b-473b-9bb7-89d3fb59bc6e - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 10:31:46.639 1 WARNING oslo_config.cfg [req-bf8787cd-629b-473b-9bb7-89d3fb59bc6e - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 10:31:46.641 1 WARNING oslo_config.cfg [req-bf8787cd-629b-473b-9bb7-89d3fb59bc6e - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:31:46.642 1 WARNING oslo_config.cfg [req-bf8787cd-629b-473b-9bb7-89d3fb59bc6e - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:31:46.642 1 WARNING oslo_config.cfg [req-bf8787cd-629b-473b-9bb7-89d3fb59bc6e - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:31:46.647 1 WARNING oslo_config.cfg [req-bf8787cd-629b-473b-9bb7-89d3fb59bc6e - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 10:31:46.649 1 WARNING oslo_config.cfg [req-bf8787cd-629b-473b-9bb7-89d3fb59bc6e - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 10:31:46.651 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 10:31:46.658 1 INFO cinder.manager [req-fc146e6e-7f96-42a6-b4cc-daa405d7d0df - - - - -] Initiating service 5 cleanup
>2018-06-26 10:31:46.663 1 INFO cinder.manager [req-fc146e6e-7f96-42a6-b4cc-daa405d7d0df - - - - -] Service 5 cleanup completed.
>2018-06-26 10:33:58.939 1 ERROR oslo.messaging._drivers.impl_rabbit [req-fc146e6e-7f96-42a6-b4cc-daa405d7d0df - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:33:58.940 1 ERROR oslo.messaging._drivers.impl_rabbit [req-fc146e6e-7f96-42a6-b4cc-daa405d7d0df - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:33:58.941 1 ERROR oslo_service.service [req-fc146e6e-7f96-42a6-b4cc-daa405d7d0df - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:33:58.941 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 10:33:58.941 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 10:33:58.941 1 ERROR oslo_service.service     service.start()
>2018-06-26 10:33:58.941 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 10:33:58.941 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 10:33:58.941 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 10:33:58.941 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 10:33:58.941 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 10:33:58.941 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 10:33:58.941 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 10:33:58.941 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 10:33:58.941 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 10:33:58.941 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 10:33:58.941 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 10:33:58.941 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 10:33:58.941 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 10:33:58.941 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 10:33:58.941 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 10:33:58.941 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 10:33:58.941 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 10:33:58.941 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 10:33:58.941 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 10:33:58.941 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 10:33:58.941 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 10:33:58.941 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 10:33:58.941 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:33:58.941 1 ERROR oslo_service.service 
>2018-06-26 10:33:58.944 1 CRITICAL cinder [req-bf8787cd-629b-473b-9bb7-89d3fb59bc6e - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 10:33:58.944 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 10:33:58.944 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 10:33:58.944 1 ERROR cinder     sys.exit(main())
>2018-06-26 10:33:58.944 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 10:33:58.944 1 ERROR cinder     service.wait()
>2018-06-26 10:33:58.944 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 10:33:58.944 1 ERROR cinder     _launcher.wait()
>2018-06-26 10:33:58.944 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 10:33:58.944 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 10:33:58.944 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 10:33:58.944 1 ERROR cinder     self.services.wait()
>2018-06-26 10:33:58.944 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 10:33:58.944 1 ERROR cinder     service.wait()
>2018-06-26 10:33:58.944 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 10:33:58.944 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 10:33:58.944 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 10:33:58.944 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 10:33:58.944 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 10:33:58.944 1 ERROR cinder     post_fn = fn()
>2018-06-26 10:33:58.944 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 10:33:58.944 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 10:33:58.944 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 10:33:58.944 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 10:33:58.944 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 10:33:58.944 1 ERROR cinder 
>2018-06-26 10:34:01.974 1 WARNING cinder.scheduler.host_manager [req-042fc9e5-1a22-45cf-8182-119e5ef3a2ac - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 10:34:01.981 1 INFO cinder.rpc [req-042fc9e5-1a22-45cf-8182-119e5ef3a2ac - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 10:34:01.987 1 INFO cinder.rpc [req-042fc9e5-1a22-45cf-8182-119e5ef3a2ac - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 10:34:02.006 1 INFO cinder.rpc [req-042fc9e5-1a22-45cf-8182-119e5ef3a2ac - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 10:34:02.013 1 INFO cinder.rpc [req-042fc9e5-1a22-45cf-8182-119e5ef3a2ac - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 10:34:02.047 1 WARNING oslo_config.cfg [req-042fc9e5-1a22-45cf-8182-119e5ef3a2ac - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 10:34:02.049 1 WARNING oslo_config.cfg [req-042fc9e5-1a22-45cf-8182-119e5ef3a2ac - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:34:02.049 1 WARNING oslo_config.cfg [req-042fc9e5-1a22-45cf-8182-119e5ef3a2ac - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:34:02.050 1 WARNING oslo_config.cfg [req-042fc9e5-1a22-45cf-8182-119e5ef3a2ac - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:34:02.055 1 WARNING oslo_config.cfg [req-042fc9e5-1a22-45cf-8182-119e5ef3a2ac - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 10:34:02.056 1 WARNING oslo_config.cfg [req-042fc9e5-1a22-45cf-8182-119e5ef3a2ac - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 10:34:02.059 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 10:34:02.066 1 INFO cinder.manager [req-fe68d1b0-711a-4527-9d1a-8df9c1db7949 - - - - -] Initiating service 5 cleanup
>2018-06-26 10:34:02.070 1 INFO cinder.manager [req-fe68d1b0-711a-4527-9d1a-8df9c1db7949 - - - - -] Service 5 cleanup completed.
>2018-06-26 10:36:14.142 1 ERROR oslo.messaging._drivers.impl_rabbit [req-fe68d1b0-711a-4527-9d1a-8df9c1db7949 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:36:14.145 1 ERROR oslo.messaging._drivers.impl_rabbit [req-fe68d1b0-711a-4527-9d1a-8df9c1db7949 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:36:14.146 1 ERROR oslo_service.service [req-fe68d1b0-711a-4527-9d1a-8df9c1db7949 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:36:14.146 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 10:36:14.146 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 10:36:14.146 1 ERROR oslo_service.service     service.start()
>2018-06-26 10:36:14.146 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 10:36:14.146 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 10:36:14.146 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 10:36:14.146 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 10:36:14.146 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 10:36:14.146 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 10:36:14.146 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 10:36:14.146 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 10:36:14.146 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 10:36:14.146 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 10:36:14.146 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 10:36:14.146 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 10:36:14.146 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 10:36:14.146 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 10:36:14.146 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 10:36:14.146 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 10:36:14.146 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 10:36:14.146 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 10:36:14.146 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 10:36:14.146 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 10:36:14.146 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 10:36:14.146 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 10:36:14.146 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:36:14.146 1 ERROR oslo_service.service 
>2018-06-26 10:36:14.150 1 CRITICAL cinder [req-042fc9e5-1a22-45cf-8182-119e5ef3a2ac - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 10:36:14.150 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 10:36:14.150 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 10:36:14.150 1 ERROR cinder     sys.exit(main())
>2018-06-26 10:36:14.150 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 10:36:14.150 1 ERROR cinder     service.wait()
>2018-06-26 10:36:14.150 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 10:36:14.150 1 ERROR cinder     _launcher.wait()
>2018-06-26 10:36:14.150 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 10:36:14.150 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 10:36:14.150 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 10:36:14.150 1 ERROR cinder     self.services.wait()
>2018-06-26 10:36:14.150 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 10:36:14.150 1 ERROR cinder     service.wait()
>2018-06-26 10:36:14.150 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 10:36:14.150 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 10:36:14.150 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 10:36:14.150 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 10:36:14.150 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 10:36:14.150 1 ERROR cinder     post_fn = fn()
>2018-06-26 10:36:14.150 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 10:36:14.150 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 10:36:14.150 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 10:36:14.150 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 10:36:14.150 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 10:36:14.150 1 ERROR cinder 
>2018-06-26 10:36:16.748 1 WARNING cinder.scheduler.host_manager [req-d23a965b-a898-41a1-a7b1-68ce732c39e0 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 10:36:16.754 1 INFO cinder.rpc [req-d23a965b-a898-41a1-a7b1-68ce732c39e0 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 10:36:16.760 1 INFO cinder.rpc [req-d23a965b-a898-41a1-a7b1-68ce732c39e0 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 10:36:16.772 1 INFO cinder.rpc [req-d23a965b-a898-41a1-a7b1-68ce732c39e0 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 10:36:16.780 1 INFO cinder.rpc [req-d23a965b-a898-41a1-a7b1-68ce732c39e0 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 10:36:16.804 1 WARNING oslo_config.cfg [req-d23a965b-a898-41a1-a7b1-68ce732c39e0 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 10:36:16.806 1 WARNING oslo_config.cfg [req-d23a965b-a898-41a1-a7b1-68ce732c39e0 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:36:16.806 1 WARNING oslo_config.cfg [req-d23a965b-a898-41a1-a7b1-68ce732c39e0 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:36:16.807 1 WARNING oslo_config.cfg [req-d23a965b-a898-41a1-a7b1-68ce732c39e0 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:36:16.812 1 WARNING oslo_config.cfg [req-d23a965b-a898-41a1-a7b1-68ce732c39e0 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 10:36:16.814 1 WARNING oslo_config.cfg [req-d23a965b-a898-41a1-a7b1-68ce732c39e0 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 10:36:16.816 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 10:36:16.822 1 INFO cinder.manager [req-17f86b94-79b7-4ac2-b6a6-c003d1887fbe - - - - -] Initiating service 5 cleanup
>2018-06-26 10:36:16.826 1 INFO cinder.manager [req-17f86b94-79b7-4ac2-b6a6-c003d1887fbe - - - - -] Service 5 cleanup completed.
>2018-06-26 10:38:22.660 1 ERROR oslo.messaging._drivers.impl_rabbit [req-17f86b94-79b7-4ac2-b6a6-c003d1887fbe - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:38:22.662 1 ERROR oslo.messaging._drivers.impl_rabbit [req-17f86b94-79b7-4ac2-b6a6-c003d1887fbe - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:38:22.663 1 ERROR oslo_service.service [req-17f86b94-79b7-4ac2-b6a6-c003d1887fbe - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:38:22.663 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 10:38:22.663 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 10:38:22.663 1 ERROR oslo_service.service     service.start()
>2018-06-26 10:38:22.663 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 10:38:22.663 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 10:38:22.663 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 10:38:22.663 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 10:38:22.663 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 10:38:22.663 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 10:38:22.663 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 10:38:22.663 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 10:38:22.663 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 10:38:22.663 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 10:38:22.663 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 10:38:22.663 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 10:38:22.663 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 10:38:22.663 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 10:38:22.663 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 10:38:22.663 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 10:38:22.663 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 10:38:22.663 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 10:38:22.663 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 10:38:22.663 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 10:38:22.663 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 10:38:22.663 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 10:38:22.663 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:38:22.663 1 ERROR oslo_service.service 
>2018-06-26 10:38:22.666 1 CRITICAL cinder [req-d23a965b-a898-41a1-a7b1-68ce732c39e0 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 10:38:22.666 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 10:38:22.666 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 10:38:22.666 1 ERROR cinder     sys.exit(main())
>2018-06-26 10:38:22.666 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 10:38:22.666 1 ERROR cinder     service.wait()
>2018-06-26 10:38:22.666 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 10:38:22.666 1 ERROR cinder     _launcher.wait()
>2018-06-26 10:38:22.666 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 10:38:22.666 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 10:38:22.666 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 10:38:22.666 1 ERROR cinder     self.services.wait()
>2018-06-26 10:38:22.666 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 10:38:22.666 1 ERROR cinder     service.wait()
>2018-06-26 10:38:22.666 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 10:38:22.666 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 10:38:22.666 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 10:38:22.666 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 10:38:22.666 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 10:38:22.666 1 ERROR cinder     post_fn = fn()
>2018-06-26 10:38:22.666 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 10:38:22.666 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 10:38:22.666 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 10:38:22.666 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 10:38:22.666 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 10:38:22.666 1 ERROR cinder 
>2018-06-26 10:38:25.307 1 WARNING cinder.scheduler.host_manager [req-d7a520c2-f7d9-43e5-89e8-6d1f42eba444 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 10:38:25.313 1 INFO cinder.rpc [req-d7a520c2-f7d9-43e5-89e8-6d1f42eba444 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 10:38:25.319 1 INFO cinder.rpc [req-d7a520c2-f7d9-43e5-89e8-6d1f42eba444 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 10:38:25.330 1 INFO cinder.rpc [req-d7a520c2-f7d9-43e5-89e8-6d1f42eba444 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 10:38:25.336 1 INFO cinder.rpc [req-d7a520c2-f7d9-43e5-89e8-6d1f42eba444 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 10:38:25.363 1 WARNING oslo_config.cfg [req-d7a520c2-f7d9-43e5-89e8-6d1f42eba444 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 10:38:25.365 1 WARNING oslo_config.cfg [req-d7a520c2-f7d9-43e5-89e8-6d1f42eba444 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:38:25.365 1 WARNING oslo_config.cfg [req-d7a520c2-f7d9-43e5-89e8-6d1f42eba444 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:38:25.366 1 WARNING oslo_config.cfg [req-d7a520c2-f7d9-43e5-89e8-6d1f42eba444 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:38:25.371 1 WARNING oslo_config.cfg [req-d7a520c2-f7d9-43e5-89e8-6d1f42eba444 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 10:38:25.373 1 WARNING oslo_config.cfg [req-d7a520c2-f7d9-43e5-89e8-6d1f42eba444 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 10:38:25.375 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 10:38:25.382 1 INFO cinder.manager [req-bf67f496-766f-43c9-abbb-9fadaf9f8e08 - - - - -] Initiating service 5 cleanup
>2018-06-26 10:38:25.389 1 INFO cinder.manager [req-bf67f496-766f-43c9-abbb-9fadaf9f8e08 - - - - -] Service 5 cleanup completed.
>2018-06-26 10:40:29.787 1 ERROR oslo.messaging._drivers.impl_rabbit [req-bf67f496-766f-43c9-abbb-9fadaf9f8e08 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:40:29.789 1 ERROR oslo.messaging._drivers.impl_rabbit [req-bf67f496-766f-43c9-abbb-9fadaf9f8e08 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:40:29.790 1 ERROR oslo_service.service [req-bf67f496-766f-43c9-abbb-9fadaf9f8e08 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:40:29.790 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 10:40:29.790 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 10:40:29.790 1 ERROR oslo_service.service     service.start()
>2018-06-26 10:40:29.790 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 10:40:29.790 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 10:40:29.790 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 10:40:29.790 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 10:40:29.790 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 10:40:29.790 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 10:40:29.790 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 10:40:29.790 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 10:40:29.790 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 10:40:29.790 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 10:40:29.790 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 10:40:29.790 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 10:40:29.790 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 10:40:29.790 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 10:40:29.790 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 10:40:29.790 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 10:40:29.790 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 10:40:29.790 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 10:40:29.790 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 10:40:29.790 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 10:40:29.790 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 10:40:29.790 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 10:40:29.790 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:40:29.790 1 ERROR oslo_service.service 
>2018-06-26 10:40:29.793 1 CRITICAL cinder [req-d7a520c2-f7d9-43e5-89e8-6d1f42eba444 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 10:40:29.793 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 10:40:29.793 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 10:40:29.793 1 ERROR cinder     sys.exit(main())
>2018-06-26 10:40:29.793 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 10:40:29.793 1 ERROR cinder     service.wait()
>2018-06-26 10:40:29.793 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 10:40:29.793 1 ERROR cinder     _launcher.wait()
>2018-06-26 10:40:29.793 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 10:40:29.793 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 10:40:29.793 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 10:40:29.793 1 ERROR cinder     self.services.wait()
>2018-06-26 10:40:29.793 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 10:40:29.793 1 ERROR cinder     service.wait()
>2018-06-26 10:40:29.793 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 10:40:29.793 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 10:40:29.793 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 10:40:29.793 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 10:40:29.793 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 10:40:29.793 1 ERROR cinder     post_fn = fn()
>2018-06-26 10:40:29.793 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 10:40:29.793 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 10:40:29.793 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 10:40:29.793 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 10:40:29.793 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 10:40:29.793 1 ERROR cinder 
>2018-06-26 10:40:32.443 1 WARNING cinder.scheduler.host_manager [req-35312bb9-fae6-40b8-b748-0996b13be58b - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 10:40:32.449 1 INFO cinder.rpc [req-35312bb9-fae6-40b8-b748-0996b13be58b - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 10:40:32.453 1 INFO cinder.rpc [req-35312bb9-fae6-40b8-b748-0996b13be58b - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 10:40:32.464 1 INFO cinder.rpc [req-35312bb9-fae6-40b8-b748-0996b13be58b - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 10:40:32.470 1 INFO cinder.rpc [req-35312bb9-fae6-40b8-b748-0996b13be58b - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 10:40:32.501 1 WARNING oslo_config.cfg [req-35312bb9-fae6-40b8-b748-0996b13be58b - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 10:40:32.503 1 WARNING oslo_config.cfg [req-35312bb9-fae6-40b8-b748-0996b13be58b - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:40:32.504 1 WARNING oslo_config.cfg [req-35312bb9-fae6-40b8-b748-0996b13be58b - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:40:32.504 1 WARNING oslo_config.cfg [req-35312bb9-fae6-40b8-b748-0996b13be58b - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:40:32.509 1 WARNING oslo_config.cfg [req-35312bb9-fae6-40b8-b748-0996b13be58b - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 10:40:32.511 1 WARNING oslo_config.cfg [req-35312bb9-fae6-40b8-b748-0996b13be58b - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 10:40:32.513 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 10:40:32.519 1 INFO cinder.manager [req-f7238c66-794f-4c39-925c-52c3da23c28b - - - - -] Initiating service 5 cleanup
>2018-06-26 10:40:32.524 1 INFO cinder.manager [req-f7238c66-794f-4c39-925c-52c3da23c28b - - - - -] Service 5 cleanup completed.
>2018-06-26 10:42:38.756 1 ERROR oslo.messaging._drivers.impl_rabbit [req-f7238c66-794f-4c39-925c-52c3da23c28b - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:42:38.758 1 ERROR oslo.messaging._drivers.impl_rabbit [req-f7238c66-794f-4c39-925c-52c3da23c28b - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:42:38.758 1 ERROR oslo_service.service [req-f7238c66-794f-4c39-925c-52c3da23c28b - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:42:38.758 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 10:42:38.758 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 10:42:38.758 1 ERROR oslo_service.service     service.start()
>2018-06-26 10:42:38.758 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 10:42:38.758 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 10:42:38.758 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 10:42:38.758 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 10:42:38.758 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 10:42:38.758 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 10:42:38.758 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 10:42:38.758 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 10:42:38.758 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 10:42:38.758 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 10:42:38.758 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 10:42:38.758 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 10:42:38.758 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 10:42:38.758 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 10:42:38.758 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 10:42:38.758 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 10:42:38.758 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 10:42:38.758 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 10:42:38.758 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 10:42:38.758 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 10:42:38.758 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 10:42:38.758 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 10:42:38.758 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:42:38.758 1 ERROR oslo_service.service 
>2018-06-26 10:42:38.761 1 CRITICAL cinder [req-35312bb9-fae6-40b8-b748-0996b13be58b - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 10:42:38.761 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 10:42:38.761 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 10:42:38.761 1 ERROR cinder     sys.exit(main())
>2018-06-26 10:42:38.761 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 10:42:38.761 1 ERROR cinder     service.wait()
>2018-06-26 10:42:38.761 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 10:42:38.761 1 ERROR cinder     _launcher.wait()
>2018-06-26 10:42:38.761 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 10:42:38.761 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 10:42:38.761 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 10:42:38.761 1 ERROR cinder     self.services.wait()
>2018-06-26 10:42:38.761 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 10:42:38.761 1 ERROR cinder     service.wait()
>2018-06-26 10:42:38.761 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 10:42:38.761 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 10:42:38.761 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 10:42:38.761 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 10:42:38.761 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 10:42:38.761 1 ERROR cinder     post_fn = fn()
>2018-06-26 10:42:38.761 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 10:42:38.761 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 10:42:38.761 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 10:42:38.761 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 10:42:38.761 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 10:42:38.761 1 ERROR cinder 
>2018-06-26 10:42:41.365 1 WARNING cinder.scheduler.host_manager [req-163425c3-919b-4c00-8c28-93e2179e9122 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 10:42:41.371 1 INFO cinder.rpc [req-163425c3-919b-4c00-8c28-93e2179e9122 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 10:42:41.376 1 INFO cinder.rpc [req-163425c3-919b-4c00-8c28-93e2179e9122 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 10:42:41.388 1 INFO cinder.rpc [req-163425c3-919b-4c00-8c28-93e2179e9122 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 10:42:41.394 1 INFO cinder.rpc [req-163425c3-919b-4c00-8c28-93e2179e9122 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 10:42:41.421 1 WARNING oslo_config.cfg [req-163425c3-919b-4c00-8c28-93e2179e9122 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 10:42:41.424 1 WARNING oslo_config.cfg [req-163425c3-919b-4c00-8c28-93e2179e9122 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:42:41.424 1 WARNING oslo_config.cfg [req-163425c3-919b-4c00-8c28-93e2179e9122 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:42:41.425 1 WARNING oslo_config.cfg [req-163425c3-919b-4c00-8c28-93e2179e9122 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:42:41.430 1 WARNING oslo_config.cfg [req-163425c3-919b-4c00-8c28-93e2179e9122 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 10:42:41.431 1 WARNING oslo_config.cfg [req-163425c3-919b-4c00-8c28-93e2179e9122 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 10:42:41.433 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 10:42:41.440 1 INFO cinder.manager [req-edf908a0-3588-4f27-b075-75d6a6bcbbad - - - - -] Initiating service 5 cleanup
>2018-06-26 10:42:41.445 1 INFO cinder.manager [req-edf908a0-3588-4f27-b075-75d6a6bcbbad - - - - -] Service 5 cleanup completed.
>2018-06-26 10:44:46.067 1 ERROR oslo.messaging._drivers.impl_rabbit [req-edf908a0-3588-4f27-b075-75d6a6bcbbad - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:44:46.068 1 ERROR oslo.messaging._drivers.impl_rabbit [req-edf908a0-3588-4f27-b075-75d6a6bcbbad - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:44:46.069 1 ERROR oslo_service.service [req-edf908a0-3588-4f27-b075-75d6a6bcbbad - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:44:46.069 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 10:44:46.069 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 10:44:46.069 1 ERROR oslo_service.service     service.start()
>2018-06-26 10:44:46.069 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 10:44:46.069 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 10:44:46.069 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 10:44:46.069 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 10:44:46.069 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 10:44:46.069 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 10:44:46.069 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 10:44:46.069 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 10:44:46.069 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 10:44:46.069 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 10:44:46.069 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 10:44:46.069 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 10:44:46.069 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 10:44:46.069 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 10:44:46.069 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 10:44:46.069 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 10:44:46.069 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 10:44:46.069 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 10:44:46.069 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 10:44:46.069 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 10:44:46.069 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 10:44:46.069 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 10:44:46.069 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:44:46.069 1 ERROR oslo_service.service 
>2018-06-26 10:44:46.073 1 CRITICAL cinder [req-163425c3-919b-4c00-8c28-93e2179e9122 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 10:44:46.073 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 10:44:46.073 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 10:44:46.073 1 ERROR cinder     sys.exit(main())
>2018-06-26 10:44:46.073 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 10:44:46.073 1 ERROR cinder     service.wait()
>2018-06-26 10:44:46.073 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 10:44:46.073 1 ERROR cinder     _launcher.wait()
>2018-06-26 10:44:46.073 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 10:44:46.073 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 10:44:46.073 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 10:44:46.073 1 ERROR cinder     self.services.wait()
>2018-06-26 10:44:46.073 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 10:44:46.073 1 ERROR cinder     service.wait()
>2018-06-26 10:44:46.073 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 10:44:46.073 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 10:44:46.073 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 10:44:46.073 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 10:44:46.073 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 10:44:46.073 1 ERROR cinder     post_fn = fn()
>2018-06-26 10:44:46.073 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 10:44:46.073 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 10:44:46.073 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 10:44:46.073 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 10:44:46.073 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 10:44:46.073 1 ERROR cinder 
>2018-06-26 10:44:48.824 1 WARNING cinder.scheduler.host_manager [req-e40d5d2a-f87f-41d2-abcf-f95cc2750b24 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 10:44:48.833 1 INFO cinder.rpc [req-e40d5d2a-f87f-41d2-abcf-f95cc2750b24 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 10:44:48.841 1 INFO cinder.rpc [req-e40d5d2a-f87f-41d2-abcf-f95cc2750b24 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 10:44:48.857 1 INFO cinder.rpc [req-e40d5d2a-f87f-41d2-abcf-f95cc2750b24 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 10:44:48.868 1 INFO cinder.rpc [req-e40d5d2a-f87f-41d2-abcf-f95cc2750b24 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 10:44:48.904 1 WARNING oslo_config.cfg [req-e40d5d2a-f87f-41d2-abcf-f95cc2750b24 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 10:44:48.906 1 WARNING oslo_config.cfg [req-e40d5d2a-f87f-41d2-abcf-f95cc2750b24 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:44:48.906 1 WARNING oslo_config.cfg [req-e40d5d2a-f87f-41d2-abcf-f95cc2750b24 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:44:48.907 1 WARNING oslo_config.cfg [req-e40d5d2a-f87f-41d2-abcf-f95cc2750b24 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:44:48.912 1 WARNING oslo_config.cfg [req-e40d5d2a-f87f-41d2-abcf-f95cc2750b24 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 10:44:48.913 1 WARNING oslo_config.cfg [req-e40d5d2a-f87f-41d2-abcf-f95cc2750b24 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 10:44:48.916 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 10:44:48.922 1 INFO cinder.manager [req-17a1f420-652e-43b4-8d79-23766f3ed9cc - - - - -] Initiating service 5 cleanup
>2018-06-26 10:44:48.930 1 INFO cinder.manager [req-17a1f420-652e-43b4-8d79-23766f3ed9cc - - - - -] Service 5 cleanup completed.
>2018-06-26 10:46:53.631 1 ERROR oslo.messaging._drivers.impl_rabbit [req-17a1f420-652e-43b4-8d79-23766f3ed9cc - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:46:53.633 1 ERROR oslo.messaging._drivers.impl_rabbit [req-17a1f420-652e-43b4-8d79-23766f3ed9cc - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:46:53.633 1 ERROR oslo_service.service [req-17a1f420-652e-43b4-8d79-23766f3ed9cc - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:46:53.633 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 10:46:53.633 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 10:46:53.633 1 ERROR oslo_service.service     service.start()
>2018-06-26 10:46:53.633 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 10:46:53.633 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 10:46:53.633 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 10:46:53.633 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 10:46:53.633 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 10:46:53.633 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 10:46:53.633 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 10:46:53.633 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 10:46:53.633 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 10:46:53.633 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 10:46:53.633 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 10:46:53.633 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 10:46:53.633 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 10:46:53.633 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 10:46:53.633 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 10:46:53.633 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 10:46:53.633 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 10:46:53.633 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 10:46:53.633 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 10:46:53.633 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 10:46:53.633 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 10:46:53.633 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 10:46:53.633 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:46:53.633 1 ERROR oslo_service.service 
>2018-06-26 10:46:53.636 1 CRITICAL cinder [req-e40d5d2a-f87f-41d2-abcf-f95cc2750b24 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 10:46:53.636 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 10:46:53.636 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 10:46:53.636 1 ERROR cinder     sys.exit(main())
>2018-06-26 10:46:53.636 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 10:46:53.636 1 ERROR cinder     service.wait()
>2018-06-26 10:46:53.636 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 10:46:53.636 1 ERROR cinder     _launcher.wait()
>2018-06-26 10:46:53.636 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 10:46:53.636 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 10:46:53.636 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 10:46:53.636 1 ERROR cinder     self.services.wait()
>2018-06-26 10:46:53.636 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 10:46:53.636 1 ERROR cinder     service.wait()
>2018-06-26 10:46:53.636 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 10:46:53.636 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 10:46:53.636 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 10:46:53.636 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 10:46:53.636 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 10:46:53.636 1 ERROR cinder     post_fn = fn()
>2018-06-26 10:46:53.636 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 10:46:53.636 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 10:46:53.636 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 10:46:53.636 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 10:46:53.636 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 10:46:53.636 1 ERROR cinder 
>2018-06-26 10:46:56.172 1 WARNING cinder.scheduler.host_manager [req-7d5d08df-74a0-4bd7-a05b-99f777b24d68 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 10:46:56.178 1 INFO cinder.rpc [req-7d5d08df-74a0-4bd7-a05b-99f777b24d68 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 10:46:56.184 1 INFO cinder.rpc [req-7d5d08df-74a0-4bd7-a05b-99f777b24d68 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 10:46:56.196 1 INFO cinder.rpc [req-7d5d08df-74a0-4bd7-a05b-99f777b24d68 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 10:46:56.202 1 INFO cinder.rpc [req-7d5d08df-74a0-4bd7-a05b-99f777b24d68 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 10:46:56.225 1 WARNING oslo_config.cfg [req-7d5d08df-74a0-4bd7-a05b-99f777b24d68 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 10:46:56.227 1 WARNING oslo_config.cfg [req-7d5d08df-74a0-4bd7-a05b-99f777b24d68 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:46:56.227 1 WARNING oslo_config.cfg [req-7d5d08df-74a0-4bd7-a05b-99f777b24d68 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:46:56.228 1 WARNING oslo_config.cfg [req-7d5d08df-74a0-4bd7-a05b-99f777b24d68 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:46:56.233 1 WARNING oslo_config.cfg [req-7d5d08df-74a0-4bd7-a05b-99f777b24d68 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 10:46:56.234 1 WARNING oslo_config.cfg [req-7d5d08df-74a0-4bd7-a05b-99f777b24d68 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 10:46:56.237 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 10:46:56.243 1 INFO cinder.manager [req-6f784534-02dd-484c-be8f-2e60afa217eb - - - - -] Initiating service 5 cleanup
>2018-06-26 10:46:56.248 1 INFO cinder.manager [req-6f784534-02dd-484c-be8f-2e60afa217eb - - - - -] Service 5 cleanup completed.
>2018-06-26 10:49:00.617 1 ERROR oslo.messaging._drivers.impl_rabbit [req-6f784534-02dd-484c-be8f-2e60afa217eb - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:49:00.619 1 ERROR oslo.messaging._drivers.impl_rabbit [req-6f784534-02dd-484c-be8f-2e60afa217eb - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:49:00.620 1 ERROR oslo_service.service [req-6f784534-02dd-484c-be8f-2e60afa217eb - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:49:00.620 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 10:49:00.620 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 10:49:00.620 1 ERROR oslo_service.service     service.start()
>2018-06-26 10:49:00.620 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 10:49:00.620 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 10:49:00.620 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 10:49:00.620 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 10:49:00.620 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 10:49:00.620 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 10:49:00.620 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 10:49:00.620 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 10:49:00.620 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 10:49:00.620 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 10:49:00.620 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 10:49:00.620 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 10:49:00.620 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 10:49:00.620 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 10:49:00.620 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 10:49:00.620 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 10:49:00.620 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 10:49:00.620 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 10:49:00.620 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 10:49:00.620 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 10:49:00.620 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 10:49:00.620 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 10:49:00.620 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:49:00.620 1 ERROR oslo_service.service 
>2018-06-26 10:49:00.623 1 CRITICAL cinder [req-7d5d08df-74a0-4bd7-a05b-99f777b24d68 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 10:49:00.623 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 10:49:00.623 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 10:49:00.623 1 ERROR cinder     sys.exit(main())
>2018-06-26 10:49:00.623 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 10:49:00.623 1 ERROR cinder     service.wait()
>2018-06-26 10:49:00.623 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 10:49:00.623 1 ERROR cinder     _launcher.wait()
>2018-06-26 10:49:00.623 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 10:49:00.623 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 10:49:00.623 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 10:49:00.623 1 ERROR cinder     self.services.wait()
>2018-06-26 10:49:00.623 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 10:49:00.623 1 ERROR cinder     service.wait()
>2018-06-26 10:49:00.623 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 10:49:00.623 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 10:49:00.623 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 10:49:00.623 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 10:49:00.623 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 10:49:00.623 1 ERROR cinder     post_fn = fn()
>2018-06-26 10:49:00.623 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 10:49:00.623 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 10:49:00.623 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 10:49:00.623 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 10:49:00.623 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 10:49:00.623 1 ERROR cinder 
>2018-06-26 10:49:03.472 1 WARNING cinder.scheduler.host_manager [req-2f203d7a-da2d-4193-b624-e46f22037576 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 10:49:03.479 1 INFO cinder.rpc [req-2f203d7a-da2d-4193-b624-e46f22037576 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 10:49:03.484 1 INFO cinder.rpc [req-2f203d7a-da2d-4193-b624-e46f22037576 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 10:49:03.496 1 INFO cinder.rpc [req-2f203d7a-da2d-4193-b624-e46f22037576 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 10:49:03.502 1 INFO cinder.rpc [req-2f203d7a-da2d-4193-b624-e46f22037576 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 10:49:03.527 1 WARNING oslo_config.cfg [req-2f203d7a-da2d-4193-b624-e46f22037576 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 10:49:03.530 1 WARNING oslo_config.cfg [req-2f203d7a-da2d-4193-b624-e46f22037576 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:49:03.530 1 WARNING oslo_config.cfg [req-2f203d7a-da2d-4193-b624-e46f22037576 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:49:03.531 1 WARNING oslo_config.cfg [req-2f203d7a-da2d-4193-b624-e46f22037576 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:49:03.536 1 WARNING oslo_config.cfg [req-2f203d7a-da2d-4193-b624-e46f22037576 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 10:49:03.537 1 WARNING oslo_config.cfg [req-2f203d7a-da2d-4193-b624-e46f22037576 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 10:49:03.539 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 10:49:03.546 1 INFO cinder.manager [req-97dd2f4e-209b-400d-b372-469646c02efa - - - - -] Initiating service 5 cleanup
>2018-06-26 10:49:03.553 1 INFO cinder.manager [req-97dd2f4e-209b-400d-b372-469646c02efa - - - - -] Service 5 cleanup completed.
>2018-06-26 10:51:15.158 1 ERROR oslo.messaging._drivers.impl_rabbit [req-97dd2f4e-209b-400d-b372-469646c02efa - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:51:15.160 1 ERROR oslo.messaging._drivers.impl_rabbit [req-97dd2f4e-209b-400d-b372-469646c02efa - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:51:15.160 1 ERROR oslo_service.service [req-97dd2f4e-209b-400d-b372-469646c02efa - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:51:15.160 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 10:51:15.160 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 10:51:15.160 1 ERROR oslo_service.service     service.start()
>2018-06-26 10:51:15.160 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 10:51:15.160 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 10:51:15.160 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 10:51:15.160 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 10:51:15.160 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 10:51:15.160 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 10:51:15.160 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 10:51:15.160 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 10:51:15.160 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 10:51:15.160 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 10:51:15.160 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 10:51:15.160 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 10:51:15.160 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 10:51:15.160 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 10:51:15.160 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 10:51:15.160 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 10:51:15.160 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 10:51:15.160 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 10:51:15.160 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 10:51:15.160 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 10:51:15.160 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 10:51:15.160 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 10:51:15.160 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:51:15.160 1 ERROR oslo_service.service 
>2018-06-26 10:51:15.163 1 CRITICAL cinder [req-2f203d7a-da2d-4193-b624-e46f22037576 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 10:51:15.163 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 10:51:15.163 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 10:51:15.163 1 ERROR cinder     sys.exit(main())
>2018-06-26 10:51:15.163 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 10:51:15.163 1 ERROR cinder     service.wait()
>2018-06-26 10:51:15.163 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 10:51:15.163 1 ERROR cinder     _launcher.wait()
>2018-06-26 10:51:15.163 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 10:51:15.163 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 10:51:15.163 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 10:51:15.163 1 ERROR cinder     self.services.wait()
>2018-06-26 10:51:15.163 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 10:51:15.163 1 ERROR cinder     service.wait()
>2018-06-26 10:51:15.163 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 10:51:15.163 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 10:51:15.163 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 10:51:15.163 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 10:51:15.163 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 10:51:15.163 1 ERROR cinder     post_fn = fn()
>2018-06-26 10:51:15.163 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 10:51:15.163 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 10:51:15.163 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 10:51:15.163 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 10:51:15.163 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 10:51:15.163 1 ERROR cinder 
>2018-06-26 10:51:17.819 1 WARNING cinder.scheduler.host_manager [req-5f145b7b-31aa-469f-b256-7d898d4f4210 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 10:51:17.825 1 INFO cinder.rpc [req-5f145b7b-31aa-469f-b256-7d898d4f4210 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 10:51:17.830 1 INFO cinder.rpc [req-5f145b7b-31aa-469f-b256-7d898d4f4210 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 10:51:17.842 1 INFO cinder.rpc [req-5f145b7b-31aa-469f-b256-7d898d4f4210 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 10:51:17.852 1 INFO cinder.rpc [req-5f145b7b-31aa-469f-b256-7d898d4f4210 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 10:51:17.877 1 WARNING oslo_config.cfg [req-5f145b7b-31aa-469f-b256-7d898d4f4210 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 10:51:17.879 1 WARNING oslo_config.cfg [req-5f145b7b-31aa-469f-b256-7d898d4f4210 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:51:17.880 1 WARNING oslo_config.cfg [req-5f145b7b-31aa-469f-b256-7d898d4f4210 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:51:17.881 1 WARNING oslo_config.cfg [req-5f145b7b-31aa-469f-b256-7d898d4f4210 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:51:17.886 1 WARNING oslo_config.cfg [req-5f145b7b-31aa-469f-b256-7d898d4f4210 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 10:51:17.887 1 WARNING oslo_config.cfg [req-5f145b7b-31aa-469f-b256-7d898d4f4210 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 10:51:17.890 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 10:51:17.896 1 INFO cinder.manager [req-35faee73-797c-4726-93b5-ef7a78483464 - - - - -] Initiating service 5 cleanup
>2018-06-26 10:51:17.901 1 INFO cinder.manager [req-35faee73-797c-4726-93b5-ef7a78483464 - - - - -] Service 5 cleanup completed.
>2018-06-26 10:53:24.043 1 ERROR oslo.messaging._drivers.impl_rabbit [req-35faee73-797c-4726-93b5-ef7a78483464 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:53:24.044 1 ERROR oslo.messaging._drivers.impl_rabbit [req-35faee73-797c-4726-93b5-ef7a78483464 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:53:24.045 1 ERROR oslo_service.service [req-35faee73-797c-4726-93b5-ef7a78483464 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:53:24.045 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 10:53:24.045 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 10:53:24.045 1 ERROR oslo_service.service     service.start()
>2018-06-26 10:53:24.045 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 10:53:24.045 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 10:53:24.045 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 10:53:24.045 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 10:53:24.045 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 10:53:24.045 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 10:53:24.045 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 10:53:24.045 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 10:53:24.045 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 10:53:24.045 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 10:53:24.045 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 10:53:24.045 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 10:53:24.045 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 10:53:24.045 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 10:53:24.045 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 10:53:24.045 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 10:53:24.045 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 10:53:24.045 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 10:53:24.045 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 10:53:24.045 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 10:53:24.045 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 10:53:24.045 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 10:53:24.045 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:53:24.045 1 ERROR oslo_service.service 
>2018-06-26 10:53:24.048 1 CRITICAL cinder [req-5f145b7b-31aa-469f-b256-7d898d4f4210 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 10:53:24.048 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 10:53:24.048 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 10:53:24.048 1 ERROR cinder     sys.exit(main())
>2018-06-26 10:53:24.048 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 10:53:24.048 1 ERROR cinder     service.wait()
>2018-06-26 10:53:24.048 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 10:53:24.048 1 ERROR cinder     _launcher.wait()
>2018-06-26 10:53:24.048 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 10:53:24.048 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 10:53:24.048 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 10:53:24.048 1 ERROR cinder     self.services.wait()
>2018-06-26 10:53:24.048 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 10:53:24.048 1 ERROR cinder     service.wait()
>2018-06-26 10:53:24.048 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 10:53:24.048 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 10:53:24.048 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 10:53:24.048 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 10:53:24.048 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 10:53:24.048 1 ERROR cinder     post_fn = fn()
>2018-06-26 10:53:24.048 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 10:53:24.048 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 10:53:24.048 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 10:53:24.048 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 10:53:24.048 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 10:53:24.048 1 ERROR cinder 
>2018-06-26 10:53:26.674 1 WARNING cinder.scheduler.host_manager [req-27ebba22-872a-4002-8749-966ffb1ab32d - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 10:53:26.681 1 INFO cinder.rpc [req-27ebba22-872a-4002-8749-966ffb1ab32d - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 10:53:26.686 1 INFO cinder.rpc [req-27ebba22-872a-4002-8749-966ffb1ab32d - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 10:53:26.697 1 INFO cinder.rpc [req-27ebba22-872a-4002-8749-966ffb1ab32d - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 10:53:26.703 1 INFO cinder.rpc [req-27ebba22-872a-4002-8749-966ffb1ab32d - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 10:53:26.731 1 WARNING oslo_config.cfg [req-27ebba22-872a-4002-8749-966ffb1ab32d - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 10:53:26.733 1 WARNING oslo_config.cfg [req-27ebba22-872a-4002-8749-966ffb1ab32d - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:53:26.734 1 WARNING oslo_config.cfg [req-27ebba22-872a-4002-8749-966ffb1ab32d - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:53:26.734 1 WARNING oslo_config.cfg [req-27ebba22-872a-4002-8749-966ffb1ab32d - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:53:26.739 1 WARNING oslo_config.cfg [req-27ebba22-872a-4002-8749-966ffb1ab32d - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 10:53:26.740 1 WARNING oslo_config.cfg [req-27ebba22-872a-4002-8749-966ffb1ab32d - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 10:53:26.743 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 10:53:26.753 1 INFO cinder.manager [req-7b5875db-5ac0-4046-9cfe-5d913a7775ae - - - - -] Initiating service 5 cleanup
>2018-06-26 10:53:26.757 1 INFO cinder.manager [req-7b5875db-5ac0-4046-9cfe-5d913a7775ae - - - - -] Service 5 cleanup completed.
>2018-06-26 10:55:31.076 1 ERROR oslo.messaging._drivers.impl_rabbit [req-7b5875db-5ac0-4046-9cfe-5d913a7775ae - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:55:31.078 1 ERROR oslo.messaging._drivers.impl_rabbit [req-7b5875db-5ac0-4046-9cfe-5d913a7775ae - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:55:31.078 1 ERROR oslo_service.service [req-7b5875db-5ac0-4046-9cfe-5d913a7775ae - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:55:31.078 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 10:55:31.078 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 10:55:31.078 1 ERROR oslo_service.service     service.start()
>2018-06-26 10:55:31.078 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 10:55:31.078 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 10:55:31.078 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 10:55:31.078 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 10:55:31.078 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 10:55:31.078 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 10:55:31.078 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 10:55:31.078 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 10:55:31.078 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 10:55:31.078 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 10:55:31.078 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 10:55:31.078 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 10:55:31.078 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 10:55:31.078 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 10:55:31.078 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 10:55:31.078 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 10:55:31.078 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 10:55:31.078 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 10:55:31.078 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 10:55:31.078 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 10:55:31.078 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 10:55:31.078 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 10:55:31.078 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:55:31.078 1 ERROR oslo_service.service 
>2018-06-26 10:55:31.081 1 CRITICAL cinder [req-27ebba22-872a-4002-8749-966ffb1ab32d - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 10:55:31.081 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 10:55:31.081 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 10:55:31.081 1 ERROR cinder     sys.exit(main())
>2018-06-26 10:55:31.081 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 10:55:31.081 1 ERROR cinder     service.wait()
>2018-06-26 10:55:31.081 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 10:55:31.081 1 ERROR cinder     _launcher.wait()
>2018-06-26 10:55:31.081 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 10:55:31.081 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 10:55:31.081 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 10:55:31.081 1 ERROR cinder     self.services.wait()
>2018-06-26 10:55:31.081 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 10:55:31.081 1 ERROR cinder     service.wait()
>2018-06-26 10:55:31.081 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 10:55:31.081 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 10:55:31.081 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 10:55:31.081 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 10:55:31.081 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 10:55:31.081 1 ERROR cinder     post_fn = fn()
>2018-06-26 10:55:31.081 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 10:55:31.081 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 10:55:31.081 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 10:55:31.081 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 10:55:31.081 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 10:55:31.081 1 ERROR cinder 
>2018-06-26 10:55:33.771 1 WARNING cinder.scheduler.host_manager [req-9000c73a-d012-4b8d-949e-9ab1f56ff08b - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 10:55:33.776 1 INFO cinder.rpc [req-9000c73a-d012-4b8d-949e-9ab1f56ff08b - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 10:55:33.782 1 INFO cinder.rpc [req-9000c73a-d012-4b8d-949e-9ab1f56ff08b - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 10:55:33.792 1 INFO cinder.rpc [req-9000c73a-d012-4b8d-949e-9ab1f56ff08b - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 10:55:33.798 1 INFO cinder.rpc [req-9000c73a-d012-4b8d-949e-9ab1f56ff08b - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 10:55:33.820 1 WARNING oslo_config.cfg [req-9000c73a-d012-4b8d-949e-9ab1f56ff08b - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 10:55:33.822 1 WARNING oslo_config.cfg [req-9000c73a-d012-4b8d-949e-9ab1f56ff08b - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:55:33.822 1 WARNING oslo_config.cfg [req-9000c73a-d012-4b8d-949e-9ab1f56ff08b - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:55:33.823 1 WARNING oslo_config.cfg [req-9000c73a-d012-4b8d-949e-9ab1f56ff08b - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:55:33.828 1 WARNING oslo_config.cfg [req-9000c73a-d012-4b8d-949e-9ab1f56ff08b - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 10:55:33.829 1 WARNING oslo_config.cfg [req-9000c73a-d012-4b8d-949e-9ab1f56ff08b - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 10:55:33.832 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 10:55:33.837 1 INFO cinder.manager [req-7005f5e2-70dc-42ac-a04f-5dd71bbf85f2 - - - - -] Initiating service 5 cleanup
>2018-06-26 10:55:33.842 1 INFO cinder.manager [req-7005f5e2-70dc-42ac-a04f-5dd71bbf85f2 - - - - -] Service 5 cleanup completed.
>2018-06-26 10:57:40.276 1 ERROR oslo.messaging._drivers.impl_rabbit [req-7005f5e2-70dc-42ac-a04f-5dd71bbf85f2 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:57:40.282 1 ERROR oslo.messaging._drivers.impl_rabbit [req-7005f5e2-70dc-42ac-a04f-5dd71bbf85f2 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:57:40.283 1 ERROR oslo_service.service [req-7005f5e2-70dc-42ac-a04f-5dd71bbf85f2 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:57:40.283 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 10:57:40.283 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 10:57:40.283 1 ERROR oslo_service.service     service.start()
>2018-06-26 10:57:40.283 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 10:57:40.283 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 10:57:40.283 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 10:57:40.283 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 10:57:40.283 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 10:57:40.283 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 10:57:40.283 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 10:57:40.283 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 10:57:40.283 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 10:57:40.283 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 10:57:40.283 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 10:57:40.283 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 10:57:40.283 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 10:57:40.283 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 10:57:40.283 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 10:57:40.283 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 10:57:40.283 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 10:57:40.283 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 10:57:40.283 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 10:57:40.283 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 10:57:40.283 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 10:57:40.283 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 10:57:40.283 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:57:40.283 1 ERROR oslo_service.service 
>2018-06-26 10:57:40.285 1 CRITICAL cinder [req-9000c73a-d012-4b8d-949e-9ab1f56ff08b - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 10:57:40.285 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 10:57:40.285 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 10:57:40.285 1 ERROR cinder     sys.exit(main())
>2018-06-26 10:57:40.285 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 10:57:40.285 1 ERROR cinder     service.wait()
>2018-06-26 10:57:40.285 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 10:57:40.285 1 ERROR cinder     _launcher.wait()
>2018-06-26 10:57:40.285 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 10:57:40.285 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 10:57:40.285 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 10:57:40.285 1 ERROR cinder     self.services.wait()
>2018-06-26 10:57:40.285 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 10:57:40.285 1 ERROR cinder     service.wait()
>2018-06-26 10:57:40.285 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 10:57:40.285 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 10:57:40.285 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 10:57:40.285 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 10:57:40.285 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 10:57:40.285 1 ERROR cinder     post_fn = fn()
>2018-06-26 10:57:40.285 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 10:57:40.285 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 10:57:40.285 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 10:57:40.285 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 10:57:40.285 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 10:57:40.285 1 ERROR cinder 
>2018-06-26 10:57:42.894 1 WARNING cinder.scheduler.host_manager [req-46aac6b5-0dd0-4d30-acb5-bf679541b421 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 10:57:42.902 1 INFO cinder.rpc [req-46aac6b5-0dd0-4d30-acb5-bf679541b421 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 10:57:42.910 1 INFO cinder.rpc [req-46aac6b5-0dd0-4d30-acb5-bf679541b421 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 10:57:42.930 1 INFO cinder.rpc [req-46aac6b5-0dd0-4d30-acb5-bf679541b421 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 10:57:42.937 1 INFO cinder.rpc [req-46aac6b5-0dd0-4d30-acb5-bf679541b421 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 10:57:42.968 1 WARNING oslo_config.cfg [req-46aac6b5-0dd0-4d30-acb5-bf679541b421 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 10:57:42.971 1 WARNING oslo_config.cfg [req-46aac6b5-0dd0-4d30-acb5-bf679541b421 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:57:42.971 1 WARNING oslo_config.cfg [req-46aac6b5-0dd0-4d30-acb5-bf679541b421 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:57:42.972 1 WARNING oslo_config.cfg [req-46aac6b5-0dd0-4d30-acb5-bf679541b421 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:57:42.977 1 WARNING oslo_config.cfg [req-46aac6b5-0dd0-4d30-acb5-bf679541b421 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 10:57:42.979 1 WARNING oslo_config.cfg [req-46aac6b5-0dd0-4d30-acb5-bf679541b421 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 10:57:42.981 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 10:57:42.993 1 INFO cinder.manager [req-49a45b2a-2707-43fd-89a4-9c310ed9afcd - - - - -] Initiating service 5 cleanup
>2018-06-26 10:57:43.000 1 INFO cinder.manager [req-49a45b2a-2707-43fd-89a4-9c310ed9afcd - - - - -] Service 5 cleanup completed.
>2018-06-26 10:59:55.184 1 ERROR oslo.messaging._drivers.impl_rabbit [req-49a45b2a-2707-43fd-89a4-9c310ed9afcd - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:59:55.187 1 ERROR oslo.messaging._drivers.impl_rabbit [req-49a45b2a-2707-43fd-89a4-9c310ed9afcd - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:59:55.187 1 ERROR oslo_service.service [req-49a45b2a-2707-43fd-89a4-9c310ed9afcd - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:59:55.187 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 10:59:55.187 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 10:59:55.187 1 ERROR oslo_service.service     service.start()
>2018-06-26 10:59:55.187 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 10:59:55.187 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 10:59:55.187 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 10:59:55.187 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 10:59:55.187 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 10:59:55.187 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 10:59:55.187 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 10:59:55.187 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 10:59:55.187 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 10:59:55.187 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 10:59:55.187 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 10:59:55.187 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 10:59:55.187 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 10:59:55.187 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 10:59:55.187 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 10:59:55.187 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 10:59:55.187 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 10:59:55.187 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 10:59:55.187 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 10:59:55.187 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 10:59:55.187 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 10:59:55.187 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 10:59:55.187 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 10:59:55.187 1 ERROR oslo_service.service 
>2018-06-26 10:59:55.190 1 CRITICAL cinder [req-46aac6b5-0dd0-4d30-acb5-bf679541b421 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 10:59:55.190 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 10:59:55.190 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 10:59:55.190 1 ERROR cinder     sys.exit(main())
>2018-06-26 10:59:55.190 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 10:59:55.190 1 ERROR cinder     service.wait()
>2018-06-26 10:59:55.190 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 10:59:55.190 1 ERROR cinder     _launcher.wait()
>2018-06-26 10:59:55.190 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 10:59:55.190 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 10:59:55.190 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 10:59:55.190 1 ERROR cinder     self.services.wait()
>2018-06-26 10:59:55.190 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 10:59:55.190 1 ERROR cinder     service.wait()
>2018-06-26 10:59:55.190 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 10:59:55.190 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 10:59:55.190 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 10:59:55.190 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 10:59:55.190 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 10:59:55.190 1 ERROR cinder     post_fn = fn()
>2018-06-26 10:59:55.190 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 10:59:55.190 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 10:59:55.190 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 10:59:55.190 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 10:59:55.190 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 10:59:55.190 1 ERROR cinder 
>2018-06-26 10:59:57.918 1 WARNING cinder.scheduler.host_manager [req-37aff85e-699b-4ca5-9bfc-c791931da4e7 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 10:59:57.924 1 INFO cinder.rpc [req-37aff85e-699b-4ca5-9bfc-c791931da4e7 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 10:59:57.929 1 INFO cinder.rpc [req-37aff85e-699b-4ca5-9bfc-c791931da4e7 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 10:59:57.943 1 INFO cinder.rpc [req-37aff85e-699b-4ca5-9bfc-c791931da4e7 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 10:59:57.949 1 INFO cinder.rpc [req-37aff85e-699b-4ca5-9bfc-c791931da4e7 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 10:59:57.969 1 WARNING oslo_config.cfg [req-37aff85e-699b-4ca5-9bfc-c791931da4e7 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 10:59:57.971 1 WARNING oslo_config.cfg [req-37aff85e-699b-4ca5-9bfc-c791931da4e7 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:59:57.972 1 WARNING oslo_config.cfg [req-37aff85e-699b-4ca5-9bfc-c791931da4e7 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:59:57.972 1 WARNING oslo_config.cfg [req-37aff85e-699b-4ca5-9bfc-c791931da4e7 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 10:59:57.977 1 WARNING oslo_config.cfg [req-37aff85e-699b-4ca5-9bfc-c791931da4e7 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 10:59:57.979 1 WARNING oslo_config.cfg [req-37aff85e-699b-4ca5-9bfc-c791931da4e7 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 10:59:57.981 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 10:59:57.989 1 INFO cinder.manager [req-44153788-2e8a-4a90-8ff9-1828561ce41d - - - - -] Initiating service 5 cleanup
>2018-06-26 10:59:57.998 1 INFO cinder.manager [req-44153788-2e8a-4a90-8ff9-1828561ce41d - - - - -] Service 5 cleanup completed.
>2018-06-26 11:02:04.625 1 ERROR oslo.messaging._drivers.impl_rabbit [req-44153788-2e8a-4a90-8ff9-1828561ce41d - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 11:02:04.627 1 ERROR oslo.messaging._drivers.impl_rabbit [req-44153788-2e8a-4a90-8ff9-1828561ce41d - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 11:02:04.628 1 ERROR oslo_service.service [req-44153788-2e8a-4a90-8ff9-1828561ce41d - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 11:02:04.628 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 11:02:04.628 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 11:02:04.628 1 ERROR oslo_service.service     service.start()
>2018-06-26 11:02:04.628 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 11:02:04.628 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 11:02:04.628 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 11:02:04.628 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 11:02:04.628 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 11:02:04.628 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 11:02:04.628 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 11:02:04.628 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 11:02:04.628 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 11:02:04.628 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 11:02:04.628 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 11:02:04.628 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 11:02:04.628 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 11:02:04.628 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 11:02:04.628 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 11:02:04.628 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 11:02:04.628 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 11:02:04.628 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 11:02:04.628 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 11:02:04.628 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 11:02:04.628 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 11:02:04.628 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 11:02:04.628 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 11:02:04.628 1 ERROR oslo_service.service 
>2018-06-26 11:02:04.631 1 CRITICAL cinder [req-37aff85e-699b-4ca5-9bfc-c791931da4e7 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 11:02:04.631 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 11:02:04.631 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 11:02:04.631 1 ERROR cinder     sys.exit(main())
>2018-06-26 11:02:04.631 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 11:02:04.631 1 ERROR cinder     service.wait()
>2018-06-26 11:02:04.631 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 11:02:04.631 1 ERROR cinder     _launcher.wait()
>2018-06-26 11:02:04.631 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 11:02:04.631 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 11:02:04.631 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 11:02:04.631 1 ERROR cinder     self.services.wait()
>2018-06-26 11:02:04.631 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 11:02:04.631 1 ERROR cinder     service.wait()
>2018-06-26 11:02:04.631 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 11:02:04.631 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 11:02:04.631 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 11:02:04.631 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 11:02:04.631 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 11:02:04.631 1 ERROR cinder     post_fn = fn()
>2018-06-26 11:02:04.631 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 11:02:04.631 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 11:02:04.631 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 11:02:04.631 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 11:02:04.631 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 11:02:04.631 1 ERROR cinder 
>2018-06-26 11:02:07.199 1 WARNING cinder.scheduler.host_manager [req-78bb7dbd-60ea-4638-a059-bc04094117e5 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 11:02:07.204 1 INFO cinder.rpc [req-78bb7dbd-60ea-4638-a059-bc04094117e5 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 11:02:07.210 1 INFO cinder.rpc [req-78bb7dbd-60ea-4638-a059-bc04094117e5 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 11:02:07.223 1 INFO cinder.rpc [req-78bb7dbd-60ea-4638-a059-bc04094117e5 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 11:02:07.229 1 INFO cinder.rpc [req-78bb7dbd-60ea-4638-a059-bc04094117e5 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 11:02:07.257 1 WARNING oslo_config.cfg [req-78bb7dbd-60ea-4638-a059-bc04094117e5 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 11:02:07.259 1 WARNING oslo_config.cfg [req-78bb7dbd-60ea-4638-a059-bc04094117e5 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 11:02:07.260 1 WARNING oslo_config.cfg [req-78bb7dbd-60ea-4638-a059-bc04094117e5 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 11:02:07.260 1 WARNING oslo_config.cfg [req-78bb7dbd-60ea-4638-a059-bc04094117e5 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 11:02:07.265 1 WARNING oslo_config.cfg [req-78bb7dbd-60ea-4638-a059-bc04094117e5 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 11:02:07.267 1 WARNING oslo_config.cfg [req-78bb7dbd-60ea-4638-a059-bc04094117e5 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 11:02:07.269 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 11:02:07.274 1 INFO cinder.manager [req-2b7a2bcd-50a2-499c-894c-e885d55a83a2 - - - - -] Initiating service 5 cleanup
>2018-06-26 11:02:07.279 1 INFO cinder.manager [req-2b7a2bcd-50a2-499c-894c-e885d55a83a2 - - - - -] Service 5 cleanup completed.
>2018-06-26 11:04:11.571 1 ERROR oslo.messaging._drivers.impl_rabbit [req-2b7a2bcd-50a2-499c-894c-e885d55a83a2 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 11:04:11.572 1 ERROR oslo.messaging._drivers.impl_rabbit [req-2b7a2bcd-50a2-499c-894c-e885d55a83a2 - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 11:04:11.573 1 ERROR oslo_service.service [req-2b7a2bcd-50a2-499c-894c-e885d55a83a2 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 11:04:11.573 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 11:04:11.573 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 11:04:11.573 1 ERROR oslo_service.service     service.start()
>2018-06-26 11:04:11.573 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 11:04:11.573 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 11:04:11.573 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 11:04:11.573 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 11:04:11.573 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 11:04:11.573 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 11:04:11.573 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 11:04:11.573 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 11:04:11.573 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 11:04:11.573 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 11:04:11.573 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 11:04:11.573 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 11:04:11.573 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 11:04:11.573 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 11:04:11.573 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 11:04:11.573 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 11:04:11.573 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 11:04:11.573 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 11:04:11.573 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 11:04:11.573 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 11:04:11.573 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 11:04:11.573 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 11:04:11.573 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 11:04:11.573 1 ERROR oslo_service.service 
>2018-06-26 11:04:11.575 1 CRITICAL cinder [req-78bb7dbd-60ea-4638-a059-bc04094117e5 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 11:04:11.575 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 11:04:11.575 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 11:04:11.575 1 ERROR cinder     sys.exit(main())
>2018-06-26 11:04:11.575 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 11:04:11.575 1 ERROR cinder     service.wait()
>2018-06-26 11:04:11.575 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 11:04:11.575 1 ERROR cinder     _launcher.wait()
>2018-06-26 11:04:11.575 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 11:04:11.575 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 11:04:11.575 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 11:04:11.575 1 ERROR cinder     self.services.wait()
>2018-06-26 11:04:11.575 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 11:04:11.575 1 ERROR cinder     service.wait()
>2018-06-26 11:04:11.575 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 11:04:11.575 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 11:04:11.575 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 11:04:11.575 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 11:04:11.575 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 11:04:11.575 1 ERROR cinder     post_fn = fn()
>2018-06-26 11:04:11.575 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 11:04:11.575 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 11:04:11.575 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 11:04:11.575 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 11:04:11.575 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 11:04:11.575 1 ERROR cinder 
>2018-06-26 11:04:14.357 1 WARNING cinder.scheduler.host_manager [req-831337c4-ce4b-4877-97d2-01da4fb7dc9d - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 11:04:14.367 1 INFO cinder.rpc [req-831337c4-ce4b-4877-97d2-01da4fb7dc9d - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 11:04:14.373 1 INFO cinder.rpc [req-831337c4-ce4b-4877-97d2-01da4fb7dc9d - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 11:04:14.391 1 INFO cinder.rpc [req-831337c4-ce4b-4877-97d2-01da4fb7dc9d - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 11:04:14.398 1 INFO cinder.rpc [req-831337c4-ce4b-4877-97d2-01da4fb7dc9d - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 11:04:14.425 1 WARNING oslo_config.cfg [req-831337c4-ce4b-4877-97d2-01da4fb7dc9d - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 11:04:14.428 1 WARNING oslo_config.cfg [req-831337c4-ce4b-4877-97d2-01da4fb7dc9d - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 11:04:14.429 1 WARNING oslo_config.cfg [req-831337c4-ce4b-4877-97d2-01da4fb7dc9d - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 11:04:14.430 1 WARNING oslo_config.cfg [req-831337c4-ce4b-4877-97d2-01da4fb7dc9d - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 11:04:14.435 1 WARNING oslo_config.cfg [req-831337c4-ce4b-4877-97d2-01da4fb7dc9d - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 11:04:14.437 1 WARNING oslo_config.cfg [req-831337c4-ce4b-4877-97d2-01da4fb7dc9d - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 11:04:14.440 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 11:04:14.450 1 INFO cinder.manager [req-3b52dc4a-84f7-4f6b-bca6-fd5b47583a72 - - - - -] Initiating service 5 cleanup
>2018-06-26 11:04:14.455 1 INFO cinder.manager [req-3b52dc4a-84f7-4f6b-bca6-fd5b47583a72 - - - - -] Service 5 cleanup completed.
>2018-06-26 11:06:20.674 1 ERROR oslo.messaging._drivers.impl_rabbit [req-3b52dc4a-84f7-4f6b-bca6-fd5b47583a72 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 11:06:20.675 1 ERROR oslo.messaging._drivers.impl_rabbit [req-3b52dc4a-84f7-4f6b-bca6-fd5b47583a72 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 11:06:20.676 1 ERROR oslo_service.service [req-3b52dc4a-84f7-4f6b-bca6-fd5b47583a72 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 11:06:20.676 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 11:06:20.676 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 11:06:20.676 1 ERROR oslo_service.service     service.start()
>2018-06-26 11:06:20.676 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 11:06:20.676 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 11:06:20.676 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 11:06:20.676 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 11:06:20.676 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 11:06:20.676 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 11:06:20.676 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 11:06:20.676 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 11:06:20.676 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 11:06:20.676 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 11:06:20.676 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 11:06:20.676 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 11:06:20.676 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 11:06:20.676 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 11:06:20.676 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 11:06:20.676 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 11:06:20.676 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 11:06:20.676 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 11:06:20.676 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 11:06:20.676 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 11:06:20.676 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 11:06:20.676 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 11:06:20.676 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 11:06:20.676 1 ERROR oslo_service.service 
>2018-06-26 11:06:20.679 1 CRITICAL cinder [req-831337c4-ce4b-4877-97d2-01da4fb7dc9d - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 11:06:20.679 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 11:06:20.679 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 11:06:20.679 1 ERROR cinder     sys.exit(main())
>2018-06-26 11:06:20.679 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 11:06:20.679 1 ERROR cinder     service.wait()
>2018-06-26 11:06:20.679 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 11:06:20.679 1 ERROR cinder     _launcher.wait()
>2018-06-26 11:06:20.679 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 11:06:20.679 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 11:06:20.679 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 11:06:20.679 1 ERROR cinder     self.services.wait()
>2018-06-26 11:06:20.679 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 11:06:20.679 1 ERROR cinder     service.wait()
>2018-06-26 11:06:20.679 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 11:06:20.679 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 11:06:20.679 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 11:06:20.679 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 11:06:20.679 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 11:06:20.679 1 ERROR cinder     post_fn = fn()
>2018-06-26 11:06:20.679 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 11:06:20.679 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 11:06:20.679 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 11:06:20.679 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 11:06:20.679 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 11:06:20.679 1 ERROR cinder 
>2018-06-26 11:06:23.399 1 WARNING cinder.scheduler.host_manager [req-2da02023-6377-4f83-96e1-e56f5983299f - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 11:06:23.405 1 INFO cinder.rpc [req-2da02023-6377-4f83-96e1-e56f5983299f - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 11:06:23.413 1 INFO cinder.rpc [req-2da02023-6377-4f83-96e1-e56f5983299f - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 11:06:23.430 1 INFO cinder.rpc [req-2da02023-6377-4f83-96e1-e56f5983299f - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 11:06:23.437 1 INFO cinder.rpc [req-2da02023-6377-4f83-96e1-e56f5983299f - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 11:06:23.465 1 WARNING oslo_config.cfg [req-2da02023-6377-4f83-96e1-e56f5983299f - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 11:06:23.467 1 WARNING oslo_config.cfg [req-2da02023-6377-4f83-96e1-e56f5983299f - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 11:06:23.468 1 WARNING oslo_config.cfg [req-2da02023-6377-4f83-96e1-e56f5983299f - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 11:06:23.468 1 WARNING oslo_config.cfg [req-2da02023-6377-4f83-96e1-e56f5983299f - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 11:06:23.474 1 WARNING oslo_config.cfg [req-2da02023-6377-4f83-96e1-e56f5983299f - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 11:06:23.475 1 WARNING oslo_config.cfg [req-2da02023-6377-4f83-96e1-e56f5983299f - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 11:06:23.478 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 11:06:23.485 1 INFO cinder.manager [req-9765f2db-ffca-496b-93db-f2b900b0d08e - - - - -] Initiating service 5 cleanup
>2018-06-26 11:06:23.489 1 INFO cinder.manager [req-9765f2db-ffca-496b-93db-f2b900b0d08e - - - - -] Service 5 cleanup completed.
>2018-06-26 11:08:27.967 1 ERROR oslo.messaging._drivers.impl_rabbit [req-9765f2db-ffca-496b-93db-f2b900b0d08e - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 11:08:27.969 1 ERROR oslo.messaging._drivers.impl_rabbit [req-9765f2db-ffca-496b-93db-f2b900b0d08e - - - - -] Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 11:08:27.970 1 ERROR oslo_service.service [req-9765f2db-ffca-496b-93db-f2b900b0d08e - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 11:08:27.970 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 11:08:27.970 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 11:08:27.970 1 ERROR oslo_service.service     service.start()
>2018-06-26 11:08:27.970 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 11:08:27.970 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 11:08:27.970 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 11:08:27.970 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 11:08:27.970 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 11:08:27.970 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 11:08:27.970 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 11:08:27.970 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 11:08:27.970 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 11:08:27.970 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 11:08:27.970 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 11:08:27.970 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 11:08:27.970 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 11:08:27.970 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 11:08:27.970 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 11:08:27.970 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 11:08:27.970 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 11:08:27.970 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 11:08:27.970 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 11:08:27.970 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 11:08:27.970 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 11:08:27.970 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 11:08:27.970 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-1.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 11:08:27.970 1 ERROR oslo_service.service 
>2018-06-26 11:08:27.972 1 CRITICAL cinder [req-2da02023-6377-4f83-96e1-e56f5983299f - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 11:08:27.972 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 11:08:27.972 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 11:08:27.972 1 ERROR cinder     sys.exit(main())
>2018-06-26 11:08:27.972 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 11:08:27.972 1 ERROR cinder     service.wait()
>2018-06-26 11:08:27.972 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 11:08:27.972 1 ERROR cinder     _launcher.wait()
>2018-06-26 11:08:27.972 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 11:08:27.972 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 11:08:27.972 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 11:08:27.972 1 ERROR cinder     self.services.wait()
>2018-06-26 11:08:27.972 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 11:08:27.972 1 ERROR cinder     service.wait()
>2018-06-26 11:08:27.972 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 11:08:27.972 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 11:08:27.972 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 11:08:27.972 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 11:08:27.972 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 11:08:27.972 1 ERROR cinder     post_fn = fn()
>2018-06-26 11:08:27.972 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 11:08:27.972 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 11:08:27.972 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 11:08:27.972 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 11:08:27.972 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 11:08:27.972 1 ERROR cinder 
>2018-06-26 11:08:30.861 1 WARNING cinder.scheduler.host_manager [req-d8034f4c-06f2-45a5-81c3-1ec43de6de64 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 11:08:30.868 1 INFO cinder.rpc [req-d8034f4c-06f2-45a5-81c3-1ec43de6de64 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 11:08:30.874 1 INFO cinder.rpc [req-d8034f4c-06f2-45a5-81c3-1ec43de6de64 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 11:08:30.889 1 INFO cinder.rpc [req-d8034f4c-06f2-45a5-81c3-1ec43de6de64 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 11:08:30.896 1 INFO cinder.rpc [req-d8034f4c-06f2-45a5-81c3-1ec43de6de64 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 11:08:30.924 1 WARNING oslo_config.cfg [req-d8034f4c-06f2-45a5-81c3-1ec43de6de64 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 11:08:30.927 1 WARNING oslo_config.cfg [req-d8034f4c-06f2-45a5-81c3-1ec43de6de64 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 11:08:30.928 1 WARNING oslo_config.cfg [req-d8034f4c-06f2-45a5-81c3-1ec43de6de64 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 11:08:30.928 1 WARNING oslo_config.cfg [req-d8034f4c-06f2-45a5-81c3-1ec43de6de64 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 11:08:30.935 1 WARNING oslo_config.cfg [req-d8034f4c-06f2-45a5-81c3-1ec43de6de64 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 11:08:30.936 1 WARNING oslo_config.cfg [req-d8034f4c-06f2-45a5-81c3-1ec43de6de64 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 11:08:30.939 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 11:08:30.946 1 INFO cinder.manager [req-255b002c-ba52-4b9b-b633-f4c9da8f92c4 - - - - -] Initiating service 5 cleanup
>2018-06-26 11:08:30.953 1 INFO cinder.manager [req-255b002c-ba52-4b9b-b633-f4c9da8f92c4 - - - - -] Service 5 cleanup completed.
>2018-06-26 11:10:37.336 1 ERROR oslo.messaging._drivers.impl_rabbit [req-255b002c-ba52-4b9b-b633-f4c9da8f92c4 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 11:10:37.337 1 ERROR oslo.messaging._drivers.impl_rabbit [req-255b002c-ba52-4b9b-b633-f4c9da8f92c4 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 11:10:37.338 1 ERROR oslo_service.service [req-255b002c-ba52-4b9b-b633-f4c9da8f92c4 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 11:10:37.338 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 11:10:37.338 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 11:10:37.338 1 ERROR oslo_service.service     service.start()
>2018-06-26 11:10:37.338 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 11:10:37.338 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 11:10:37.338 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 11:10:37.338 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 11:10:37.338 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 11:10:37.338 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 11:10:37.338 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 11:10:37.338 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 11:10:37.338 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 11:10:37.338 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 11:10:37.338 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 11:10:37.338 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 11:10:37.338 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 11:10:37.338 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 11:10:37.338 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 11:10:37.338 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 11:10:37.338 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 11:10:37.338 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 11:10:37.338 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 11:10:37.338 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 11:10:37.338 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 11:10:37.338 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 11:10:37.338 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 11:10:37.338 1 ERROR oslo_service.service 
>2018-06-26 11:10:37.341 1 CRITICAL cinder [req-d8034f4c-06f2-45a5-81c3-1ec43de6de64 - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 11:10:37.341 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 11:10:37.341 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 11:10:37.341 1 ERROR cinder     sys.exit(main())
>2018-06-26 11:10:37.341 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 11:10:37.341 1 ERROR cinder     service.wait()
>2018-06-26 11:10:37.341 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 11:10:37.341 1 ERROR cinder     _launcher.wait()
>2018-06-26 11:10:37.341 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 11:10:37.341 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 11:10:37.341 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 11:10:37.341 1 ERROR cinder     self.services.wait()
>2018-06-26 11:10:37.341 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 11:10:37.341 1 ERROR cinder     service.wait()
>2018-06-26 11:10:37.341 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 11:10:37.341 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 11:10:37.341 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 11:10:37.341 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 11:10:37.341 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 11:10:37.341 1 ERROR cinder     post_fn = fn()
>2018-06-26 11:10:37.341 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 11:10:37.341 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 11:10:37.341 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 11:10:37.341 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 11:10:37.341 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 11:10:37.341 1 ERROR cinder 
>2018-06-26 11:10:39.996 1 WARNING cinder.scheduler.host_manager [req-bbc1b0cc-42a8-42cc-8206-9fbfec14ceda - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 11:10:40.002 1 INFO cinder.rpc [req-bbc1b0cc-42a8-42cc-8206-9fbfec14ceda - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 11:10:40.007 1 INFO cinder.rpc [req-bbc1b0cc-42a8-42cc-8206-9fbfec14ceda - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 11:10:40.017 1 INFO cinder.rpc [req-bbc1b0cc-42a8-42cc-8206-9fbfec14ceda - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 11:10:40.022 1 INFO cinder.rpc [req-bbc1b0cc-42a8-42cc-8206-9fbfec14ceda - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 11:10:40.045 1 WARNING oslo_config.cfg [req-bbc1b0cc-42a8-42cc-8206-9fbfec14ceda - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 11:10:40.047 1 WARNING oslo_config.cfg [req-bbc1b0cc-42a8-42cc-8206-9fbfec14ceda - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 11:10:40.048 1 WARNING oslo_config.cfg [req-bbc1b0cc-42a8-42cc-8206-9fbfec14ceda - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 11:10:40.048 1 WARNING oslo_config.cfg [req-bbc1b0cc-42a8-42cc-8206-9fbfec14ceda - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 11:10:40.054 1 WARNING oslo_config.cfg [req-bbc1b0cc-42a8-42cc-8206-9fbfec14ceda - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 11:10:40.055 1 WARNING oslo_config.cfg [req-bbc1b0cc-42a8-42cc-8206-9fbfec14ceda - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 11:10:40.058 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 11:10:40.066 1 INFO cinder.manager [req-f03116fe-5f86-473b-b1c4-1d718dd339f4 - - - - -] Initiating service 5 cleanup
>2018-06-26 11:10:40.076 1 INFO cinder.manager [req-f03116fe-5f86-473b-b1c4-1d718dd339f4 - - - - -] Service 5 cleanup completed.
>2018-06-26 11:12:46.299 1 ERROR oslo.messaging._drivers.impl_rabbit [req-f03116fe-5f86-473b-b1c4-1d718dd339f4 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 11:12:46.301 1 ERROR oslo.messaging._drivers.impl_rabbit [req-f03116fe-5f86-473b-b1c4-1d718dd339f4 - - - - -] Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 11:12:46.301 1 ERROR oslo_service.service [req-f03116fe-5f86-473b-b1c4-1d718dd339f4 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 11:12:46.301 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 11:12:46.301 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 11:12:46.301 1 ERROR oslo_service.service     service.start()
>2018-06-26 11:12:46.301 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 11:12:46.301 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 11:12:46.301 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 11:12:46.301 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 11:12:46.301 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 11:12:46.301 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 11:12:46.301 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 11:12:46.301 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 11:12:46.301 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 11:12:46.301 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 11:12:46.301 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 11:12:46.301 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 11:12:46.301 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 11:12:46.301 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 11:12:46.301 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 11:12:46.301 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 11:12:46.301 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 11:12:46.301 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 11:12:46.301 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 11:12:46.301 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 11:12:46.301 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 11:12:46.301 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 11:12:46.301 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-0.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 11:12:46.301 1 ERROR oslo_service.service 
>2018-06-26 11:12:46.304 1 CRITICAL cinder [req-bbc1b0cc-42a8-42cc-8206-9fbfec14ceda - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 11:12:46.304 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 11:12:46.304 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 11:12:46.304 1 ERROR cinder     sys.exit(main())
>2018-06-26 11:12:46.304 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 11:12:46.304 1 ERROR cinder     service.wait()
>2018-06-26 11:12:46.304 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 11:12:46.304 1 ERROR cinder     _launcher.wait()
>2018-06-26 11:12:46.304 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 11:12:46.304 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 11:12:46.304 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 11:12:46.304 1 ERROR cinder     self.services.wait()
>2018-06-26 11:12:46.304 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 11:12:46.304 1 ERROR cinder     service.wait()
>2018-06-26 11:12:46.304 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 11:12:46.304 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 11:12:46.304 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 11:12:46.304 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 11:12:46.304 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 11:12:46.304 1 ERROR cinder     post_fn = fn()
>2018-06-26 11:12:46.304 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 11:12:46.304 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 11:12:46.304 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 11:12:46.304 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 11:12:46.304 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 11:12:46.304 1 ERROR cinder 
>2018-06-26 11:12:49.034 1 WARNING cinder.scheduler.host_manager [req-10e08405-41ca-49cf-afba-3a15d9fa73dd - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 11:12:49.042 1 INFO cinder.rpc [req-10e08405-41ca-49cf-afba-3a15d9fa73dd - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 11:12:49.047 1 INFO cinder.rpc [req-10e08405-41ca-49cf-afba-3a15d9fa73dd - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 11:12:49.063 1 INFO cinder.rpc [req-10e08405-41ca-49cf-afba-3a15d9fa73dd - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 11:12:49.069 1 INFO cinder.rpc [req-10e08405-41ca-49cf-afba-3a15d9fa73dd - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 11:12:49.097 1 WARNING oslo_config.cfg [req-10e08405-41ca-49cf-afba-3a15d9fa73dd - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 11:12:49.100 1 WARNING oslo_config.cfg [req-10e08405-41ca-49cf-afba-3a15d9fa73dd - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 11:12:49.100 1 WARNING oslo_config.cfg [req-10e08405-41ca-49cf-afba-3a15d9fa73dd - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 11:12:49.101 1 WARNING oslo_config.cfg [req-10e08405-41ca-49cf-afba-3a15d9fa73dd - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 11:12:49.106 1 WARNING oslo_config.cfg [req-10e08405-41ca-49cf-afba-3a15d9fa73dd - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 11:12:49.107 1 WARNING oslo_config.cfg [req-10e08405-41ca-49cf-afba-3a15d9fa73dd - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 11:12:49.110 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 11:12:49.116 1 INFO cinder.manager [req-0c766988-6308-43d1-8cde-aa0f830fed72 - - - - -] Initiating service 5 cleanup
>2018-06-26 11:12:49.121 1 INFO cinder.manager [req-0c766988-6308-43d1-8cde-aa0f830fed72 - - - - -] Service 5 cleanup completed.
>2018-06-26 11:15:01.329 1 ERROR oslo.messaging._drivers.impl_rabbit [req-0c766988-6308-43d1-8cde-aa0f830fed72 - - - - -] Failed to declare consumer for topic 'cinder-scheduler': Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 11:15:01.333 1 ERROR oslo.messaging._drivers.impl_rabbit [req-0c766988-6308-43d1-8cde-aa0f830fed72 - - - - -] Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout: NotFound: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 11:15:01.333 1 ERROR oslo_service.service [req-0c766988-6308-43d1-8cde-aa0f830fed72 - - - - -] Error starting thread.: MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 11:15:01.333 1 ERROR oslo_service.service Traceback (most recent call last):
>2018-06-26 11:15:01.333 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 729, in run_service
>2018-06-26 11:15:01.333 1 ERROR oslo_service.service     service.start()
>2018-06-26 11:15:01.333 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 239, in start
>2018-06-26 11:15:01.333 1 ERROR oslo_service.service     self.rpcserver.start()
>2018-06-26 11:15:01.333 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 11:15:01.333 1 ERROR oslo_service.service     log_after, timeout_timer)
>2018-06-26 11:15:01.333 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 11:15:01.333 1 ERROR oslo_service.service     post_fn = fn()
>2018-06-26 11:15:01.333 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 11:15:01.333 1 ERROR oslo_service.service     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 11:15:01.333 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 416, in start
>2018-06-26 11:15:01.333 1 ERROR oslo_service.service     self.listener = self._create_listener()
>2018-06-26 11:15:01.333 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/server.py", line 151, in _create_listener
>2018-06-26 11:15:01.333 1 ERROR oslo_service.service     return self.transport._listen(self._target, 1, None)
>2018-06-26 11:15:01.333 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py", line 146, in _listen
>2018-06-26 11:15:01.333 1 ERROR oslo_service.service     batch_timeout)
>2018-06-26 11:15:01.333 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 572, in listen
>2018-06-26 11:15:01.333 1 ERROR oslo_service.service     callback=listener)
>2018-06-26 11:15:01.333 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1120, in declare_topic_consumer
>2018-06-26 11:15:01.333 1 ERROR oslo_service.service     self.declare_consumer(consumer)
>2018-06-26 11:15:01.333 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1023, in declare_consumer
>2018-06-26 11:15:01.333 1 ERROR oslo_service.service     error_callback=_connect_error)
>2018-06-26 11:15:01.333 1 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 825, in ensure
>2018-06-26 11:15:01.333 1 ERROR oslo_service.service     raise exceptions.MessageDeliveryFailure(msg)
>2018-06-26 11:15:01.333 1 ERROR oslo_service.service MessageDeliveryFailure: Unable to connect to AMQP server on controller-2.internalapi.localdomain:5672 after None tries: Queue.declare: (404) NOT_FOUND - failed to perform operation on queue 'cinder-scheduler' in vhost '/' due to timeout
>2018-06-26 11:15:01.333 1 ERROR oslo_service.service 
>2018-06-26 11:15:01.337 1 CRITICAL cinder [req-10e08405-41ca-49cf-afba-3a15d9fa73dd - - - - -] Unhandled error: AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 11:15:01.337 1 ERROR cinder Traceback (most recent call last):
>2018-06-26 11:15:01.337 1 ERROR cinder   File "/usr/bin/cinder-scheduler", line 10, in <module>
>2018-06-26 11:15:01.337 1 ERROR cinder     sys.exit(main())
>2018-06-26 11:15:01.337 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/cmd/scheduler.py", line 55, in main
>2018-06-26 11:15:01.337 1 ERROR cinder     service.wait()
>2018-06-26 11:15:01.337 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 629, in wait
>2018-06-26 11:15:01.337 1 ERROR cinder     _launcher.wait()
>2018-06-26 11:15:01.337 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 334, in wait
>2018-06-26 11:15:01.337 1 ERROR cinder     super(ServiceLauncher, self).wait()
>2018-06-26 11:15:01.337 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 237, in wait
>2018-06-26 11:15:01.337 1 ERROR cinder     self.services.wait()
>2018-06-26 11:15:01.337 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_service/service.py", line 708, in wait
>2018-06-26 11:15:01.337 1 ERROR cinder     service.wait()
>2018-06-26 11:15:01.337 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/cinder/service.py", line 442, in wait
>2018-06-26 11:15:01.337 1 ERROR cinder     self.rpcserver.wait()
>2018-06-26 11:15:01.337 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 270, in wrapper
>2018-06-26 11:15:01.337 1 ERROR cinder     log_after, timeout_timer)
>2018-06-26 11:15:01.337 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 190, in run_once
>2018-06-26 11:15:01.337 1 ERROR cinder     post_fn = fn()
>2018-06-26 11:15:01.337 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 269, in <lambda>
>2018-06-26 11:15:01.337 1 ERROR cinder     states[state].run_once(lambda: fn(self, *args, **kwargs),
>2018-06-26 11:15:01.337 1 ERROR cinder   File "/usr/lib/python2.7/site-packages/oslo_messaging/server.py", line 448, in wait
>2018-06-26 11:15:01.337 1 ERROR cinder     self.listener.cleanup()
>2018-06-26 11:15:01.337 1 ERROR cinder AttributeError: 'NoneType' object has no attribute 'cleanup'
>2018-06-26 11:15:01.337 1 ERROR cinder 
>2018-06-26 11:15:03.966 1 WARNING cinder.scheduler.host_manager [req-8447d8e7-71ba-49ff-939c-d25117e7a968 - - - - -] volume service is down. (host: hostgroup@tripleo_ceph)
>2018-06-26 11:15:03.973 1 INFO cinder.rpc [req-8447d8e7-71ba-49ff-939c-d25117e7a968 - - - - -] Automatically selected cinder-volume objects version 1.35 as minimum service version.
>2018-06-26 11:15:03.978 1 INFO cinder.rpc [req-8447d8e7-71ba-49ff-939c-d25117e7a968 - - - - -] Automatically selected cinder-volume RPC version 3.15 as minimum service version.
>2018-06-26 11:15:03.988 1 INFO cinder.rpc [req-8447d8e7-71ba-49ff-939c-d25117e7a968 - - - - -] Automatically selected cinder-scheduler objects version 1.35 as minimum service version.
>2018-06-26 11:15:03.995 1 INFO cinder.rpc [req-8447d8e7-71ba-49ff-939c-d25117e7a968 - - - - -] Automatically selected cinder-scheduler RPC version 3.10 as minimum service version.
>2018-06-26 11:15:04.016 1 WARNING oslo_config.cfg [req-8447d8e7-71ba-49ff-939c-d25117e7a968 - - - - -] Option "iscsi_helper" from group "DEFAULT" is deprecated. Use option "target_helper" from group "DEFAULT".
>2018-06-26 11:15:04.018 1 WARNING oslo_config.cfg [req-8447d8e7-71ba-49ff-939c-d25117e7a968 - - - - -] Option "rabbit_port" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 11:15:04.019 1 WARNING oslo_config.cfg [req-8447d8e7-71ba-49ff-939c-d25117e7a968 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 11:15:04.019 1 WARNING oslo_config.cfg [req-8447d8e7-71ba-49ff-939c-d25117e7a968 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal (Replaced by [DEFAULT]/transport_url).  Its value may be silently ignored in the future.
>2018-06-26 11:15:04.024 1 WARNING oslo_config.cfg [req-8447d8e7-71ba-49ff-939c-d25117e7a968 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated for removal (The auth_uri option is deprecated in favor of www_authenticate_uri and will be removed in the S  release.).  Its value may be silently ignored in the future.
>2018-06-26 11:15:04.025 1 WARNING oslo_config.cfg [req-8447d8e7-71ba-49ff-939c-d25117e7a968 - - - - -] Option "auth_uri" from group "keystone_authtoken" is deprecated. Use option "www_authenticate_uri" from group "keystone_authtoken".
>2018-06-26 11:15:04.028 1 INFO cinder.service [-] Starting cinder-scheduler node (version 12.0.1)
>2018-06-26 11:15:04.033 1 INFO cinder.manager [req-52f887e9-0b61-4fcf-8a49-517f56f60a3a - - - - -] Initiating service 5 cleanup
>2018-06-26 11:15:04.038 1 INFO cinder.manager [req-52f887e9-0b61-4fcf-8a49-517f56f60a3a - - - - -] Service 5 cleanup completed.

Actions: View

Attachments on bug 1595206: 1454623 | 1454630