Bug 1393880 - osp-director-10: Upgrade with IPv6 fails during convergence over : AllNodesDeploySteps.resources.ControllerDeployment_Step3.resources
Summary: osp-director-10: Upgrade with IPv6 fails during convergence over : AllNodesD...
Keywords:
Status: CLOSED DUPLICATE of bug 1393346
Alias: None
Product: Red Hat OpenStack
Classification: Red Hat
Component: rhosp-director
Version: 10.0 (Newton)
Hardware: x86_64
OS: Linux
urgent
urgent
Target Milestone: ---
: ---
Assignee: Angus Thomas
QA Contact: Omri Hochman
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2016-11-10 14:25 UTC by Omri Hochman
Modified: 2016-11-10 15:41 UTC (History)
4 users (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2016-11-10 15:41:28 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)

Description Omri Hochman 2016-11-10 14:25:58 UTC
osp-director-10: Upgrade with IPv6 fails during convergence over :  AllNodesDeploySteps.resources.ControllerDeployment_Step3.resources

Environment:
------------
instack-5.0.0-1.el7ost.noarch
instack-undercloud-5.0.0-4.el7ost.noarch
openstack-heat-api-cfn-7.0.0-5.el7ost.noarch
openstack-tripleo-heat-templates-5.0.0-1.4.el7ost.noarch
python-heatclient-1.5.0-1.el7ost.noarch
python-heat-agent-0-0.6.1e6015dgit.el7ost.noarch
openstack-tripleo-heat-templates-compat-2.0.0-34.3.el7ost.noarch
python-heat-tests-7.0.0-5.el7ost.noarch
heat-cfntools-1.3.0-2.el7ost.noarch
openstack-heat-common-7.0.0-5.el7ost.noarch
openstack-heat-engine-7.0.0-5.el7ost.noarch
openstack-heat-templates-0-0.6.1e6015dgit.el7ost.noarch
puppet-heat-9.4.1-1.el7ost.noarch
openstack-heat-api-7.0.0-5.el7ost.noarch


Steps: 
-------
(1) Deploy OSP9 with IPv6. 
(2) Attempt to upgrade from OSP9 to OSP10 .

Results : Upgrade fails during convergence_step 


[stack@undercloud-0 ~]$ heat resource-list overcloud -n 5 | grep -v COMPLETE 
WARNING (shell) "heat resource-list" is deprecated, please use "openstack stack resource list" instead
+-------------------------------------------+---------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------+-----------------+----------------------+----------------------------------------------------------------------------------------------------------------------+
| resource_name                             | physical_resource_id                                                            | resource_type                                                                                                       | resource_status | updated_time         | stack_name                                                                                                           |
+-------------------------------------------+---------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------+-----------------+----------------------+----------------------------------------------------------------------------------------------------------------------+
| AllNodesDeploySteps                       | 32a28e92-db83-486b-952c-21aa64404d8b                                            | OS::TripleO::PostDeploySteps                                                                                        | CREATE_FAILED   | 2016-11-10T00:04:50Z | overcloud                                                                                                            |
| ControllerDeployment_Step3                | cd635e3a-4f4c-4612-8168-575499319d86                                            | OS::Heat::StructuredDeploymentGroup                                                                                 | CREATE_FAILED   | 2016-11-10T00:04:52Z | overcloud-AllNodesDeploySteps-mobdt5fcb5ut                                                                           |
| 0                                         | c63248f0-2164-43c1-8ba1-ae63c95071a2                                            | OS::Heat::StructuredDeployment                                                                                      | CREATE_FAILED   | 2016-11-10T00:15:48Z | overcloud-AllNodesDeploySteps-mobdt5fcb5ut-ControllerDeployment_Step3-gyz3lxncp3pu                                   |
+-------------------------------------------+---------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------+-----------------+----------------------+----------------------------------------------------------------------------------------------------------------------+
[stack@undercloud-0 ~]$ heat deployment-show c63248f0-2164-43c1-8ba1-ae63c95071a2
WARNING (shell) "heat deployment-show" is deprecated, please use "openstack software deployment show" instead
{
  "status": "FAILED", 
  "server_id": "eebf9062-88a0-4ef1-948b-e91b580225ff", 
  "config_id": "ca2e3d77-af5f-4646-b8f0-d083f61a4d26", 
  "output_values": {
    "deploy_stdout": "Matching apachectl 'Server version: Apache/2.4.6 (Red Hat Enterprise Linux)\nServer built:   Aug  3 2016 08:33:27'\n\u001b[mNotice: Scope(Class[Tripleo::Firewall::Post]): At this stage, all network traffic is blocked.\u001b[0m\n\u001b[mNotice: Compiled catalog for controller-0.localdomain in environment production in 40.28 seconds\u001b[0m\n\u001b[mNotice: /Stage[main]/Neutron/Neutron_config[DEFAULT/notify_nova_on_port_status_changes]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Neutron/Neutron_config[keystone_authtoken/admin_user]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Neutron/Neutron_config[nova/auth_type]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Neutron/Neutron_config[DEFAULT/router_scheduler_driver]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Neutron/Neutron_config[nova/project_name]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Neutron/Neutron_config[DEFAULT/auth_type]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Neutron/Neutron_config[keystone_authtoken/admin_tenant_name]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Main/Package_manifest[/var/lib/tripleo/installed-packages/overcloud_controller_pacemaker3]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Neutron/Neutron_config[keystone_authtoken/identity_uri]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Nova/Nova_config[DEFAULT/scheduler_use_baremetal_filters]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Nova/Nova_config[conductor/use_local]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Nova/Nova_config[osapi_v3/enabled]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Nova/Nova_config[DEFAULT/notification_driver]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Nova/Nova_config[DEFAULT/max_io_ops_per_host]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Nova/Nova_config[keystone_authtoken/admin_password]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Nova/Nova_config[keystone_authtoken/admin_user]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Nova/Nova_config[DEFAULT/novncproxy_host]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Nova/Nova_config[vnc/novncproxy_base_url]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Nova/Nova_config[DEFAULT/scheduler_weight_classes]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Nova/Nova_config[neutron/auth_plugin]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Nova/Nova_config[DEFAULT/security_group_api]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Neutron/Neutron_config[DEFAULT/min_l3_agents_per_router]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Neutron/Neutron_config[DEFAULT/notification_driver]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Neutron/Neutron_config[DEFAULT/allow_automatic_l3agent_failover]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Sahara/Oslo::Messaging::Rabbit[sahara_config]/Sahara_config[oslo_messaging_rabbit/rabbit_hosts]/value: value changed 'fd00:fd00:fd00:2000::14,fd00:fd00:fd00:2000::13,fd00:fd00:fd00:2000::15' to 'fd00:fd00:fd00:2000::14:5672,fd00:fd00:fd00:2000::13:5672,fd00:fd00:fd00:2000::15:5672'\u001b[0m\n\u001b[mNotice: /Stage[main]/Sahara/Sahara_config[DEFAULT/port]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Neutron/Neutron_config[nova/username]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Neutron/Neutron_config[keystone_authtoken/admin_password]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Nova/Nova_config[DEFAULT/volume_api_class]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Neutron/Neutron_config[database/connection]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Nova/Nova_config[DEFAULT/scheduler_host_subset_size]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Nova/Nova_config[DEFAULT/novncproxy_port]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Neutron/Neutron_config[DEFAULT/rpc_workers]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Neutron/Neutron_config[keystone_authtoken/auth_uri]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Neutron/Neutron_config[DEFAULT/max_l3_agents_per_router]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Sahara/Oslo::Messaging::Rabbit[sahara_config]/Sahara_config[oslo_messaging_rabbit/rabbit_userid]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Neutron/Neutron_config[DEFAULT/api_workers]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Nova/Nova_config[DEFAULT/scheduler_driver]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Neutron/Neutron_config[nova/password]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Neutron/Neutron_config[nova/project_domain_id]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Aodh::Auth/Aodh_config[service_credentials/region_name]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Aodh::Auth/Aodh_config[service_credentials/project_domain_id]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Aodh/Oslo::Messaging::Rabbit[aodh_config]/Aodh_config[oslo_messaging_rabbit/heartbeat_timeout_threshold]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Aodh::Auth/Aodh_config[service_credentials/auth_url]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Aodh/Oslo::Messaging::Rabbit[aodh_config]/Aodh_config[oslo_messaging_rabbit/rabbit_hosts]/value: value changed 'fd00:fd00:fd00:2000::14,fd00:fd00:fd00:2000::13,fd00:fd00:fd00:2000::15' to 'fd00:fd00:fd00:2000::14:5672,fd00:fd00:fd00:2000::13:5672,fd00:fd00:fd00:2000::15:5672'\u001b[0m\n\u001b[mNotice: /Stage[main]/Aodh/Oslo::Messaging::Rabbit[aodh_config]/Aodh_config[oslo_messaging_rabbit/rabbit_virtual_host]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Aodh/Oslo::Messaging::Rabbit[aodh_config]/Aodh_config[oslo_messaging_rabbit/heartbeat_rate]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Aodh/Oslo::Messaging::Rabbit[aodh_config]/Aodh_config[oslo_messaging_rabbit/kombu_reconnect_delay]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Aodh::Auth/Aodh_config[service_credentials/project_name]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Aodh::Auth/Aodh_config[service_credentials/auth_type]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Aodh::Auth/Aodh_config[service_credentials/username]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Aodh::Auth/Aodh_config[service_credentials/user_domain_id]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Aodh::Auth/Aodh_config[service_credentials/password]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Nova/Nova_config[DEFAULT/api_paste_config]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Glance::Notify::Rabbitmq/Oslo::Messaging::Rabbit[glance_registry_config]/Glance_registry_config[DEFAULT/rpc_backend]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Glance::Notify::Rabbitmq/Oslo::Messaging::Rabbit[glance_api_config]/Glance_api_config[oslo_messaging_rabbit/heartbeat_timeout_threshold]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Glance::Notify::Rabbitmq/Oslo::Messaging::Rabbit[glance_api_config]/Glance_api_config[DEFAULT/rpc_backend]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Glance::Notify::Rabbitmq/Oslo::Messaging::Rabbit[glance_api_config]/Glance_api_config[oslo_messaging_rabbit/rabbit_port]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Glance::Registry/Glance_registry_config[DEFAULT/workers]/value: value changed '0' to '4'\u001b[0m\n\u001b[mNotice: /Stage[main]/Glance::Notify::Rabbitmq/Oslo::Messaging::Rabbit[glance_api_config]/Glance_api_config[oslo_messaging_rabbit/amqp_durable_queues]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Glance::Notify::Rabbitmq/Oslo::Messaging::Rabbit[glance_api_config]/Glance_api_config[oslo_messaging_rabbit/rabbit_ha_queues]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Glance::Backend::Rbd/Glance_api_config[glance_store/rbd_store_chunk_size]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Glance::Notify::Rabbitmq/Oslo::Messaging::Rabbit[glance_api_config]/Glance_api_config[oslo_messaging_rabbit/heartbeat_rate]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Glance::Notify::Rabbitmq/Oslo::Messaging::Rabbit[glance_registry_config]/Glance_registry_config[oslo_messaging_rabbit/rabbit_use_ssl]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Glance::Notify::Rabbitmq/Oslo::Messaging::Rabbit[glance_api_config]/Glance_api_config[oslo_messaging_rabbit/rabbit_virtual_host]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Glance::Backend::Rbd/Glance_api_config[glance_store/rbd_store_ceph_conf]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Glance::Notify::Rabbitmq/Oslo::Messaging::Notifications[glance_registry_config]/Glance_registry_config[oslo_messaging_notifications/driver]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Nova/Nova_config[DEFAULT/scheduler_max_attempts]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Ceilometer::Collector/Ceilometer_config[DEFAULT/meter_dispatchers]/value: value changed ['database'] to ['gnocchi']\u001b[0m\n\u001b[mNotice: /Stage[main]/Glance::Notify::Rabbitmq/Oslo::Messaging::Notifications[glance_api_config]/Glance_api_config[oslo_messaging_notifications/driver]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Nova/Nova_config[DEFAULT/max_instances_per_host]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Glance::Notify::Rabbitmq/Oslo::Messaging::Rabbit[glance_api_config]/Glance_api_config[oslo_messaging_rabbit/rabbit_hosts]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Nova/Nova_config[DEFAULT/scheduler_available_filters]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Glance::Notify::Rabbitmq/Oslo::Messaging::Rabbit[glance_registry_config]/Glance_registry_config[oslo_messaging_rabbit/rabbit_userid]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Neutron/Neutron_config[DEFAULT/notify_nova_on_port_data_changes]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Neutron/Neutron_config[nova/tenant_name]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Nova/Nova_config[keystone_authtoken/admin_tenant_name]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Glance::Notify::Rabbitmq/Oslo::Messaging::Rabbit[glance_registry_config]/Glance_registry_config[oslo_messaging_rabbit/rabbit_password]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Glance::Registry::Logging/Oslo::Log[glance_registry_config]/Glance_registry_config[DEFAULT/use_syslog]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Glance::Registry::Logging/Oslo::Log[glance_registry_config]/Glance_registry_config[DEFAULT/syslog_log_facility]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Glance::Registry::Logging/Oslo::Log[glance_registry_config]/Glance_registry_config[DEFAULT/use_stderr]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Nova/Nova_config[DEFAULT/scheduler_host_manager]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Nova/Nova_config[DEFAULT/notification_topics]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Ceilometer::Db/Oslo::Db[ceilometer_config]/Ceilometer_config[database/db_max_retries]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Neutron/Neutron_config[nova/user_domain_id]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Swift/Package[swift]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Neutron/Oslo::Messaging::Rabbit[neutron_config]/Neutron_config[oslo_messaging_rabbit/rabbit_hosts]/value: value changed ['fd00:fd00:fd00:2000::14,fd00:fd00:fd00:2000::13,fd00:fd00:fd00:2000::15'] to ['fd00:fd00:fd00:2000::14:5672,fd00:fd00:fd00:2000::13:5672,fd00:fd00:fd00:2000::15:5672']\u001b[0m\n\u001b[mNotice: /Stage[main]/Neutron/Oslo::Messaging::Rabbit[neutron_config]/Neutron_config[oslo_messaging_rabbit/heartbeat_rate]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Neutron/Neutron_config[DEFAULT/service_plugins]/value: value changed ['router,qos'] to ['router,qos,trunk']\u001b[0m\n\u001b[mNotice: /Stage[main]/Neutron/Neutron_config[DEFAULT/host]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Neutron/Neutron_config[DEFAULT/global_physnet_mtu]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Glance::Notify::Rabbitmq/Oslo::Messaging::Rabbit[glance_registry_config]/Glance_registry_config[oslo_messaging_rabbit/rabbit_port]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Nova/Nova_config[keystone_authtoken/identity_uri]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Nova/Nova_config[DEFAULT/secure_proxy_ssl_header]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Neutron/Neutron_config[nova/auth_url]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Neutron/Neutron_config[DEFAULT/nova_url]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Glance::Backend::Rbd/Glance_api_config[glance_store/rados_connect_timeout]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Ceilometer/Oslo::Messaging::Notifications[ceilometer_config]/Ceilometer_config[oslo_messaging_notifications/topics]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Glance::Registry::Authtoken/Keystone::Resource::Authtoken[glance_registry_config]/Glance_registry_config[keystone_authtoken/username]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Glance::Registry::Authtoken/Keystone::Resource::Authtoken[glance_registry_config]/Glance_registry_config[keystone_authtoken/auth_type]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Glance::Registry::Authtoken/Keystone::Resource::Authtoken[glance_registry_config]/Glance_registry_config[keystone_authtoken/project_name]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Glance::Registry::Authtoken/Keystone::Resource::Authtoken[glance_registry_config]/Glance_registry_config[keystone_authtoken/password]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Glance::Registry::Authtoken/Keystone::Resource::Authtoken[glance_registry_config]/Glance_registry_config[keystone_authtoken/auth_url]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Ceilometer/Ceilometer_config[publisher/telemetry_secret]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Ceilometer/Oslo::Messaging::Rabbit[ceilometer_config]/Ceilometer_config[oslo_messaging_rabbit/rabbit_hosts]/value: value changed ['127.0.0.1:5672'] to ['fd00:fd00:fd00:2000::14:5672,fd00:fd00:fd00:2000::13:5672,fd00:fd00:fd00:2000::15:5672']\u001b[0m\n\u001b[mNotice: /Stage[main]/Ceilometer/Oslo::Messaging::Rabbit[ceilometer_config]/Ceilometer_config[oslo_messaging_rabbit/rabbit_ha_queues]/value: value changed ['False'] to ['True']\u001b[0m\n\u001b[mNotice: /Stage[main]/Ceilometer/Oslo::Messaging::Rabbit[ceilometer_config]/Ceilometer_config[oslo_messaging_rabbit/rabbit_host]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Ceilometer/Oslo::Messaging::Rabbit[ceilometer_config]/Ceilometer_config[oslo_messaging_rabbit/rabbit_virtual_host]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Ceilometer/Oslo::Messaging::Rabbit[ceilometer_config]/Ceilometer_config[oslo_messaging_rabbit/rabbit_port]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Ceilometer/Oslo::Messaging::Rabbit[ceilometer_config]/Ceilometer_config[oslo_messaging_rabbit/heartbeat_rate]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Cinder/Oslo::Messaging::Rabbit[cinder_config]/Cinder_config[oslo_messaging_rabbit/amqp_durable_queues]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Cinder/Oslo::Messaging::Rabbit[cinder_config]/Cinder_config[oslo_messaging_rabbit/heartbeat_rate]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Cinder::Keystone::Authtoken/Keystone::Resource::Authtoken[cinder_config]/Cinder_config[keystone_authtoken/auth_type]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Cinder::Api/Oslo::Middleware[cinder_config]/Cinder_config[oslo_middleware/enable_proxy_headers_parsing]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Cinder::Keystone::Authtoken/Keystone::Resource::Authtoken[cinder_config]/Cinder_config[keystone_authtoken/username]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Cinder::Api/Cinder_config[DEFAULT/nova_catalog_info]/value: value changed 'compute:Compute Service:publicURL' to 'compute:Compute Service:internalURL'\u001b[0m\n\u001b[mNotice: /Stage[main]/Cinder/Oslo::Messaging::Rabbit[cinder_config]/Cinder_config[oslo_messaging_rabbit/rabbit_hosts]/value: value changed 'fd00:fd00:fd00:2000::14,fd00:fd00:fd00:2000::13,fd00:fd00:fd00:2000::15' to 'fd00:fd00:fd00:2000::14:5672,fd00:fd00:fd00:2000::13:5672,fd00:fd00:fd00:2000::15:5672'\u001b[0m\n\u001b[mNotice: /Stage[main]/Cinder/Oslo::Messaging::Rabbit[cinder_config]/Cinder_config[oslo_messaging_rabbit/rabbit_virtual_host]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Cinder::Ceilometer/Oslo::Messaging::Notifications[cinder_config]/Cinder_config[oslo_messaging_notifications/driver]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Apache/File[/etc/httpd/conf.d/openstack-dashboard.conf]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Apache/File[/etc/httpd/conf.d/10-horizon_vhost.conf]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Apache/File[/etc/httpd/conf.d/10-gnocchi_wsgi.conf]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Apache/File[/etc/httpd/conf.d/10-aodh_wsgi.conf]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Cinder::Keystone::Authtoken/Keystone::Resource::Authtoken[cinder_config]/Cinder_config[keystone_authtoken/auth_url]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Heat/Heat_config[trustee/project_domain_id]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Heat::Engine/Heat_config[DEFAULT/heat_metadata_server_url]/value: value changed 'http://[fd00:fd00:fd00:2000::11]:8000' to 'http://127.0.0.1:8000'\u001b[0m\n\u001b[mNotice: /Stage[main]/Heat::Engine/Heat_config[DEFAULT/heat_waitcondition_server_url]/value: value changed 'http://[fd00:fd00:fd00:2000::11]:8000/v1/waitcondition' to 'http://127.0.0.1:8000/v1/waitcondition'\u001b[0m\n\u001b[mNotice: /Stage[main]/Heat::Keystone::Authtoken/Keystone::Resource::Authtoken[heat_config]/Heat_config[keystone_authtoken/password]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Heat::Keystone::Authtoken/Keystone::Resource::Authtoken[heat_config]/Heat_config[keystone_authtoken/project_name]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Heat/Oslo::Messaging::Rabbit[heat_config]/Heat_config[oslo_messaging_rabbit/rabbit_ha_queues]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Heat::Engine/Heat_config[DEFAULT/num_engine_workers]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Heat::Engine/Heat_config[DEFAULT/heat_watch_server_url]/value: value changed 'http://[fd00:fd00:fd00:2000::11]:8003' to 'http://127.0.0.1:8003'\u001b[0m\n\u001b[mNotice: /Stage[main]/Heat/Oslo::Messaging::Rabbit[heat_config]/Heat_config[oslo_messaging_rabbit/rabbit_port]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Heat::Keystone::Authtoken/Keystone::Resource::Authtoken[heat_config]/Heat_config[keystone_authtoken/project_domain_name]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Heat/Oslo::Messaging::Rabbit[heat_config]/Heat_config[oslo_messaging_rabbit/rabbit_hosts]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Heat::Keystone::Authtoken/Keystone::Resource::Authtoken[heat_config]/Heat_config[keystone_authtoken/auth_url]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Heat/Oslo::Messaging::Rabbit[heat_config]/Heat_config[DEFAULT/rpc_backend]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Heat::Keystone::Authtoken/Keystone::Resource::Authtoken[heat_config]/Heat_config[keystone_authtoken/username]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Heat/Heat_config[trustee/project_domain_name]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Heat/Heat_config[trustee/user_domain_name]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Heat::Keystone::Authtoken/Keystone::Resource::Authtoken[heat_config]/Heat_config[keystone_authtoken/auth_type]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Heat/Oslo::Middleware[heat_config]/Heat_config[oslo_middleware/enable_proxy_headers_parsing]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Heat/Heat_config[trustee/user_domain_id]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Heat::Keystone::Authtoken/Keystone::Resource::Authtoken[heat_config]/Heat_config[keystone_authtoken/user_domain_name]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Heat::Db/Oslo::Db[heat_config]/Heat_config[database/max_retries]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Cinder::Db/Oslo::Db[cinder_config]/Cinder_config[database/max_retries]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Cinder::Db/Oslo::Db[cinder_config]/Cinder_config[database/db_max_retries]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Heat::Db/Oslo::Db[heat_config]/Heat_config[database/db_max_retries]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Sahara::Db/Oslo::Db[sahara_config]/Sahara_config[database/max_retries]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Sahara::Db/Oslo::Db[sahara_config]/Sahara_config[database/db_max_retries]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Glance::Registry::Db/Oslo::Db[glance_registry_config]/Glance_registry_config[database/max_retries]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Glance::Registry::Db/Oslo::Db[glance_registry_config]/Glance_registry_config[database/db_max_retries]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Sahara::Db/Oslo::Db[sahara_config]/Sahara_config[database/connection]/value: value changed '[old secret redacted]' to '[new secret redacted]'\u001b[0m\n\u001b[mNotice: /Stage[main]/Aodh::Db/Oslo::Db[aodh_config]/Aodh_config[database/max_retries]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Aodh::Db/Oslo::Db[aodh_config]/Aodh_config[database/min_pool_size]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Aodh::Db/Oslo::Db[aodh_config]/Aodh_config[database/max_overflow]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Aodh::Db/Oslo::Db[aodh_config]/Aodh_config[database/retry_interval]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Aodh::Db/Oslo::Db[aodh_config]/Aodh_config[database/max_pool_size]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Aodh::Db/Oslo::Db[aodh_config]/Aodh_config[database/idle_timeout]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Aodh::Db/Oslo::Db[aodh_config]/Aodh_config[database/connection]/value: value changed '[old secret redacted]' to '[new secret redacted]'\u001b[0m\n\u001b[mNotice: /Stage[main]/Cinder::Keystone::Authtoken/Keystone::Resource::Authtoken[cinder_config]/Cinder_config[keystone_authtoken/project_name]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Mongodb::Server::Config/File[/var/lib/mongodb/journal/j._0]/mode: mode changed '0600' to '0755'\u001b[0m\n\u001b[mNotice: /Stage[main]/Mongodb::Server::Service/Service[mongodb]: Triggered 'refresh' from 1 events\u001b[0m\n\u001b[mNotice: /Stage[main]/Apache/File[/etc/httpd/conf.d/10-ceilometer_wsgi.conf]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Keystone::Wsgi::Apache/File[keystone_wsgi_admin]/content: content changed '{md5}3e763f6203adfbc645149a95b6416797' to '{md5}9d752c4dcc117417f7e9bb771f2f9fe1'\u001b[0m\n\u001b[mNotice: /Stage[main]/Keystone/File[/etc/keystone/credential-keys]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Keystone/File[/etc/keystone/credential-keys/0]/ensure: defined content as '{md5}d28d633791b7cdc2acbe76646795d9b2'\u001b[0m\n\u001b[mNotice: /Stage[main]/Keystone/File[/etc/keystone/credential-keys/1]/ensure: defined content as '{md5}8e6c65b0609359d55fa8210848246513'\u001b[0m\n\u001b[mNotice: /Stage[main]/Keystone::Wsgi::Apache/File[keystone_wsgi_main]/content: content changed '{md5}34980ddacaf4a3f735ce33ff9688364e' to '{md5}c81070109f0f0824798a0c3c240f16ef'\u001b[0m\n\u001b[mNotice: /Stage[main]/Keystone/Keystone_config[signing/keyfile]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Keystone::Db/Oslo::Db[keystone_config]/Keystone_config[database/db_max_retries]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Keystone/Keystone_config[signing/key_size]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Keystone/Oslo::Middleware[keystone_config]/Keystone_config[oslo_middleware/enable_proxy_headers_parsing]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Keystone/Keystone_config[signing/ca_certs]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Keystone/Keystone_config[signing/ca_key]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Keystone/Keystone_config[signing/certfile]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Keystone/Oslo::Messaging::Rabbit[keystone_config]/Keystone_config[oslo_messaging_rabbit/rabbit_hosts]/value: value changed 'fd00:fd00:fd00:2000::14,fd00:fd00:fd00:2000::13,fd00:fd00:fd00:2000::15' to 'fd00:fd00:fd00:2000::14:5672,fd00:fd00:fd00:2000::13:5672,fd00:fd00:fd00:2000::15:5672'\u001b[0m\n\u001b[mNotice: /Stage[main]/Keystone/Oslo::Messaging::Notifications[keystone_config]/Keystone_config[oslo_messaging_notifications/driver]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Keystone/Oslo::Messaging::Rabbit[keystone_config]/Keystone_config[DEFAULT/rpc_backend]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Keystone/Keystone_config[DEFAULT/public_endpoint]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Keystone::Db/Oslo::Db[keystone_config]/Keystone_config[database/max_retries]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Keystone/Keystone_config[credential/key_repository]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Keystone/Keystone_config[signing/cert_subject]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Keystone::Wsgi::Apache/Apache::Vhost[keystone_wsgi_main]/Concat[10-keystone_wsgi_main.conf]/File[/etc/httpd/conf.d/10-keystone_wsgi_main.conf]/content: content changed '{md5}a50b9abd0e4bd501f780f7e462e19eae' to '{md5}7353187c3649a11d0c3ddc079ff208f2'\u001b[0m\n\u001b[mNotice: /Stage[main]/Swift::Deps/Anchor[swift::install::end]: Triggered 'refresh' from 1 events\u001b[0m\n\u001b[mNotice: /Stage[main]/Nova::Keystone::Authtoken/Keystone::Resource::Authtoken[nova_config]/Nova_config[keystone_authtoken/username]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Nova::Keystone::Authtoken/Keystone::Resource::Authtoken[nova_config]/Nova_config[keystone_authtoken/project_name]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Nova/Oslo::Messaging::Notifications[nova_config]/Nova_config[oslo_messaging_notifications/driver]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Nova::Keystone::Authtoken/Keystone::Resource::Authtoken[nova_config]/Nova_config[keystone_authtoken/auth_type]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Nova::Db/Oslo::Db[nova_config]/Nova_config[database/max_retries]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Nova/Oslo::Messaging::Rabbit[nova_config]/Nova_config[oslo_messaging_rabbit/rabbit_virtual_host]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Nova/Nova_config[upgrade_levels/compute]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Nova/Oslo::Messaging::Rabbit[nova_config]/Nova_config[oslo_messaging_rabbit/kombu_reconnect_delay]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Nova::Keystone::Authtoken/Keystone::Resource::Authtoken[nova_config]/Nova_config[keystone_authtoken/auth_url]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Nova::Db/Oslo::Db[nova_config]/Nova_config[database/db_max_retries]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Nova/Oslo::Messaging::Rabbit[nova_config]/Nova_config[oslo_messaging_rabbit/amqp_durable_queues]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Nova::Policy/Oslo::Policy[nova_config]/Nova_config[oslo_policy/policy_file]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Nova/Nova_config[DEFAULT/disk_allocation_ratio]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Nova/Oslo::Messaging::Rabbit[nova_config]/Nova_config[oslo_messaging_rabbit/heartbeat_rate]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Nova/Nova_config[DEFAULT/cpu_allocation_ratio]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Nova::Api/Nova_config[wsgi/api_paste_config]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Nova::Api/Oslo::Middleware[nova_config]/Nova_config[oslo_middleware/enable_proxy_headers_parsing]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Nova/Nova_config[DEFAULT/host]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Nova::Keystone::Authtoken/Keystone::Resource::Authtoken[nova_config]/Nova_config[keystone_authtoken/password]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Nova/Oslo::Messaging::Rabbit[nova_config]/Nova_config[oslo_messaging_rabbit/rabbit_hosts]/value: value changed ['fd00:fd00:fd00:2000::14,fd00:fd00:fd00:2000::13,fd00:fd00:fd00:2000::15'] to ['fd00:fd00:fd00:2000::14:5672,fd00:fd00:fd00:2000::13:5672,fd00:fd00:fd00:2000::15:5672']\u001b[0m\n\u001b[mNotice: /Stage[main]/Nova::Network::Neutron/Nova_config[DEFAULT/dhcp_domain]/value: value changed [''] to ['novalocal']\u001b[0m\n\u001b[mNotice: /Stage[main]/Nova::Network::Neutron/Nova_config[neutron/auth_type]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Cinder::Policy/Oslo::Policy[cinder_config]/Cinder_config[oslo_policy/policy_file]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Apache/Concat[/etc/httpd/conf/ports.conf]/File[/etc/httpd/conf/ports.conf]/content: content changed '{md5}9962b3a1c40b43ba62917107e2bd31ff' to '{md5}8e634ba49c91983259197beec5de0625'\u001b[0m\n\u001b[mNotice: /Stage[main]/Neutron/Neutron_config[DEFAULT/l3_ha]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Swift::Deps/Anchor[swift::service::begin]: Triggered 'refresh' from 1 events\u001b[0m\n\u001b[mNotice: /Stage[main]/Glance::Deps/Anchor[glance::config::end]: Triggered 'refresh' from 29 events\u001b[0m\n\u001b[mNotice: /Stage[main]/Nova::Deps/Anchor[nova::config::end]: Triggered 'refresh' from 22 events\u001b[0m\n\u001b[mNotice: /Stage[main]/Cinder::Keystone::Authtoken/Keystone::Resource::Authtoken[cinder_config]/Cinder_config[keystone_authtoken/password]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Tripleo::Profile::Pacemaker::Database::Mysql/Exec[galera-ready]/returns: executed successfully\u001b[0m\n\u001b[mNotice: /Stage[main]/Glance::Db::Sync/Exec[glance-manage db_sync]: Triggered 'refresh' from 1 events\u001b[0m\n\u001b[mNotice: /Stage[main]/Glance::Deps/Anchor[glance::dbsync::end]: Triggered 'refresh' from 1 events\u001b[0m\n\u001b[mNotice: /Stage[main]/Glance::Deps/Anchor[glance::service::begin]: Triggered 'refresh' from 2 events\u001b[0m\n\u001b[mNotice: /Stage[main]/Glance::Registry/Service[glance-registry]/enable: enable changed 'false' to 'true'\u001b[0m\n\u001b[mNotice: /Stage[main]/Glance::Registry/Service[glance-registry]: Triggered 'refresh' from 1 events\u001b[0m\n\u001b[mNotice: /Stage[main]/Glance::Deps/Anchor[glance::service::end]: Triggered 'refresh' from 2 events\u001b[0m\n\u001b[mNotice: /Stage[main]/Aodh::Db::Sync/Exec[aodh-db-sync]: Triggered 'refresh' from 21 events\u001b[0m\n\u001b[mNotice: /Stage[main]/Nova::Db::Sync/Exec[nova-db-sync]: Triggered 'refresh' from 1 events\u001b[0m\n\u001b[mNotice: /Stage[main]/Nova::Deps/Anchor[nova::dbsync::end]: Triggered 'refresh' from 1 events\u001b[0m\n\u001b[mNotice: /Stage[main]/Nova::Deps/Anchor[nova::dbsync_api::begin]: Triggered 'refresh' from 1 events\u001b[0m\n\u001b[mNotice: /Stage[main]/Nova::Db::Sync_api/Exec[nova-db-sync-api]: Triggered 'refresh' from 2 events\u001b[0m\n\u001b[mNotice: /Stage[main]/Nova::Deps/Anchor[nova::dbsync_api::end]: Triggered 'refresh' from 1 events\u001b[0m\n\u001b[mNotice: /Stage[main]/Nova::Deps/Anchor[nova::service::begin]: Triggered 'refresh' from 2 events\u001b[0m\n\u001b[mNotice: /Stage[main]/Nova::Api/Nova::Generic_service[api]/Service[nova-api]/enable: enable changed 'false' to 'true'\u001b[0m\n\u001b[mNotice: /Stage[main]/Nova::Api/Nova::Generic_service[api]/Service[nova-api]: Triggered 'refresh' from 1 events\u001b[0m\n\u001b[mNotice: /Stage[main]/Nova::Deps/Anchor[nova::service::end]: Triggered 'refresh' from 2 events\u001b[0m\n\u001b[mNotice: /Stage[main]/Keystone::Wsgi::Apache/Apache::Vhost[keystone_wsgi_admin]/Concat[10-keystone_wsgi_admin.conf]/File[/etc/httpd/conf.d/10-keystone_wsgi_admin.conf]/content: content changed '{md5}36ca879284d6ad15550d9ed298ce2f1d' to '{md5}a29be596a8c1a3b7685f0b72edd1fc79'\u001b[0m\n\u001b[mNotice: /Stage[main]/Keystone::Deps/Anchor[keystone::config::end]: Triggered 'refresh' from 16 events\u001b[0m\n\u001b[mNotice: /Stage[main]/Sahara::Policy/Oslo::Policy[sahara_config]/Sahara_config[oslo_policy/policy_file]/ensure: created\u001b[0m\n\u001b[mNotice: /Stage[main]/Sahara::Db::Sync/Exec[sahara-dbmanage]: Triggered 'refresh' from 1 events\u001b[0m\n\u001b[mNotice: /Stage[main]/Sahara::Service::Engine/Service[sahara-engine]/enable: enable changed 'false' to 'true'\u001b[0m\n\u001b[mNotice: /Stage[main]/Sahara::Service::Engine/Service[sahara-engine]: Triggered 'refresh' from 8 events\u001b[0m\n\u001b[mNotice: /Stage[main]/Apache/File[/etc/httpd/conf.modules.d/status.conf]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Apache/File[/etc/httpd/conf.modules.d/status.load]/ensure: removed\u001b[0m\n\u001b[mNotice: /Stage[main]/Cinder::Deps/Anchor[cinder::config::end]: Triggered 'refresh' from 15 events\u001b[0m\n\u001b[mNotice: /Stage[main]/Tripleo::Profile::Pacemaker::Cinder::Volume/Tripleo::Pacemaker::Resource_restart_flag[openstack-cinder-volume]/Exec[openstack-cinder-volume resource restart flag]: Triggered 'refresh' from 1 events\u001b[0m\n\u001b[mNotice: /Stage[main]/Cinder::Db::Sync/Exec[cinder-manage db_sync]: Triggered 'refresh' from 1 events\u001b[0m\n\u001b[mNotice: /Stage[main]/Cinder::Deps/Anchor[cinder::dbsync::end]: Triggered 'refresh' from 1 events\u001b[0m\n\u001b[mNotice: /Stage[main]/Cinder::Deps/Anchor[cinder::service::begin]: Triggered 'refresh' from 2 events\u001b[0m\n\u001b[mNotice: /Stage[main]/Cinder::Api/Service[cinder-api]/enable: enable changed 'false' to 'true'\u001b[0m\n\u001b[mNotice: /Stage[main]/Cinder::Api/Service[cinder-api]: Triggered 'refresh' from 1 events\u001b[0m\n\u001b[mNotice: /Stage[main]/Cinder::Deps/Anchor[cinder::service::end]: Triggered 'refresh' from 3 events\u001b[0m\n\u001b[mNotice: /Stage[main]/Ceilometer::Collector/Service[ceilometer-collector]/enable: enable changed 'false' to 'true'\u001b[0m\n\u001b[mNotice: /Stage[main]/Ceilometer::Collector/Service[ceilometer-collector]: Triggered 'refresh' from 10 events\u001b[0m\n\u001b[mNotice: /Stage[main]/Neutron::Deps/Anchor[neutron::config::end]: Triggered 'refresh' from 5 events\u001b[0m\n\u001b[mNotice: /Stage[main]/Neutron::Deps/Anchor[neutron::service::begin]: Triggered 'refresh' from 1 events\u001b[0m\n\u001b[mNotice: /Stage[main]/Keystone::Db::Sync/Exec[keystone-manage db_sync]: Triggered 'refresh' from 1 events\u001b[0m\n\u001b[mNotice: /Stage[main]/Keystone::Deps/Anchor[keystone::dbsync::end]: Triggered 'refresh' from 1 events\u001b[0m\n\u001b[mNotice: /Stage[main]/Keystone::Deps/Anchor[keystone::service::begin]: Triggered 'refresh' from 2 events\u001b[0m\n\u001b[mNotice: /Stage[main]/Apache::Service/Service[httpd]/enable: enable changed 'false' to 'true'\u001b[0m\n\u001b[mNotice: /Stage[main]/Apache::Service/Service[httpd]: Triggered 'refresh' from 2 events\u001b[0m\n\u001b[mNotice: /Stage[main]/Keystone::Deps/Anchor[keystone::service::end]: Triggered 'refresh' from 1 events\u001b[0m\n\u001b[mNotice: /Stage[main]/Keystone::Roles::Admin/Keystone_user_role[admin@admin]: Dependency Keystone_user[admin] has failures: true\u001b[0m\n\u001b[mNotice: /Stage[main]/Keystone::Endpoint/Keystone::Resource::Service_identity[keystone]/Keystone_endpoint[regionOne/keystone::identity]: Dependency Keystone_service[keystone::identity] has failures: true\u001b[0m\n\u001b[mNotice: /Stage[main]/Heat::Deps/Anchor[heat::config::end]: Triggered 'refresh' from 22 events\u001b[0m\n\u001b[mNotice: /Stage[main]/Heat::Db::Sync/Exec[heat-dbsync]: Triggered 'refresh' from 1 events\u001b[0m\n\u001b[mNotice: /Stage[main]/Heat::Deps/Anchor[heat::dbsync::end]: Triggered 'refresh' from 1 events\u001b[0m\n\u001b[mNotice: /Stage[main]/Heat::Deps/Anchor[heat::service::begin]: Triggered 'refresh' from 2 events\u001b[0m\n\u001b[mNotice: /Stage[main]/Heat::Engine/Service[heat-engine]/enable: enable changed 'false' to 'true'\u001b[0m\n\u001b[mNotice: /Stage[main]/Heat::Engine/Service[heat-engine]: Triggered 'refresh' from 1 events\u001b[0m\n\u001b[mNotice: /Stage[main]/Heat::Deps/Anchor[heat::service::end]: Triggered 'refresh' from 2 events\u001b[0m\n\u001b[mNotice: /Firewall[998 log all]: Dependency Keystone_user[admin] has failures: true\u001b[0m\n\u001b[mNotice: /Firewall[998 log all]: Dependency Keystone_service[keystone::identity] has failures: true\u001b[0m\n\u001b[mNotice: /Firewall[999 drop all]: Dependency Keystone_user[admin] has failures: true\u001b[0m\n\u001b[mNotice: /Firewall[999 drop all]: Dependency Keystone_service[keystone::identity] has failures: true\u001b[0m\n\u001b[mNotice: Finished catalog run in 1172.80 seconds\u001b[0m\n", 
    "deploy_stderr": "exception: connect failed\n\u001b[1;31mWarning: Scope(Class[Cinder::Api]): keystone_enabled is deprecated, use auth_strategy instead.\u001b[0m\n\u001b[1;31mWarning: Scope(Class[Keystone]): Fernet token is recommended in Mitaka release. The default for token_provider will be changed to 'fernet' in O release.\u001b[0m\n\u001b[1;31mWarning: Scope(Class[Heat]): keystone_user_domain_id is deprecated, use the name option instead.\u001b[0m\n\u001b[1;31mWarning: Scope(Class[Heat]): keystone_project_domain_id is deprecated, use the name option instead.\u001b[0m\n\u001b[1;31mWarning: Scope(Class[Nova]): Could not look up qualified variable '::nova::scheduler::filter::cpu_allocation_ratio'; class ::nova::scheduler::filter has not been evaluated\u001b[0m\n\u001b[1;31mWarning: Scope(Class[Nova]): Could not look up qualified variable '::nova::scheduler::filter::ram_allocation_ratio'; class ::nova::scheduler::filter has not been evaluated\u001b[0m\n\u001b[1;31mWarning: Scope(Class[Nova]): Could not look up qualified variable '::nova::scheduler::filter::disk_allocation_ratio'; class ::nova::scheduler::filter has not been evaluated\u001b[0m\n\u001b[1;31mWarning: Scope(Class[Mongodb::Server]): Replset specified, but no replset_members or replset_config provided.\u001b[0m\n\u001b[1;31mWarning: Scope(Class[Nova::Keystone::Authtoken]): Could not look up qualified variable '::nova::api::admin_user'; class ::nova::api has not been evaluated\u001b[0m\n\u001b[1;31mWarning: Scope(Class[Nova::Keystone::Authtoken]): Could not look up qualified variable '::nova::api::admin_password'; class ::nova::api has not been evaluated\u001b[0m\n\u001b[1;31mWarning: Scope(Class[Nova::Keystone::Authtoken]): Could not look up qualified variable '::nova::api::admin_tenant_name'; class ::nova::api has not been evaluated\u001b[0m\n\u001b[1;31mWarning: Scope(Class[Nova::Keystone::Authtoken]): Could not look up qualified variable '::nova::api::auth_uri'; class ::nova::api has not been evaluated\u001b[0m\n\u001b[1;31mWarning: Scope(Class[Nova::Keystone::Authtoken]): Could not look up qualified variable '::nova::api::auth_version'; class ::nova::api has not been evaluated\u001b[0m\n\u001b[1;31mWarning: Scope(Class[Nova::Keystone::Authtoken]): Could not look up qualified variable '::nova::api::identity_uri'; class ::nova::api has not been evaluated\u001b[0m\n\u001b[1;31mWarning: Scope(Class[Ceilometer]): Both $metering_secret and $telemetry_secret defined, using $telemetry_secret\u001b[0m\n\u001b[1;31mWarning: Scope(Haproxy::Config[haproxy]): haproxy: The $merge_options parameter will default to true in the next major release. Please review the documentation regarding the implications.\u001b[0m\n\u001b[1;31mError: /Stage[main]/Keystone/Exec[keystone-manage bootstrap]: Failed to call refresh: Command exceeded timeout\u001b[0m\n\u001b[1;31mError: /Stage[main]/Keystone/Exec[keystone-manage bootstrap]: Command exceeded timeout\u001b[0m\n\u001b[1;31mError: /Stage[main]/Keystone::Roles::Admin/Keystone_user[admin]: Could not evaluate: Command: 'openstack [\"token\", \"issue\", [\"--format\", \"value\"]]' has been running for more than 40 seconds (tried 4, for a total of 170 seconds)\u001b[0m\n\u001b[1;31mWarning: /Stage[main]/Keystone::Roles::Admin/Keystone_user_role[admin@admin]: Skipping because of failed dependencies\u001b[0m\n\u001b[1;31mError: Could not prefetch keystone_service provider 'openstack': Command: 'openstack [\"service\", \"list\", \"--quiet\", \"--format\", \"csv\", \"--long\"]' has been running for more than 40 seconds (tried 4, for a total of 170 seconds)\u001b[0m\n\u001b[1;31mError: Not managing Keystone_service[keystone] due to earlier Keystone API failures.\u001b[0m\n\u001b[1;31mError: /Stage[main]/Keystone::Endpoint/Keystone::Resource::Service_identity[keystone]/Keystone_service[keystone::identity]/ensure: change from absent to present failed: Not managing Keystone_service[keystone] due to earlier Keystone API failures.\u001b[0m\n\u001b[1;31mError: Could not prefetch keystone_endpoint provider 'openstack': Command: 'openstack [\"endpoint\", \"list\", \"--quiet\", \"--format\", \"csv\", []]' has been running for more than 40 seconds (tried 4, for a total of 170 seconds)\u001b[0m\n\u001b[1;31mWarning: /Stage[main]/Keystone::Endpoint/Keystone::Resource::Service_identity[keystone]/Keystone_endpoint[regionOne/keystone::identity]: Skipping because of failed dependencies\u001b[0m\n\u001b[1;31mWarning: /Firewall[998 log all]: Skipping because of failed dependencies\u001b[0m\n\u001b[1;31mWarning: /Firewall[999 drop all]: Skipping because of failed dependencies\u001b[0m\n", 
    "deploy_status_code": 6
  }, 
  "creation_time": "2016-11-10T00:15:51Z", 
  "updated_time": "2016-11-10T00:38:18Z", 
  "input_values": {
    "step": 3, 
    "update_identifier": "1478735696"
  }, 
  "action": "CREATE", 
  "status_reason": "deploy_status_code : Deployment exited with non-zero status code: 6", 
  "id": "c63248f0-2164-43c1-8ba1-ae63c95071a2"
}

------------------------------------------------------------------------------



[stack@undercloud-0 ~]$  less /var/log/heat/heat-engine.log : 


2016-11-09 19:38:19.507 23237 INFO heat.engine.service [req-618be5a8-bac4-4499-9f84-bb3280d5c0fb - - - - -] Stack create failed, status FAILED
2016-11-09 19:38:19.546 23237 DEBUG oslo_messaging._drivers.amqpdriver [req-618be5a8-bac4-4499-9f84-bb3280d5c0fb - - - - -] CAST unique_id: ba8c4ed0b81c43cf83f4083cce28eca
2 NOTIFY exchange 'heat' topic 'notifications.error' _send /usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py:432
2016-11-09 19:38:19.560 23237 INFO heat.engine.stack [req-618be5a8-bac4-4499-9f84-bb3280d5c0fb - - - - -] Stack CREATE FAILED (overcloud-AllNodesDeploySteps-mobdt5fcb5ut):
 Resource CREATE failed: Error: resources.ControllerDeployment_Step3.resources[0]: Deployment to server failed: deploy_status_code: Deployment exited with non-zero status 
code: 6
2016-11-09 19:38:19.792 23236 DEBUG heat.engine.scheduler [req-7c5085b3-e488-4b02-932b-38bae5726b28 - - - - -] Task update_task from Stack "overcloud" [720ea90b-047d-4559-
82d8-fd7bce28aeae] running step /usr/lib/python2.7/site-packages/heat/engine/scheduler.py:216
2016-11-09 19:38:19.793 23236 DEBUG heat.engine.scheduler [req-7c5085b3-e488-4b02-932b-38bae5726b28 - - - - -] Task Stack "overcloud" [720ea90b-047d-4559-82d8-fd7bce28aeae
] Update running step /usr/lib/python2.7/site-packages/heat/engine/scheduler.py:216
2016-11-09 19:38:19.794 23236 DEBUG heat.engine.scheduler [req-7c5085b3-e488-4b02-932b-38bae5726b28 - - - - -] Task _resource_update from Stack "overcloud" [720ea90b-047d-
4559-82d8-fd7bce28aeae] Update running step /usr/lib/python2.7/site-packages/heat/engine/scheduler.py:216
2016-11-09 19:38:19.800 23236 INFO heat.engine.resource [req-7c5085b3-e488-4b02-932b-38bae5726b28 - - - - -] CREATE: TemplateResource "AllNodesDeploySteps" [32a28e92-db83-
486b-952c-21aa64404d8b] Stack "overcloud" [720ea90b-047d-4559-82d8-fd7bce28aeae]
2016-11-09 19:38:19.800 23236 ERROR heat.engine.resource Traceback (most recent call last):
2016-11-09 19:38:19.800 23236 ERROR heat.engine.resource   File "/usr/lib/python2.7/site-packages/heat/engine/resource.py", line 753, in _action_recorder
2016-11-09 19:38:19.800 23236 ERROR heat.engine.resource     yield
2016-11-09 19:38:19.800 23236 ERROR heat.engine.resource   File "/usr/lib/python2.7/site-packages/heat/engine/resource.py", line 855, in _do_action
2016-11-09 19:38:19.800 23236 ERROR heat.engine.resource     yield self.action_handler_task(action, args=handler_args)
2016-11-09 19:38:19.800 23236 ERROR heat.engine.resource   File "/usr/lib/python2.7/site-packages/heat/engine/scheduler.py", line 353, in wrapper
2016-11-09 19:38:19.800 23236 ERROR heat.engine.resource     step = next(subtask)
2016-11-09 19:38:19.800 23236 ERROR heat.engine.resource   File "/usr/lib/python2.7/site-packages/heat/engine/resource.py", line 806, in action_handler_task
2016-11-09 19:38:19.800 23236 ERROR heat.engine.resource     done = check(handler_data)
2016-11-09 19:38:19.800 23236 ERROR heat.engine.resource   File "/usr/lib/python2.7/site-packages/heat/engine/resources/stack_resource.py", line 354, in check_create_compl
ete
2016-11-09 19:38:19.800 23236 ERROR heat.engine.resource     return self._check_status_complete(self.CREATE)
2016-11-09 19:38:19.800 23236 ERROR heat.engine.resource   File "/usr/lib/python2.7/site-packages/heat/engine/resources/stack_resource.py", line 404, in _check_status_comp
lete
2016-11-09 19:38:19.800 23236 ERROR heat.engine.resource     action=action)
2016-11-09 19:38:19.800 23236 ERROR heat.engine.resource ResourceFailure: Error: resources.AllNodesDeploySteps.resources.ControllerDeployment_Step3.resources[0]: Deploymen
t to server failed: deploy_status_code: Deployment exited with non-zero status code: 6
2016-11-09 19:38:19.800 23236 ERROR heat.engine.resource

Comment 2 Omri Hochman 2016-11-10 15:41:28 UTC

*** This bug has been marked as a duplicate of bug 1393346 ***


Note You need to log in before you can comment on or make changes to this bug.