Bug 1426947

Created attachment 1257844 [details]
os-collect-config-log

Description of problem:
OSP10 -> OSP11 upgrade fails during major-upgrade-composable-steps(  because httpd is stopped:


overcloud.AllNodesDeploySteps.AllNodesPostUpgradeSteps.ControllerDeployment_Step3.0:
  resource_type: OS::Heat::StructuredDeployment
  physical_resource_id: d96c3622-d2f2-40f6-9488-57cf95c8d8c0
  status: CREATE_FAILED
  status_reason: |
    Error: resources[0]: Deployment to server failed: deploy_status_code : Deployment exited with non-zero status code: 1
  deploy_stdout: |
    ...
    Notice: /Stage[main]/Keystone::Deps/Anchor[keystone::dbsync::end]: Dependency File[placement_wsgi] has failures: true
    Notice: /Stage[main]/Keystone::Deps/Anchor[keystone::dbsync::end]: Dependency Panko_config[database/connection] has failures: true
    Notice: /Stage[main]/Keystone/Exec[keystone-manage bootstrap]: Dependency File[placement_wsgi] has failures: true
    Notice: /Stage[main]/Keystone/Exec[keystone-manage bootstrap]: Dependency Panko_config[database/connection] has failures: true
    Notice: /Stage[main]/Keystone::Deps/Anchor[keystone::service::begin]: Dependency File[placement_wsgi] has failures: true
    Notice: /Stage[main]/Keystone::Deps/Anchor[keystone::service::begin]: Dependency Panko_config[database/connection] has failures: true
    Notice: /Stage[main]/Apache::Service/Service[httpd]: Dependency Panko_config[database/connection] has failures: true
    Notice: /Stage[main]/Apache::Service/Service[httpd]: Dependency File[placement_wsgi] has failures: true
    Notice: /Stage[main]/Keystone::Deps/Anchor[keystone::service::end]: Dependency Panko_config[database/connection] has failures: true
    Notice: /Stage[main]/Keystone::Deps/Anchor[keystone::service::end]: Dependency File[placement_wsgi] has failures: true
    (truncated, view all with --long)
  deploy_stderr: |
    ...
    Warning: /Stage[main]/Keystone::Db::Mysql/Openstacklib::Db::Mysql[keystone]/Openstacklib::Db::Mysql::Host_access[keystone_10.0.0.17]/Mysql_grant[keystone.0.17/keystone.*]: Skipping because of failed dependencies
    Warning: /Stage[main]/Keystone::Deps/Anchor[keystone::db::end]: Skipping because of failed dependencies
    Warning: /Stage[main]/Keystone::Deps/Anchor[keystone::dbsync::begin]: Skipping because of failed dependencies
    Warning: /Stage[main]/Keystone::Db::Sync/Exec[keystone-manage db_sync]: Skipping because of failed dependencies
    Warning: /Stage[main]/Keystone::Deps/Anchor[keystone::dbsync::end]: Skipping because of failed dependencies
    Warning: /Stage[main]/Keystone/Exec[keystone-manage bootstrap]: Skipping because of failed dependencies
    Warning: /Stage[main]/Keystone::Deps/Anchor[keystone::service::begin]: Skipping because of failed dependencies
    Warning: /Stage[main]/Apache::Service/Service[httpd]: Skipping because of failed dependencies
    Warning: /Stage[main]/Keystone::Deps/Anchor[keystone::service::end]: Skipping because of failed dependencies
    Error: Failed to apply catalog: Execution of '/usr/bin/openstack domain list --quiet --format csv' returned 1: Unable to establish connection to http://overcloud-controller-0.ctlplane.localdomain:35357/v3/domains?: HTTPConnectionPool(host='overcloud-controller-0.ctlplane.localdomain', port=35357): Max retries exceeded with url: /v3/domains (Caused by NewConnectionError('<requests.packages.urllib3.connection.HTTPConnection object at 0x3e4e3d0>: Failed to establish a new connection: [Errno 111] Connection refused',)) (tried 45, for a total of 170 seconds)
    (truncated, view all with --long)


Version-Release number of selected component (if applicable):
openstack-tripleo-heat-templates-6.0.0-0.20170222195630.46117f4.el7ost.noarch

How reproducible:
100%

Steps to Reproduce:
1. Upgrade overcloud OSP10 to OSP11

Actual results:
Upgrade fails because httpd is stopped and Keystone cannot be reached.

Expected results:
Successful upgrade.

Additional info:
Attaching the os-collect-config log from the controller: