Created attachment 1485633 [details]
/home/stack/overcloud_install.log

Description of problem:

Overcloud deploy is still stuck 100 minutes after deployment started, then it is killed by "--timeout 100".

Last entries in /home/stack/overcloud_install.log are:
...
ok: [ceph-0] => {
    "failed_when_result": false, 
    "outputs.stdout_lines | default([]) | union(outputs.stderr_lines | default([]))": [
        "stdout: ce811316fb3f82468d810fa1199e2d430376ee3e6307b844a4bd270b45b26442", 
        "", 
        "stderr: "
    ]
}

TASK [Check if /var/lib/docker-puppet/docker-puppet-tasks4.json exists] ********
Friday 21 September 2018  08:43:44 -0400 (0:00:00.217)       0:27:06.634 ****** 
ok: [ceph-0] => {"changed": false, "stat": {"exists": false}}
ok: [compute-0] => {"changed": false, "stat": {"exists": false}}
ok: [controller-0] => {"changed": false, "stat": {"atime": 1537532467.8883862, "attr_flags": "", "attributes": [], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "checksum": "fc092b06b8d6fdc6d18320ab604ab9a6ebc1e1ae", "ctime": 1537532467.8933864, "dev": 64514, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 41943523, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0600", "mtime": 1537532467.7203863, "nlink": 1, "path": "/var/lib/docker-puppet/docker-puppet-tasks4.json", "pw_name": "root", "readable": true, "rgrp": false, "roth": false, "rusr": true, "size": 321, "uid": 0, "version": "18446744073615036390", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}}

TASK [Run docker-puppet tasks (bootstrap tasks) for step 4] ********************
Friday 21 September 2018  08:43:44 -0400 (0:00:00.456)       Connection is already closed.
0:27:07.090 ****** 
skipping: [compute-0] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false}
skipping: [ceph-0] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false}
ok: [controller-0] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false}



Last entries in /var/lib/mistral/overcloud/ansible.log are:
...
2018-09-21 08:44:33,941 p=891 u=mistral |  TASK [Run docker-puppet tasks (generate config) during step 5] *****************
2018-09-21 08:44:33,941 p=891 u=mistral |  Friday 21 September 2018  08:44:33 -0400 (0:00:00.162)       0:27:56.428 ****** 
2018-09-21 08:44:33,977 p=891 u=mistral |  skipping: [controller-0] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false}
2018-09-21 08:44:34,012 p=891 u=mistral |  skipping: [compute-0] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false}
2018-09-21 08:44:34,028 p=891 u=mistral |  skipping: [ceph-0] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false}
2018-09-21 08:44:34,058 p=891 u=mistral |  TASK [Debug output for task which failed: Run docker-puppet tasks (generate config) during step 5] ***
2018-09-21 08:44:34,058 p=891 u=mistral |  Friday 21 September 2018  08:44:34 -0400 (0:00:00.116)       0:27:56.544 ****** 
2018-09-21 08:44:34,094 p=891 u=mistral |  skipping: [controller-0] => {}
2018-09-21 08:44:34,129 p=891 u=mistral |  skipping: [compute-0] => {}
2018-09-21 08:44:34,145 p=891 u=mistral |  skipping: [ceph-0] => {}
2018-09-21 08:44:34,175 p=891 u=mistral |  TASK [Start containers for step 5] *********************************************
2018-09-21 08:44:34,176 p=891 u=mistral |  Friday 21 September 2018  08:44:34 -0400 (0:00:00.117)       0:27:56.662 ****** 
2018-09-21 08:44:34,756 p=891 u=mistral |  ok: [compute-0] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false}
2018-09-21 08:44:34,786 p=891 u=mistral |  ok: [ceph-0] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false}



Version-Release number of selected component (if applicable):
OSP14, puddle 2018-09-20.1, topology 1uc:1contr:1comp:1ceph

How reproducible:
100%

Steps to Reproduce:
1. Deploy mentioned topology using InfraRed
2. OC deployment times out

Additional info:
heat-cfntools.noarch            1.3.0-2.el7ost
openstack-heat-agents.noarch    1.7.1-0.20180907213355.476aae2.el7ost
openstack-heat-api.noarch       1:12.0.0-0.20180604085325.7d878a8.el7ost
openstack-heat-common.noarch    1:12.0.0-0.20180604085325.7d878a8.el7ost
openstack-heat-engine.noarch    1:12.0.0-0.20180604085325.7d878a8.el7ost
openstack-heat-monolith.noarch  1:12.0.0-0.20180604085325.7d878a8.el7ost
openstack-tripleo-heat-templates.noarch 9.0.0-0.20180906145841.66804ff.0rc1.0rc1.el7ost
puppet-heat.noarch              13.3.1-0.20180831195745.28088f9.el7ost
python-tripleoclient-heat-installer.noarch 10.5.1-0.20180906012840.5b00837.el7ost