During deployment step4 config for container-puppet-nova_placement fails. Reproduced here: [root@undercloud common]# export CONFIG=/tmp/contianer-puppet.json [root@undercloud common]# python3 container-puppet.py 2019-11-06 08:37:35,484 INFO: 963838 -- Running container-puppet 2019-11-06 08:37:35,485 INFO: 963838 -- Service compilation completed. 2019-11-06 08:37:35,485 INFO: 963838 -- Starting multiprocess configuration steps. Using 8 processes. 2019-11-06 08:37:35,498 INFO: 963840 -- Starting configuration of nova_placement using image 172.16.0.1:8787/rhosp15-rhel8/openstack-nova-placement-api:15.0-73 2019-11-06 08:37:35,590 INFO: 963840 -- Removing container: container-puppet-nova_placement 2019-11-06 08:37:35,851 INFO: 963840 -- Image already exists: 172.16.0.1:8787/rhosp15-rhel8/openstack-nova-placement-api:15.0-73 2019-11-06 08:37:38,947 ERROR: 963840 -- ['/usr/bin/podman', 'run', '--user', 'root', '--name', 'container-puppet-nova_placement', '--env', 'PUPPET_TAGS=file,file_line,concat,augeas,cron,nova_config', '--env', 'NAME=nova_placement', '--env', 'HOSTNAME=undercloud', '--env', 'NO_ARCHIVE=', '--env', 'STEP=6', '--env', 'NET_HOST=false', '--volume', '/etc/localtime:/etc/localtime:ro', '--volume', '/tmp/tmprzz7dh7e:/etc/config.pp:ro', '--volume', '/etc/puppet/:/tmp/puppet-etc/:ro', '--volume', '/etc/pki/ca-trust/extracted:/etc/pki/ca-trust/extracted:ro', '--volume', '/etc/pki/tls/certs/ca-bundle.crt:/etc/pki/tls/certs/ca-bundle.crt:ro', '--volume', '/etc/pki/tls/certs/ca-bundle.trust.crt:/etc/pki/tls/certs/ca-bundle.trust.crt:ro', '--volume', '/etc/pki/tls/cert.pem:/etc/pki/tls/cert.pem:ro', '--volume', '/var/lib/config-data:/var/lib/config-data/:rw', '--volume', '/var/lib/container-puppet/puppetlabs/facter.conf:/etc/puppetlabs/facter/facter.conf:ro', '--volume', '/var/lib/container-puppet/puppetlabs/:/opt/puppetlabs/:ro', '--volume', '/dev/log:/dev/log:rw', '--log-driver', 'k8s-file', '--log-opt', 'path=/var/log/containers/stdouts/container-puppet-nova_placement.log', '--security-opt', 'label=disable', '--volume', '/usr/share/openstack-puppet/modules/:/usr/share/openstack-puppet/modules/:ro', '--volume', '/usr/share/openstack-puppet/modules/:/usr/share/openstack-puppet/modules/:ro', '--entrypoint', '/var/lib/container-puppet/container-puppet.sh', '--volume', '/var/lib/container-puppet/container-puppet.sh:/var/lib/container-puppet/container-puppet.sh:ro', '172.16.0.1:8787/rhosp15-rhel8/openstack-nova-placement-api:15.0-73'] run failed after Error: /usr/share/openstack-puppet/modules/: duplicate mount destination attempt(s): 1 2019-11-06 08:37:38,948 WARNING: 963840 -- Retrying running container: nova_placement 2019-11-06 08:37:42,040 ERROR: 963840 -- ['/usr/bin/podman', 'start', '-a', 'container-puppet-nova_placement'] run failed after Error: unable to find container container-puppet-nova_placement: no container with name or ID container-puppet-nova_placement found: no such container attempt(s): 2 2019-11-06 08:37:42,040 WARNING: 963840 -- Retrying running container: nova_placement 2019-11-06 08:37:45,148 ERROR: 963840 -- ['/usr/bin/podman', 'start', '-a', 'container-puppet-nova_placement'] run failed after Error: unable to find container container-puppet-nova_placement: no container with name or ID container-puppet-nova_placement found: no such container attempt(s): 3 2019-11-06 08:37:45,149 WARNING: 963840 -- Retrying running container: nova_placement 2019-11-06 08:37:45,149 ERROR: 963840 -- Failed running container for nova_placement 2019-11-06 08:37:45,149 INFO: 963840 -- Finished processing puppet configs for nova_placement 2019-11-06 08:37:45,150 ERROR: 963838 -- ERROR configuring nova_placement [root@undercloud common]# rpm -qa | grep tripleo-heat-templates openstack-tripleo-heat-templates-10.6.2-0.20191102040438.83bd596.el8ost.noarch [root@undercloud common]# cat /tmp/contianer-puppet.json [ { "config_image": "172.16.0.1:8787/rhosp15-rhel8/openstack-nova-placement-api:15.0-73", "config_volume": "nova_placement", "puppet_tags": "nova_config", "step_config": "include tripleo::profile::base::nova::placement\ninclude ::tripleo::profile::base::database::mysql::client" } ] [root@undercloud common]#
This issue presents as: 2019-11-06 05:22:21,289 p=15040 u=mistral | TASK [Start containers for step 4] ********************************************* 2019-11-06 05:22:21,289 p=15040 u=mistral | Wednesday 06 November 2019 05:22:21 -0500 (0:00:00.265) 0:30:35.957 **** 2019-11-06 05:24:09,464 p=15040 u=mistral | ok: [central-controller-1] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-06 05:24:12,184 p=15040 u=mistral | ok: [central-controller-2] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-06 05:24:15,084 p=15040 u=mistral | ok: [central-controller-0] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-11-06 05:24:15,164 p=15040 u=mistral | TASK [Debug output for task: Start containers for step 4] ********************** 2019-11-06 05:24:15,164 p=15040 u=mistral | Wednesday 06 November 2019 05:24:15 -0500 (0:01:53.874) 0:32:29.832 **** 2019-11-06 05:24:15,249 p=15040 u=mistral | fatal: [central-controller-0]: FAILED! => { "failed_when_result": true, "outputs.stdout_lines | default([]) | union(outputs.stderr_lines | default([]))": [ "stdout: 42d32709434380a345435f46d32e76ce63a0fdd0515316d5d600b496315a6c31", "", "stderr: Trying to pull 172.16.0.1:8787/rhosp15-rhel8/openstack-aodh-api:15.0-66...Getting image source signatures", "Copying blob sha256:a60e73ae88b1d89e3692266bef07acc59a73db24382fdd19fc273c32aa5e97fb", "Copying blob sha256:f87dfcac8eff5df8645ed06bc1809d522ce69d0280517d38d89a988b68bcc419", ... "Error running ['podman', 'run', '--name', 'nova_placement_wait_for_service', '--label', 'config_id=tripleo_step4', '--label', 'container_name=nova_placement_wait_for_service', '--label', 'managed_by=paunch', '--label', 'config_data={\"command\": \"/usr/bin/bootstrap_host_exec nova_placement su nova -s /bin/bash -c \\'/container-config-scripts/pyshim.sh /container-config-scripts/placement_wait_for_service.py\\'\", \"detach\": false, \"environment\": [\"__OS_DEBUG=false\"], \"image\": \"172.16.0.1:8787/rhosp15-rhel8/openstack-nova-placement-api:15.0-73\", \"net\": \"host\", \"privileged\": false, \"start_order\": 2, \"user\": \"root\", \"volumes\": [\"/etc/hosts:/etc/hosts:ro\", \"/etc/localtime:/etc/localtime:ro\", \"/etc/pki/ca-trust/extracted:/etc/pki/ca-trust/extracted:ro\", \"/etc/pki/ca-trust/source/anchors:/etc/pki/ca-trust/source/anchors:ro\", \"/etc/pki/tls/certs/ca-bundle.crt:/etc/pki/tls/certs/ca-bundle.crt:ro\", \"/etc/pki/tls/certs/ca-bundle.trust.crt:/etc/pki/tls/certs/ca-bundle.trust.crt:ro\", \"/etc/pki/tls/cert.pem:/etc/pki/tls/cert.pem:ro\", \"/dev/log:/dev/log\", \"/etc/ssh/ssh_known_hosts:/etc/ssh/ssh_known_hosts:ro\", \"/etc/puppet:/etc/puppet:ro\", \"/var/log/containers/nova:/var/log/nova:z\", \"/var/log/containers/httpd/nova-placement:/var/log/httpd:z\", \"/var/lib/container-config-scripts/:/container-config-scripts/:z\", \"/var/lib/config-data/nova_placement/etc/placement/:/etc/placement/:ro\"]}', '--conmon-pidfile=/var/run/nova_placement_wait_for_service.pid', '--log-driver', 'k8s-file', '--log-opt', 'path=/var/log/containers/stdouts/nova_placement_wait_for_service.log', '--env=__OS_DEBUG=false', '--net=host', '--privileged=false', '--user=root', '--volume=/etc/hosts:/etc/hosts:ro', '--volume=/etc/localtime:/etc/localtime:ro', '--volume=/etc/pki/ca-trust/extracted:/etc/pki/ca-trust/extracted:ro', '--volume=/etc/pki/ca-trust/source/anchors:/etc/pki/ca-trust/source/anchors:ro', '--volume=/etc/pki/tls/certs/ca-bundle.crt:/etc/pki/tls/certs/ca-bundle.crt:ro', '--volume=/etc/pki/tls/certs/ca-bundle.trust.crt:/etc/pki/tls/certs/ca-bundle.trust.crt:ro', '--volume=/etc/pki/tls/cert.pem:/etc/pki/tls/cert.pem:ro', '--volume=/dev/log:/dev/log', '--volume=/etc/ssh/ssh_known_hosts:/etc/ssh/ssh_known_hosts:ro', '--volume=/etc/puppet:/etc/puppet:ro', '--volume=/var/log/containers/nova:/var/log/nova:z', '--volume=/var/log/containers/httpd/nova-placement:/var/log/httpd:z', '--volume=/var/lib/container-config-scripts/:/container-config-scripts/:z', '--volume=/var/lib/config-data/nova_placement/etc/placement/:/etc/placement/:ro', '172.16.0.1:8787/rhosp15-rhel8/openstack-nova-placement-api:15.0-73', '/usr/bin/bootstrap_host_exec', 'nova_placement', 'su', 'nova', '-s', '/bin/bash', '-c', \"'/container-config-scripts/pyshim.sh\", \"/container-config-scripts/placement_wait_for_service.py'\"]. [125]", "stderr: Error: error checking path \"/var/lib/config-data/nova_placement/etc/placement/\": stat /var/lib/config-data/nova_placement/etc/placement/: no such file or directory", "stdout: 5510429c48f2b448d31f87b0781752c90aaf31144ee999a034d6d4242aea772b", "Created symlink /etc/systemd/system/multi-user.target.wants/tripleo_panko_api.service → /etc/systemd/system/tripleo_panko_api.service.", "stdout: cc81d75243ebbdc05b81e506b5d3cd09bf855b22710b2704479aa50d2b774dc9", "Created symlink /etc/systemd/system/multi-user.target.wants/tripleo_swift_proxy.service → /etc/systemd/system/tripleo_swift_proxy.service.", "stdout: Skipping execution since this is not the bootstrap node for this service.", "stdout: 2090b9ad9eb6bda9eafe97002682671e912ec9b40b78b2c3a9254c3834358c5c", "Created symlink /etc/systemd/system/multi-user.target.wants/tripleo_nova_api_cron.service → /etc/systemd/system/tripleo_nova_api_cron.service." ] }
Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory, and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHBA-2019:4030