Bug 1483756

Summary: Overcloud deploy fails with: IOError: [Errno 26] Text file busy: '/var/lib/docker-puppet/docker-puppet.sh'
Product: Red Hat OpenStack Reporter: Dan Yasny <dyasny>
Component: openstack-tripleoAssignee: Derek Higgins <derekh>
Status: CLOSED DUPLICATE QA Contact: Dan Yasny <dyasny>
Severity: urgent Docs Contact:
Priority: urgent    
Version: 12.0 (Pike)CC: aschultz, bfournie, derekh, dprince, dyasny, m.andre, mburns, mlammon, ohochman, racedoro, rhel-osp-director-maint, sasha, tvignaud
Target Milestone: ---Keywords: TestBlocker
Target Release: ---Flags: tvignaud: needinfo+
Hardware: x86_64   
OS: Linux   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2017-09-26 20:28:25 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 1434060    

Description Dan Yasny 2017-08-21 21:35:42 UTC
Description of problem:
overcloud deploy fails with $subj

Full heat deployment-show:

{ "status": "FAILED", "server_id": "331b7ef5-6f3c-433f-a069-33bbdbd19da5", "config_id": "4394b71a-5cf9-4523-94aa-6d26360e895c", "output_values": { "deploy_stdout": "
PLAY [localhost] ***************************************************************

TASK [Gathering Facts] *********************************************************
ok: [localhost]

TASK [Write the config_step hieradata] *****************************************
changed: [localhost]

TASK [Run puppet host configuration for step 1] ********************************
ok: [localhost]

TASK [debug] *******************************************************************
ok: [localhost] => {
 \"(outputs.stderr|default('')).split('\n')|union(outputs.stdout_lines|default([]))\": [
 \"exception: connect failed\", 
 \"Warning: Undefined variable 'deploy_config_name'; \", 
 \" (file & line not available)\", 
 \"Warning: This method is deprecated, please use the stdlib validate_legacy function, with Stdlib::Compat::Bool. There is further documentation for validate_legacy function in the README. at [\\"/etc/puppet/modules/ntp/manifests/init.pp\\", 54]:[\\"/etc/puppet/modules/tripleo/manifests/profile/base/time/ntp.pp\\", 29]\", 
 \" (at /etc/puppet/modules/stdlib/lib/puppet/functions/deprecation.rb:25:in `deprecation')\", 
 \"Warning: This method is deprecated, please use the stdlib validate_legacy function, with Stdlib::Compat::Absolute_Path. There is further documentation for validate_legacy function in the README. at [\\"/etc/puppet/modules/ntp/manifests/init.pp\\", 55]:[\\"/etc/puppet/modules/tripleo/manifests/profile/base/time/ntp.pp\\", 29]\", 
 \"Warning: This method is deprecated, please use the stdlib validate_legacy function, with Stdlib::Compat::String. There is further documentation for validate_legacy function in the README. at [\\"/etc/puppet/modules/ntp/manifests/init.pp\\", 56]:[\\"/etc/puppet/modules/tripleo/manifests/profile/base/time/ntp.pp\\", 29]\", 
 \"Warning: This method is deprecated, please use the stdlib validate_legacy function, with Stdlib::Compat::Array. There is further documentation for validate_legacy function in the README. at [\\"/etc/puppet/modules/ntp/manifests/init.pp\\", 66]:[\\"/etc/puppet/modules/tripleo/manifests/profile/base/time/ntp.pp\\", 29]\", 
 \"Warning: This method is deprecated, please use the stdlib validate_legacy function, with Pattern[]. There is further documentation for validate_legacy function in the README. at [\\"/etc/puppet/modules/ntp/manifests/init.pp\\", 68]:[\\"/etc/puppet/modules/tripleo/manifests/profile/base/time/ntp.pp\\", 29]\", 
 \"Warning: This method is deprecated, please use the stdlib validate_legacy function, with Stdlib::Compat::Numeric. There is further documentation for validate_legacy function in the README. at [\\"/etc/puppet/modules/ntp/manifests/init.pp\\", 76]:[\\"/etc/puppet/modules/tripleo/manifests/profile/base/time/ntp.pp\\", 29]\", 
 \"Warning: ModuleLoader: module 'ssh' has unresolved dependencies - it will only see those that are resolved. Use 'puppet module list --tree' to see information about modules\", 
 \"Warning: This method is deprecated, please use the stdlib validate_legacy function, with Stdlib::Compat::Hash. There is further documentation for validate_legacy function in the README. at [\\"/etc/puppet/modules/ssh/manifests/server.pp\\", 12]:[\\"/var/lib/tripleo-config/puppet_step_config.pp\\", 31]\", 
 \"Warning: ModuleLoader: module 'timezone' has unresolved dependencies - it will only see those that are resolved. Use 'puppet module list --tree' to see information about modules\", 
 \"Notice: hiera(): Cannot load backend module_data: cannot load such file -- hiera/backend/module_data_backend\", 
 \"Notice: Scope(Class[Tripleo::Firewall::Post]): At this stage, all network traffic is blocked.\", 
 \"Notice: Compiled catalog for controller-1.localdomain in environment production in 2.88 seconds\", 
 \"Notice: /Stage[main]/Tripleo::Profile::Base::Docker/Augeas[docker-sysconfig-options]/returns: executed successfully\", 
 \"Notice: /Stage[main]/Tripleo::Profile::Base::Docker/Augeas[docker-sysconfig-registry]/returns: executed successfully\", 
 \"Notice: /Stage[main]/Tripleo::Profile::Base::Docker/Augeas[docker-sysconfig-storage]/returns: executed successfully\", 
 \"Notice: /Stage[main]/Tripleo::Profile::Base::Docker/Service[docker]/ensure: ensure changed 'stopped' to 'running'\", 
 \"Notice: /Stage[main]/Tripleo::Profile::Base::Database::Mysql::Client/Augeas[tripleo-mysql-client-conf]/returns: executed successfully\", 
 \"Notice: /Stage[main]/Tripleo::Profile::Base::Time::Ntp/Service[chronyd]/ensure: ensure changed 'running' to 'stopped'\", 
 \"Notice: /Stage[main]/Ntp::Config/File[/etc/ntp.conf]/content: content changed '{md5}913c85f0fde85f83c2d6c030ecf259e9' to '{md5}d2b8ac2e6d83f5059a13b66de0fccc3e'\", 
 \"Notice: /Stage[main]/Ntp::Service/Service[ntp]/ensure: ensure changed 'stopped' to 'running'\", 
 \"Notice: /Stage[main]/Pacemaker::Service/Service[pcsd]/ensure: ensure changed 'stopped' to 'running'\", 
 \"Notice: /Stage[main]/Pacemaker::Service/Service[corosync]/enable: enable changed 'false' to 'true'\", 
 \"Notice: /Stage[main]/Pacemaker::Service/Service[pacemaker]/enable: enable changed 'false' to 'true'\", 
 \"Notice: /Stage[main]/Pacemaker::Corosync/User[hacluster]/password: changed password\", 
 \"Notice: /Stage[main]/Pacemaker::Corosync/User[hacluster]/groups: groups changed '' to ['haclient']\", 
 \"Notice: /Stage[main]/Pacemaker::Corosync/Exec[reauthenticate-across-all-nodes]: Triggered 'refresh' from 2 events\", 
 \"Notice: /Stage[main]/Pacemaker::Corosync/File[etc-pacemaker]/owner: owner changed 'root' to 'hacluster'\", 
 \"Notice: /Stage[main]/Pacemaker::Corosync/File[etc-pacemaker]/group: group changed 'root' to 'haclient'\", 
 \"Notice: /Stage[main]/Pacemaker::Corosync/File[etc-pacemaker]/mode: mode changed '0755' to '0750'\", 
 \"Notice: /Stage[main]/Pacemaker::Corosync/File[etc-pacemaker-authkey]/mode: mode changed '0400' to '0640'\", 
 \"Notice: /Stage[main]/Pacemaker::Corosync/Exec[wait-for-settle]/returns: executed successfully\", 
 \"Notice: /Stage[main]/Timezone/File[/etc/localtime]/target: target changed '../usr/share/zoneinfo/America/New_York' to '/usr/share/zoneinfo/UTC'\", 
 \"Notice: /Stage[main]/Firewall::Linux::Redhat/Exec[/usr/bin/systemctl daemon-reload]/returns: executed successfully\", 
 \"Notice: /Stage[main]/Firewall::Linux::Redhat/Service[iptables]/ensure: ensure changed 'stopped' to 'running'\", 
 \"Notice: /Stage[main]/Firewall::Linux::Redhat/Service[ip6tables]/ensure: ensure changed 'stopped' to 'running'\", 
 \"Notice: /Stage[main]/Tripleo::Profile::Base::Kernel/Kmod::Load[nf_conntrack]/File[/etc/sysconfig/modules/nf_conntrack.modules]/ensure: defined content as '{md5}69dc79067bb7ee8d7a8a12176ceddb02'\", 
 \"Notice: /Stage[main]/Tripleo::Profile::Base::Kernel/Kmod::Load[nf_conntrack_proto_sctp]/Exec[modprobe nf_conntrack_proto_sctp]/returns: executed successfully\", 
 \"Notice: /Stage[main]/Tripleo::Profile::Base::Kernel/Kmod::Load[nf_conntrack_proto_sctp]/File[/etc/sysconfig/modules/nf_conntrack_proto_sctp.modules]/ensure: defined content as '{md5}7dfc614157ed326e9943593a7aca37c9'\", 
 \"Notice: /Stage[main]/Tripleo::Profile::Base::Kernel/Sysctl::Value[fs.suid_dumpable]/Sysctl[fs.suid_dumpable]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Profile::Base::Kernel/Sysctl::Value[kernel.dmesg_restrict]/Sysctl[kernel.dmesg_restrict]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Profile::Base::Kernel/Sysctl::Value[kernel.dmesg_restrict]/Sysctl_runtime[kernel.dmesg_restrict]/val: val changed '0' to '1'\", 
 \"Notice: /Stage[main]/Tripleo::Profile::Base::Kernel/Sysctl::Value[kernel.pid_max]/Sysctl[kernel.pid_max]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Profile::Base::Kernel/Sysctl::Value[kernel.pid_max]/Sysctl_runtime[kernel.pid_max]/val: val changed '32768' to '1048576'\", 
 \"Notice: /Stage[main]/Tripleo::Profile::Base::Kernel/Sysctl::Value[net.core.netdev_max_backlog]/Sysctl[net.core.netdev_max_backlog]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Profile::Base::Kernel/Sysctl::Value[net.core.netdev_max_backlog]/Sysctl_runtime[net.core.netdev_max_backlog]/val: val changed '1000' to '10000'\", 
 \"Notice: /Stage[main]/Tripleo::Profile::Base::Kernel/Sysctl::Value[net.ipv4.conf.all.arp_accept]/Sysctl[net.ipv4.conf.all.arp_accept]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Profile::Base::Kernel/Sysctl::Value[net.ipv4.conf.all.arp_accept]/Sysctl_runtime[net.ipv4.conf.all.arp_accept]/val: val changed '0' to '1'\", 
 \"Notice: /Stage[main]/Tripleo::Profile::Base::Kernel/Sysctl::Value[net.ipv4.conf.all.log_martians]/Sysctl[net.ipv4.conf.all.log_martians]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Profile::Base::Kernel/Sysctl::Value[net.ipv4.conf.all.log_martians]/Sysctl_runtime[net.ipv4.conf.all.log_martians]/val: val changed '0' to '1'\", 
 \"Notice: /Stage[main]/Tripleo::Profile::Base::Kernel/Sysctl::Value[net.ipv4.conf.all.secure_redirects]/Sysctl[net.ipv4.conf.all.secure_redirects]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Profile::Base::Kernel/Sysctl::Value[net.ipv4.conf.all.secure_redirects]/Sysctl_runtime[net.ipv4.conf.all.secure_redirects]/val: val changed '1' to '0'\", 
 \"Notice: /Stage[main]/Tripleo::Profile::Base::Kernel/Sysctl::Value[net.ipv4.conf.all.send_redirects]/Sysctl[net.ipv4.conf.all.send_redirects]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Profile::Base::Kernel/Sysctl::Value[net.ipv4.conf.all.send_redirects]/Sysctl_runtime[net.ipv4.conf.all.send_redirects]/val: val changed '1' to '0'\", 
 \"Notice: /Stage[main]/Tripleo::Profile::Base::Kernel/Sysctl::Value[net.ipv4.conf.default.accept_redirects]/Sysctl[net.ipv4.conf.default.accept_redirects]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Profile::Base::Kernel/Sysctl::Value[net.ipv4.conf.default.accept_redirects]/Sysctl_runtime[net.ipv4.conf.default.accept_redirects]/val: val changed '1' to '0'\", 
 \"Notice: /Stage[main]/Tripleo::Profile::Base::Kernel/Sysctl::Value[net.ipv4.conf.default.log_martians]/Sysctl[net.ipv4.conf.default.log_martians]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Profile::Base::Kernel/Sysctl::Value[net.ipv4.conf.default.log_martians]/Sysctl_runtime[net.ipv4.conf.default.log_martians]/val: val changed '0' to '1'\", 
 \"Notice: /Stage[main]/Tripleo::Profile::Base::Kernel/Sysctl::Value[net.ipv4.conf.default.secure_redirects]/Sysctl[net.ipv4.conf.default.secure_redirects]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Profile::Base::Kernel/Sysctl::Value[net.ipv4.conf.default.secure_redirects]/Sysctl_runtime[net.ipv4.conf.default.secure_redirects]/val: val changed '1' to '0'\", 
 \"Notice: /Stage[main]/Tripleo::Profile::Base::Kernel/Sysctl::Value[net.ipv4.conf.default.send_redirects]/Sysctl[net.ipv4.conf.default.send_redirects]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Profile::Base::Kernel/Sysctl::Value[net.ipv4.conf.default.send_redirects]/Sysctl_runtime[net.ipv4.conf.default.send_redirects]/val: val changed '1' to '0'\", 
 \"Notice: /Stage[main]/Tripleo::Profile::Base::Kernel/Sysctl::Value[net.ipv4.neigh.default.gc_thresh1]/Sysctl[net.ipv4.neigh.default.gc_thresh1]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Profile::Base::Kernel/Sysctl::Value[net.ipv4.neigh.default.gc_thresh1]/Sysctl_runtime[net.ipv4.neigh.default.gc_thresh1]/val: val changed '128' to '1024'\", 
 \"Notice: /Stage[main]/Tripleo::Profile::Base::Kernel/Sysctl::Value[net.ipv4.neigh.default.gc_thresh2]/Sysctl[net.ipv4.neigh.default.gc_thresh2]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Profile::Base::Kernel/Sysctl::Value[net.ipv4.neigh.default.gc_thresh2]/Sysctl_runtime[net.ipv4.neigh.default.gc_thresh2]/val: val changed '512' to '2048'\", 
 \"Notice: /Stage[main]/Tripleo::Profile::Base::Kernel/Sysctl::Value[net.ipv4.neigh.default.gc_thresh3]/Sysctl[net.ipv4.neigh.default.gc_thresh3]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Profile::Base::Kernel/Sysctl::Value[net.ipv4.neigh.default.gc_thresh3]/Sysctl_runtime[net.ipv4.neigh.default.gc_thresh3]/val: val changed '1024' to '4096'\", 
 \"Notice: /Stage[main]/Tripleo::Profile::Base::Kernel/Sysctl::Value[net.ipv4.tcp_keepalive_intvl]/Sysctl[net.ipv4.tcp_keepalive_intvl]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Profile::Base::Kernel/Sysctl::Value[net.ipv4.tcp_keepalive_intvl]/Sysctl_runtime[net.ipv4.tcp_keepalive_intvl]/val: val changed '75' to '1'\", 
 \"Notice: /Stage[main]/Tripleo::Profile::Base::Kernel/Sysctl::Value[net.ipv4.tcp_keepalive_probes]/Sysctl[net.ipv4.tcp_keepalive_probes]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Profile::Base::Kernel/Sysctl::Value[net.ipv4.tcp_keepalive_probes]/Sysctl_runtime[net.ipv4.tcp_keepalive_probes]/val: val changed '9' to '5'\", 
 \"Notice: /Stage[main]/Tripleo::Profile::Base::Kernel/Sysctl::Value[net.ipv4.tcp_keepalive_time]/Sysctl[net.ipv4.tcp_keepalive_time]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Profile::Base::Kernel/Sysctl::Value[net.ipv4.tcp_keepalive_time]/Sysctl_runtime[net.ipv4.tcp_keepalive_time]/val: val changed '7200' to '5'\", 
 \"Notice: /Stage[main]/Tripleo::Profile::Base::Kernel/Sysctl::Value[net.ipv6.conf.all.accept_ra]/Sysctl[net.ipv6.conf.all.accept_ra]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Profile::Base::Kernel/Sysctl::Value[net.ipv6.conf.all.accept_ra]/Sysctl_runtime[net.ipv6.conf.all.accept_ra]/val: val changed '1' to '0'\", 
 \"Notice: /Stage[main]/Tripleo::Profile::Base::Kernel/Sysctl::Value[net.ipv6.conf.all.accept_redirects]/Sysctl[net.ipv6.conf.all.accept_redirects]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Profile::Base::Kernel/Sysctl::Value[net.ipv6.conf.all.accept_redirects]/Sysctl_runtime[net.ipv6.conf.all.accept_redirects]/val: val changed '1' to '0'\", 
 \"Notice: /Stage[main]/Tripleo::Profile::Base::Kernel/Sysctl::Value[net.ipv6.conf.all.autoconf]/Sysctl[net.ipv6.conf.all.autoconf]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Profile::Base::Kernel/Sysctl::Value[net.ipv6.conf.all.autoconf]/Sysctl_runtime[net.ipv6.conf.all.autoconf]/val: val changed '1' to '0'\", 
 \"Notice: /Stage[main]/Tripleo::Profile::Base::Kernel/Sysctl::Value[net.ipv6.conf.all.disable_ipv6]/Sysctl[net.ipv6.conf.all.disable_ipv6]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Profile::Base::Kernel/Sysctl::Value[net.ipv6.conf.default.accept_ra]/Sysctl[net.ipv6.conf.default.accept_ra]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Profile::Base::Kernel/Sysctl::Value[net.ipv6.conf.default.accept_ra]/Sysctl_runtime[net.ipv6.conf.default.accept_ra]/val: val changed '1' to '0'\", 
 \"Notice: /Stage[main]/Tripleo::Profile::Base::Kernel/Sysctl::Value[net.ipv6.conf.default.accept_redirects]/Sysctl[net.ipv6.conf.default.accept_redirects]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Profile::Base::Kernel/Sysctl::Value[net.ipv6.conf.default.accept_redirects]/Sysctl_runtime[net.ipv6.conf.default.accept_redirects]/val: val changed '1' to '0'\", 
 \"Notice: /Stage[main]/Tripleo::Profile::Base::Kernel/Sysctl::Value[net.ipv6.conf.default.autoconf]/Sysctl[net.ipv6.conf.default.autoconf]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Profile::Base::Kernel/Sysctl::Value[net.ipv6.conf.default.autoconf]/Sysctl_runtime[net.ipv6.conf.default.autoconf]/val: val changed '1' to '0'\", 
 \"Notice: /Stage[main]/Tripleo::Profile::Base::Kernel/Sysctl::Value[net.ipv6.conf.default.disable_ipv6]/Sysctl[net.ipv6.conf.default.disable_ipv6]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Profile::Base::Kernel/Sysctl::Value[net.netfilter.nf_conntrack_max]/Sysctl[net.netfilter.nf_conntrack_max]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Profile::Base::Kernel/Sysctl::Value[net.netfilter.nf_conntrack_max]/Sysctl_runtime[net.netfilter.nf_conntrack_max]/val: val changed '262144' to '500000'\", 
 \"Notice: /Stage[main]/Tripleo::Profile::Base::Kernel/Sysctl::Value[net.nf_conntrack_max]/Sysctl[net.nf_conntrack_max]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Profile::Base::Kernel/Sysctl::Value[net.nf_conntrack_max]/Sysctl_runtime[net.nf_conntrack_max]/val: val changed '262144' to '500000'\", 
 \"Notice: /Stage[main]/Ssh::Server::Config/Concat[/etc/ssh/sshd_config]/File[/etc/ssh/sshd_config]/content: content changed '{md5}9b71d785c3744799a1e819901183d492' to '{md5}94ad982da674b1094a49a0f26a7c6988'\", 
 \"Notice: /Stage[main]/Ssh::Server::Service/Service[sshd]: Triggered 'refresh' from 2 events\", 
 \"Notice: /Stage[main]/Tripleo::Firewall::Pre/Tripleo::Firewall::Rule[000 accept related established rules]/Firewall[000 accept related established rules ipv4]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall::Pre/Tripleo::Firewall::Rule[000 accept related established rules]/Firewall[000 accept related established rules ipv6]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall::Pre/Tripleo::Firewall::Rule[001 accept all icmp]/Firewall[001 accept all icmp ipv4]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall::Pre/Tripleo::Firewall::Rule[001 accept all icmp]/Firewall[001 accept all icmp ipv6]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall::Pre/Tripleo::Firewall::Rule[002 accept all to lo interface]/Firewall[002 accept all to lo interface ipv4]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall::Pre/Tripleo::Firewall::Rule[002 accept all to lo interface]/Firewall[002 accept all to lo interface ipv6]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall::Pre/Tripleo::Firewall::Rule[003 accept ssh]/Firewall[003 accept ssh ipv4]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall::Pre/Tripleo::Firewall::Rule[003 accept ssh]/Firewall[003 accept ssh ipv6]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall::Pre/Tripleo::Firewall::Rule[004 accept ipv6 dhcpv6]/Firewall[004 accept ipv6 dhcpv6 ipv6]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall::Post/Tripleo::Firewall::Rule[998 log all]/Firewall[998 log all ipv4]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall::Post/Tripleo::Firewall::Rule[998 log all]/Firewall[998 log all ipv6]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall::Post/Tripleo::Firewall::Rule[999 drop all]/Firewall[999 drop all ipv4]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall::Post/Tripleo::Firewall::Rule[999 drop all]/Firewall[999 drop all ipv6]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[aodh_api]/Tripleo::Firewall::Rule[128 aodh-api]/Firewall[128 aodh-api ipv4]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[aodh_api]/Tripleo::Firewall::Rule[128 aodh-api]/Firewall[128 aodh-api ipv6]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[cinder_api]/Tripleo::Firewall::Rule[119 cinder]/Firewall[119 cinder ipv4]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[cinder_api]/Tripleo::Firewall::Rule[119 cinder]/Firewall[119 cinder ipv6]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[cinder_volume]/Tripleo::Firewall::Rule[120 iscsi initiator]/Firewall[120 iscsi initiator ipv4]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[cinder_volume]/Tripleo::Firewall::Rule[120 iscsi initiator]/Firewall[120 iscsi initiator ipv6]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[glance_api]/Tripleo::Firewall::Rule[112 glance_api]/Firewall[112 glance_api ipv4]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[glance_api]/Tripleo::Firewall::Rule[112 glance_api]/Firewall[112 glance_api ipv6]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[gnocchi_api]/Tripleo::Firewall::Rule[129 gnocchi-api]/Firewall[129 gnocchi-api ipv4]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[gnocchi_api]/Tripleo::Firewall::Rule[129 gnocchi-api]/Firewall[129 gnocchi-api ipv6]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[gnocchi_statsd]/Tripleo::Firewall::Rule[140 gnocchi-statsd]/Firewall[140 gnocchi-statsd ipv4]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[gnocchi_statsd]/Tripleo::Firewall::Rule[140 gnocchi-statsd]/Firewall[140 gnocchi-statsd ipv6]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[haproxy]/Tripleo::Firewall::Rule[107 haproxy stats]/Firewall[107 haproxy stats ipv4]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[haproxy]/Tripleo::Firewall::Rule[107 haproxy stats]/Firewall[107 haproxy stats ipv6]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[heat_api]/Tripleo::Firewall::Rule[125 heat_api]/Firewall[125 heat_api ipv4]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[heat_api]/Tripleo::Firewall::Rule[125 heat_api]/Firewall[125 heat_api ipv6]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[heat_api_cfn]/Tripleo::Firewall::Rule[125 heat_cfn]/Firewall[125 heat_cfn ipv4]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[heat_api_cfn]/Tripleo::Firewall::Rule[125 heat_cfn]/Firewall[125 heat_cfn ipv6]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[heat_api_cloudwatch]/Tripleo::Firewall::Rule[125 heat_cloudwatch]/Firewall[125 heat_cloudwatch ipv4]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[heat_api_cloudwatch]/Tripleo::Firewall::Rule[125 heat_cloudwatch]/Firewall[125 heat_cloudwatch ipv6]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[horizon]/Tripleo::Firewall::Rule[127 horizon]/Firewall[127 horizon ipv4]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[horizon]/Tripleo::Firewall::Rule[127 horizon]/Firewall[127 horizon ipv6]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[ironic_api]/Tripleo::Firewall::Rule[133 ironic api]/Firewall[133 ironic api ipv4]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[ironic_api]/Tripleo::Firewall::Rule[133 ironic api]/Firewall[133 ironic api ipv6]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[ironic_conductor]/Tripleo::Firewall::Rule[134 ironic conductor TFTP]/Firewall[134 ironic conductor TFTP ipv4]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[ironic_conductor]/Tripleo::Firewall::Rule[134 ironic conductor TFTP]/Firewall[134 ironic conductor TFTP ipv6]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[ironic_conductor]/Tripleo::Firewall::Rule[135 ironic conductor HTTP]/Firewall[135 ironic conductor HTTP ipv4]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[ironic_conductor]/Tripleo::Firewall::Rule[135 ironic conductor HTTP]/Firewall[135 ironic conductor HTTP ipv6]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[keystone]/Tripleo::Firewall::Rule[111 keystone]/Firewall[111 keystone ipv4]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[keystone]/Tripleo::Firewall::Rule[111 keystone]/Firewall[111 keystone ipv6]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[memcached]/Tripleo::Firewall::Rule[121 memcached]/Firewall[121 memcached ipv4]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[memcached]/Tripleo::Firewall::Rule[121 memcached]/Firewall[121 memcached ipv6]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[mongodb]/Tripleo::Firewall::Rule[101 mongodb_config]/Firewall[101 mongodb_config ipv4]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[mongodb]/Tripleo::Firewall::Rule[101 mongodb_config]/Firewall[101 mongodb_config ipv6]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[mongodb]/Tripleo::Firewall::Rule[102 mongodb_sharding]/Firewall[102 mongodb_sharding ipv4]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[mongodb]/Tripleo::Firewall::Rule[102 mongodb_sharding]/Firewall[102 mongodb_sharding ipv6]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[mongodb]/Tripleo::Firewall::Rule[103 mongod]/Firewall[103 mongod ipv4]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[mongodb]/Tripleo::Firewall::Rule[103 mongod]/Firewall[103 mongod ipv6]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[mysql]/Tripleo::Firewall::Rule[104 mysql galera-bundle]/Firewall[104 mysql galera-bundle ipv4]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[mysql]/Tripleo::Firewall::Rule[104 mysql galera-bundle]/Firewall[104 mysql galera-bundle ipv6]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[neutron_api]/Tripleo::Firewall::Rule[114 neutron api]/Firewall[114 neutron api ipv4]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[neutron_api]/Tripleo::Firewall::Rule[114 neutron api]/Firewall[114 neutron api ipv6]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[neutron_dhcp]/Tripleo::Firewall::Rule[115 neutron dhcp input]/Firewall[115 neutron dhcp input ipv4]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[neutron_dhcp]/Tripleo::Firewall::Rule[115 neutron dhcp input]/Firewall[115 neutron dhcp input ipv6]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[neutron_dhcp]/Tripleo::Firewall::Rule[116 neutron dhcp output]/Firewall[116 neutron dhcp output ipv4]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[neutron_dhcp]/Tripleo::Firewall::Rule[116 neutron dhcp output]/Firewall[116 neutron dhcp output ipv6]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[neutron_l3]/Tripleo::Firewall::Rule[106 neutron_l3 vrrp]/Firewall[106 neutron_l3 vrrp ipv4]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[neutron_l3]/Tripleo::Firewall::Rule[106 neutron_l3 vrrp]/Firewall[106 neutron_l3 vrrp ipv6]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[neutron_ovs_agent]/Tripleo::Firewall::Rule[118 neutron vxlan networks]/Firewall[118 neutron vxlan networks ipv4]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[neutron_ovs_agent]/Tripleo::Firewall::Rule[118 neutron vxlan networks]/Firewall[118 neutron vxlan networks ipv6]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[neutron_ovs_agent]/Tripleo::Firewall::Rule[136 neutron gre networks]/Firewall[136 neutron gre networks ipv4]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[neutron_ovs_agent]/Tripleo::Firewall::Rule[136 neutron gre networks]/Firewall[136 neutron gre networks ipv6]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[nova_api]/Tripleo::Firewall::Rule[113 nova_api]/Firewall[113 nova_api ipv4]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[nova_api]/Tripleo::Firewall::Rule[113 nova_api]/Firewall[113 nova_api ipv6]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[nova_placement]/Tripleo::Firewall::Rule[138 nova_placement]/Firewall[138 nova_placement ipv4]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[nova_placement]/Tripleo::Firewall::Rule[138 nova_placement]/Firewall[138 nova_placement ipv6]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[nova_vnc_proxy]/Tripleo::Firewall::Rule[137 nova_vnc_proxy]/Firewall[137 nova_vnc_proxy ipv4]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[nova_vnc_proxy]/Tripleo::Firewall::Rule[137 nova_vnc_proxy]/Firewall[137 nova_vnc_proxy ipv6]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[ntp]/Tripleo::Firewall::Rule[105 ntp]/Firewall[105 ntp ipv4]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[ntp]/Tripleo::Firewall::Rule[105 ntp]/Firewall[105 ntp ipv6]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[pacemaker]/Tripleo::Firewall::Rule[130 pacemaker tcp]/Firewall[130 pacemaker tcp ipv4]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[pacemaker]/Tripleo::Firewall::Rule[130 pacemaker tcp]/Firewall[130 pacemaker tcp ipv6]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[pacemaker]/Tripleo::Firewall::Rule[131 pacemaker udp]/Firewall[131 pacemaker udp ipv4]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[pacemaker]/Tripleo::Firewall::Rule[131 pacemaker udp]/Firewall[131 pacemaker udp ipv6]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[panko_api]/Tripleo::Firewall::Rule[140 panko-api]/Firewall[140 panko-api ipv4]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[panko_api]/Tripleo::Firewall::Rule[140 panko-api]/Firewall[140 panko-api ipv6]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[rabbitmq]/Tripleo::Firewall::Rule[109 rabbitmq-bundle]/Firewall[109 rabbitmq-bundle ipv4]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[rabbitmq]/Tripleo::Firewall::Rule[109 rabbitmq-bundle]/Firewall[109 rabbitmq-bundle ipv6]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[redis]/Tripleo::Firewall::Rule[108 redis-bundle]/Firewall[108 redis-bundle ipv4]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[redis]/Tripleo::Firewall::Rule[108 redis-bundle]/Firewall[108 redis-bundle ipv6]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[snmp]/Tripleo::Firewall::Rule[127 snmp]/Firewall[127 snmp ipv4]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[snmp]/Tripleo::Firewall::Rule[127 snmp]/Firewall[127 snmp ipv6]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[swift_proxy]/Tripleo::Firewall::Rule[122 swift proxy]/Firewall[122 swift proxy ipv4]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[swift_proxy]/Tripleo::Firewall::Rule[122 swift proxy]/Firewall[122 swift proxy ipv6]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[swift_storage]/Tripleo::Firewall::Rule[123 swift storage]/Firewall[123 swift storage ipv4]/ensure: created\", 
 \"Notice: /Stage[main]/Tripleo::Firewall/Tripleo::Firewall::Service_rules[swift_storage]/Tripleo::Firewall::Rule[123 swift storage]/Firewall[123 swift storage ipv6]/ensure: created\", 
 \"Notice: /Stage[main]/Firewall::Linux::Redhat/File[/etc/sysconfig/iptables]/seltype: seltype changed 'etc_t' to 'system_conf_t'\", 
 \"Notice: /Stage[main]/Firewall::Linux::Redhat/File[/etc/sysconfig/ip6tables]/seltype: seltype changed 'etc_t' to 'system_conf_t'\", 
 \"Notice: Applied catalog in 79.80 seconds\"
 ], 
 \"failed\": false, 
 \"failed_when_result\": false
}

TASK [Run docker-puppet tasks (generate config)] *******************************
ok: [localhost]

TASK [debug] *******************************************************************
fatal: [localhost]: FAILED! => {
 \"(outputs.stderr|default('')).split('\n')|union(outputs.stdout_lines|default([]))\": [
 \"Traceback (most recent call last):\", 
 \" File \\"/var/lib/docker-puppet/docker-puppet.py\\", line 337, in <module>\", 
 \" returncodes = list(p.map(mp_puppet_config, process_map))\", 
 \" File \\"/usr/lib64/python2.7/multiprocessing/pool.py\\", line 250, in map\", 
 \" return self.map_async(func, iterable, chunksize).get()\", 
 \" File \\"/usr/lib64/python2.7/multiprocessing/pool.py\\", line 554, in get\", 
 \" raise self._value\", 
 \"IOError: [Errno 26] Text file busy: '/var/lib/docker-puppet/docker-puppet.sh'\", 
 \"2017-08-21 21:15:48,227 INFO: 23997 -- Running docker-puppet\", 
 \"2017-08-21 21:15:48,228 INFO: 23997 -- config_volume aodh\", 
 \"2017-08-21 21:15:48,228 INFO: 23997 -- puppet_tags aodh_api_paste_ini,aodh_config\", 
 \"2017-08-21 21:15:48,228 INFO: 23997 -- manifest include tripleo::profile::base::aodh::api\", 
 \"\", 
 \"include ::tripleo::profile::base::database::mysql::client\", 
 \"2017-08-21 21:15:48,228 INFO: 23997 -- config_image 192.168.24.1:8787/rhosp12/openstack-aodh-api-docker:2017-08-18.2\", 
 \"2017-08-21 21:15:48,228 INFO: 23997 -- volumes []\", 
 \"2017-08-21 21:15:48,228 INFO: 23997 -- Adding new service\", 
 \"2017-08-21 21:15:48,229 INFO: 23997 -- config_volume aodh\", 
 \"2017-08-21 21:15:48,229 INFO: 23997 -- puppet_tags aodh_config\", 
 \"2017-08-21 21:15:48,229 INFO: 23997 -- manifest include tripleo::profile::base::aodh::evaluator\", 
 \"2017-08-21 21:15:48,229 INFO: 23997 -- config_image 192.168.24.1:8787/rhosp12/openstack-aodh-api-docker:2017-08-18.2\", 
 \"2017-08-21 21:15:48,229 INFO: 23997 -- volumes []\", 
 \"2017-08-21 21:15:48,229 INFO: 23997 -- Existing service, appending puppet tags and manifest\", 
 \"2017-08-21 21:15:48,229 INFO: 23997 -- manifest include tripleo::profile::base::aodh::listener\", 
 \"2017-08-21 21:15:48,229 INFO: 23997 -- manifest include tripleo::profile::base::aodh::notifier\", 
 \"2017-08-21 21:15:48,230 INFO: 23997 -- config_volume ceilometer\", 
 \"2017-08-21 21:15:48,230 INFO: 23997 -- puppet_tags ceilometer_config\", 
 \"2017-08-21 21:15:48,230 INFO: 23997 -- manifest include ::tripleo::profile::base::ceilometer::agent::polling\", 
 \"2017-08-21 21:15:48,230 INFO: 23997 -- config_image 192.168.24.1:8787/rhosp12/openstack-ceilometer-central-docker:2017-08-18.2\", 
 \"2017-08-21 21:15:48,230 INFO: 23997 -- volumes []\", 
 \"2017-08-21 21:15:48,230 INFO: 23997 -- Adding new service\", 
 \"2017-08-21 21:15:48,230 INFO: 23997 -- manifest include ::tripleo::profile::base::ceilometer::agent::notification\", 
 \"2017-08-21 21:15:48,230 INFO: 23997 -- Existing service, appending puppet tags and manifest\", 
 \"2017-08-21 21:15:48,230 INFO: 23997 -- config_volume clustercheck\", 
 \"2017-08-21 21:15:48,230 INFO: 23997 -- puppet_tags file\", 
 \"2017-08-21 21:15:48,230 INFO: 23997 -- manifest include ::tripleo::profile::pacemaker::clustercheck\", 
 \"2017-08-21 21:15:48,230 INFO: 23997 -- config_image 192.168.24.1:8787/rhosp12/openstack-mariadb-docker:2017-08-18.2\", 
 \"2017-08-21 21:15:48,230 INFO: 23997 -- config_volume glance_api\", 
 \"2017-08-21 21:15:48,230 INFO: 23997 -- puppet_tags glance_api_config,glance_api_paste_ini,glance_swift_config,glance_cache_config\", 
 \"2017-08-21 21:15:48,231 INFO: 23997 -- manifest include ::tripleo::profile::base::glance::api\", 
 \"2017-08-21 21:15:48,231 INFO: 23997 -- config_image 192.168.24.1:8787/rhosp12/openstack-glance-api-docker:2017-08-18.2\", 
 \"2017-08-21 21:15:48,231 INFO: 23997 -- volumes []\", 
 \"2017-08-21 21:15:48,231 INFO: 23997 -- Adding new service\", 
 \"2017-08-21 21:15:48,231 INFO: 23997 -- config_volume gnocchi\", 
 \"2017-08-21 21:15:48,231 INFO: 23997 -- puppet_tags gnocchi_api_paste_ini,gnocchi_config\", 
 \"2017-08-21 21:15:48,231 INFO: 23997 -- manifest include ::tripleo::profile::base::gnocchi::api\", 
 \"2017-08-21 21:15:48,231 INFO: 23997 -- config_image 192.168.24.1:8787/rhosp12/openstack-gnocchi-api-docker:2017-08-18.2\", 
 \"2017-08-21 21:15:48,231 INFO: 23997 -- puppet_tags gnocchi_config\", 
 \"2017-08-21 21:15:48,231 INFO: 23997 -- manifest include ::tripleo::profile::base::gnocchi::metricd\", 
 \"2017-08-21 21:15:48,231 INFO: 23997 -- Existing service, appending puppet tags and manifest\", 
 \"2017-08-21 21:15:48,231 INFO: 23997 -- manifest include ::tripleo::profile::base::gnocchi::statsd\", 
 \"2017-08-21 21:15:48,232 INFO: 23997 -- config_image 192.168.24.1:8787/rhosp12/openstack-gnocchi-api-docker:2017-08-18.2\", 
 \"2017-08-21 21:15:48,232 INFO: 23997 -- volumes []\", 
 \"2017-08-21 21:15:48,232 INFO: 23997 -- Existing service, appending puppet tags and manifest\", 
 \"2017-08-21 21:15:48,232 INFO: 23997 -- config_volume haproxy\", 
 \"2017-08-21 21:15:48,232 INFO: 23997 -- puppet_tags haproxy_config\", 
 \"2017-08-21 21:15:48,232 INFO: 23997 -- manifest exec {'wait-for-settle': command => '/bin/true' }\", 
 \"class tripleo::firewall(){}; define tripleo::firewall::rule( $port = undef, $dport = undef, $sport = undef, $proto = undef, $action = undef, $state = undef, $source = undef, $iniface = undef, $chain = undef, $destination = undef, $extras = undef){}\", 
 \"['pcmk_bundle', 'pcmk_resource', 'pcmk_property', 'pcmk_constraint', 'pcmk_resource_default'].each |String $val| { noop_resource($val) }\", 
 \"include ::tripleo::profile::pacemaker::haproxy_bundle\", 
 \"2017-08-21 21:15:48,232 INFO: 23997 -- config_image 192.168.24.1:8787/rhosp12/openstack-haproxy-docker:2017-08-18.2\", 
 \"2017-08-21 21:15:48,232 INFO: 23997 -- volumes [u'/etc/pki/tls/private/overcloud_endpoint.pem:/etc/pki/tls/private/overcloud_endpoint.pem:ro']\", 
 \"2017-08-21 21:15:48,232 INFO: 23997 -- Adding new service\", 
 \"2017-08-21 21:15:48,232 INFO: 23997 -- config_volume heat_api\", 
 \"2017-08-21 21:15:48,232 INFO: 23997 -- puppet_tags heat_config,file,concat,file_line\", 
 \"2017-08-21 21:15:48,232 INFO: 23997 -- manifest include ::tripleo::profile::base::heat::api\", 
 \"2017-08-21 21:15:48,232 INFO: 23997 -- config_image 192.168.24.1:8787/rhosp12/openstack-heat-api-docker:2017-08-18.2\", 
 \"2017-08-21 21:15:48,232 INFO: 23997 -- config_volume heat_api_cfn\", 
 \"2017-08-21 21:15:48,232 INFO: 23997 -- manifest include ::tripleo::profile::base::heat::api_cfn\", 
 \"2017-08-21 21:15:48,232 INFO: 23997 -- config_image 192.168.24.1:8787/rhosp12/openstack-heat-api-cfn-docker:2017-08-18.2\", 
 \"2017-08-21 21:15:48,233 INFO: 23997 -- volumes []\", 
 \"2017-08-21 21:15:48,233 INFO: 23997 -- Adding new service\", 
 \"2017-08-21 21:15:48,233 INFO: 23997 -- config_volume heat\", 
 \"2017-08-21 21:15:48,233 INFO: 23997 -- puppet_tags heat_config,file,concat,file_line\", 
 \"2017-08-21 21:15:48,233 INFO: 23997 -- manifest include ::tripleo::profile::base::heat::engine\", 
 \"2017-08-21 21:15:48,233 INFO: 23997 -- config_image 192.168.24.1:8787/rhosp12/openstack-heat-api-docker:2017-08-18.2\", 
 \"2017-08-21 21:15:48,233 INFO: 23997 -- config_volume horizon\", 
 \"2017-08-21 21:15:48,233 INFO: 23997 -- puppet_tags horizon_config\", 
 \"2017-08-21 21:15:48,233 INFO: 23997 -- manifest include ::tripleo::profile::base::horizon\", 
 \"2017-08-21 21:15:48,233 INFO: 23997 -- config_image 192.168.24.1:8787/rhosp12/openstack-horizon-docker:2017-08-18.2\", 
 \"2017-08-21 21:15:48,233 INFO: 23997 -- config_volume ironic_api\", 
 \"2017-08-21 21:15:48,233 INFO: 23997 -- puppet_tags ironic_config\", 
 \"2017-08-21 21:15:48,233 INFO: 23997 -- manifest include ::tripleo::profile::base::ironic::api\", 
 \"2017-08-21 21:15:48,233 INFO: 23997 -- config_image 192.168.24.1:8787/rhosp12/openstack-ironic-api-docker:2017-08-18.2\", 
 \"2017-08-21 21:15:48,234 INFO: 23997 -- Adding new service\", 
 \"2017-08-21 21:15:48,234 INFO: 23997 -- config_volume ironic\", 
 \"2017-08-21 21:15:48,234 INFO: 23997 -- puppet_tags ironic_config\", 
 \"2017-08-21 21:15:48,234 INFO: 23997 -- manifest include ::tripleo::profile::base::ironic::conductor\", 
 \"2017-08-21 21:15:48,234 INFO: 23997 -- config_image 192.168.24.1:8787/rhosp12/openstack-ironic-pxe-docker:2017-08-18.2\", 
 \"2017-08-21 21:15:48,234 INFO: 23997 -- volumes []\", 
 \"2017-08-21 21:15:48,234 INFO: 23997 -- config_volume iscsid\", 
 \"2017-08-21 21:15:48,234 INFO: 23997 -- puppet_tags iscsid_config\", 
 \"2017-08-21 21:15:48,234 INFO: 23997 -- manifest include ::tripleo::profile::base::iscsid\", 
 \"2017-08-21 21:15:48,234 INFO: 23997 -- config_image 192.168.24.1:8787/rhosp12/openstack-iscsid-docker:2017-08-18.2\", 
 \"2017-08-21 21:15:48,234 INFO: 23997 -- config_volume keystone\", 
 \"2017-08-21 21:15:48,234 INFO: 23997 -- puppet_tags keystone_config\", 
 \"2017-08-21 21:15:48,234 INFO: 23997 -- manifest ['Keystone_user', 'Keystone_endpoint', 'Keystone_domain', 'Keystone_tenant', 'Keystone_user_role', 'Keystone_role', 'Keystone_service'].each |String $val| { noop_resource($val) }\", 
 \"include ::tripleo::profile::base::keystone\", 
 \"2017-08-21 21:15:48,234 INFO: 23997 -- config_image 192.168.24.1:8787/rhosp12/openstack-keystone-docker:2017-08-18.2\", 
 \"2017-08-21 21:15:48,235 INFO: 23997 -- config_volume memcached\", 
 \"2017-08-21 21:15:48,235 INFO: 23997 -- puppet_tags file\", 
 \"2017-08-21 21:15:48,235 INFO: 23997 -- manifest include ::tripleo::profile::base::memcached\", 
 \"2017-08-21 21:15:48,235 INFO: 23997 -- config_image 192.168.24.1:8787/rhosp12/openstack-memcached-docker:2017-08-18.2\", 
 \"2017-08-21 21:15:48,235 INFO: 23997 -- volumes []\", 
 \"2017-08-21 21:15:48,235 INFO: 23997 -- Adding new service\", 
 \"2017-08-21 21:15:48,235 INFO: 23997 -- config_volume mongodb\", 
 \"2017-08-21 21:15:48,235 INFO: 23997 -- manifest ['Mongodb_database', 'Mongodb_user', 'Mongodb_replset'].each |String $val| { noop_resource($val) }\", 
 \"include ::tripleo::profile::base::database::mongodb\", 
 \"2017-08-21 21:15:48,235 INFO: 23997 -- config_image 192.168.24.1:8787/rhosp12/openstack-mongodb-docker:2017-08-18.2\", 
 \"2017-08-21 21:15:48,235 INFO: 23997 -- config_volume mysql\", 
 \"2017-08-21 21:15:48,235 INFO: 23997 -- manifest ['Mysql_datadir', 'Mysql_user', 'Mysql_database', 'Mysql_grant', 'Mysql_plugin'].each |String $val| { noop_resource($val) }\", 
 \"exec {'wait-for-settle': command => '/bin/true' }\", 
 \"include ::tripleo::profile::pacemaker::database::mysql_bundle\", 
 \"2017-08-21 21:15:48,235 INFO: 23997 -- config_image 192.168.24.1:8787/rhosp12/openstack-mariadb-docker:2017-08-18.2\", 
 \"2017-08-21 21:15:48,236 INFO: 23997 -- Adding new service\", 
 \"2017-08-21 21:15:48,236 INFO: 23997 -- config_volume nova\", 
 \"2017-08-21 21:15:48,236 INFO: 23997 -- puppet_tags nova_config\", 
 \"2017-08-21 21:15:48,236 INFO: 23997 -- manifest ['Nova_cell_v2'].each |String $val| { noop_resource($val) }\", 
 \"include tripleo::profile::base::nova::api\", 
 \"2017-08-21 21:15:48,236 INFO: 23997 -- config_image 192.168.24.1:8787/rhosp12/openstack-nova-base-docker:2017-08-18.2\", 
 \"2017-08-21 21:15:48,236 INFO: 23997 -- volumes []\", 
 \"2017-08-21 21:15:48,236 INFO: 23997 -- manifest include tripleo::profile::base::nova::conductor\", 
 \"2017-08-21 21:15:48,236 INFO: 23997 -- Existing service, appending puppet tags and manifest\", 
 \"2017-08-21 21:15:48,236 INFO: 23997 -- manifest include tripleo::profile::base::nova::consoleauth\", 
 \"2017-08-21 21:15:48,237 INFO: 23997 -- Existing service, appending puppet tags and manifest\", 
 \"2017-08-21 21:15:48,237 INFO: 23997 -- config_volume nova\", 
 \"2017-08-21 21:15:48,237 INFO: 23997 -- puppet_tags nova_config,nova_paste_api_ini\", 
 \"2017-08-21 21:15:48,237 INFO: 23997 -- manifest include tripleo::profile::base::nova::compute::ironic\", 
 \"2017-08-21 21:15:48,237 INFO: 23997 -- config_image 192.168.24.1:8787/rhosp12/openstack-nova-base-docker:2017-08-18.2\", 
 \"2017-08-21 21:15:48,237 INFO: 23997 -- volumes []\", 
 \"2017-08-21 21:15:48,237 INFO: 23997 -- config_volume nova_placement\", 
 \"2017-08-21 21:15:48,237 INFO: 23997 -- puppet_tags nova_config\", 
 \"2017-08-21 21:15:48,237 INFO: 23997 -- manifest include tripleo::profile::base::nova::placement\", 
 \"2017-08-21 21:15:48,237 INFO: 23997 -- config_image 192.168.24.1:8787/rhosp12/openstack-nova-placement-api-docker:2017-08-18.2\", 
 \"2017-08-21 21:15:48,237 INFO: 23997 -- Adding new service\", 
 \"2017-08-21 21:15:48,237 INFO: 23997 -- manifest include tripleo::profile::base::nova::scheduler\", 
 \"2017-08-21 21:15:48,238 INFO: 23997 -- Existing service, appending puppet tags and manifest\", 
 \"2017-08-21 21:15:48,238 INFO: 23997 -- config_volume nova\", 
 \"2017-08-21 21:15:48,238 INFO: 23997 -- puppet_tags nova_config\", 
 \"2017-08-21 21:15:48,238 INFO: 23997 -- manifest include tripleo::profile::base::nova::vncproxy\", 
 \"2017-08-21 21:15:48,238 INFO: 23997 -- config_image 192.168.24.1:8787/rhosp12/openstack-nova-base-docker:2017-08-18.2\", 
 \"2017-08-21 21:15:48,238 INFO: 23997 -- volumes []\", 
 \"2017-08-21 21:15:48,238 INFO: 23997 -- config_volume panko\", 
 \"2017-08-21 21:15:48,238 INFO: 23997 -- puppet_tags panko_api_paste_ini,panko_config\", 
 \"2017-08-21 21:15:48,238 INFO: 23997 -- manifest include tripleo::profile::base::panko::api\", 
 \"2017-08-21 21:15:48,238 INFO: 23997 -- config_image 192.168.24.1:8787/rhosp12/openstack-panko-api-docker:2017-08-18.2\", 
 \"2017-08-21 21:15:48,239 INFO: 23997 -- volumes []\", 
 \"2017-08-21 21:15:48,239 INFO: 23997 -- Adding new service\", 
 \"2017-08-21 21:15:48,239 INFO: 23997 -- config_volume rabbitmq\", 
 \"2017-08-21 21:15:48,239 INFO: 23997 -- puppet_tags file\", 
 \"2017-08-21 21:15:48,239 INFO: 23997 -- manifest include ::tripleo::profile::base::rabbitmq\", 
 \"2017-08-21 21:15:48,239 INFO: 23997 -- config_image 192.168.24.1:8787/rhosp12/openstack-rabbitmq-docker:2017-08-18.2\", 
 \"2017-08-21 21:15:48,239 INFO: 23997 -- config_volume redis\", 
 \"2017-08-21 21:15:48,239 INFO: 23997 -- puppet_tags exec\", 
 \"2017-08-21 21:15:48,239 INFO: 23997 -- manifest include ::tripleo::profile::base::database::redis\", 
 \"2017-08-21 21:15:48,239 INFO: 23997 -- config_image 192.168.24.1:8787/rhosp12/openstack-redis-docker:2017-08-18.2\", 
 \"2017-08-21 21:15:48,239 INFO: 23997 -- config_volume swift\", 
 \"2017-08-21 21:15:48,239 INFO: 23997 -- puppet_tags swift_proxy_config\", 
 \"2017-08-21 21:15:48,240 INFO: 23997 -- manifest include ::tripleo::profile::base::swift::proxy\", 
 \"2017-08-21 21:15:48,240 INFO: 23997 -- config_image 192.168.24.1:8787/rhosp12/openstack-swift-proxy-server-docker:2017-08-18.2\", 
 \"2017-08-21 21:15:48,240 INFO: 23997 -- volumes []\", 
 \"2017-08-21 21:15:48,240 INFO: 23997 -- Adding new service\", 
 \"2017-08-21 21:15:48,240 INFO: 23997 -- config_volume swift\", 
 \"2017-08-21 21:15:48,240 INFO: 23997 -- puppet_tags exec,fetch_swift_ring_tarball,extract_swift_ring_tarball,ring_object_device,swift::ringbuilder::create,tripleo::profile::base::swift::add_devices,swift::ringbuilder::rebalance,create_swift_ring_tarball,upload_swift_ring_tarball\", 
 \"2017-08-21 21:15:48,240 INFO: 23997 -- manifest include ::tripleo::profile::base::swift::ringbuilder\", 
 \"2017-08-21 21:15:48,240 INFO: 23997 -- Existing service, appending puppet tags and manifest\", 
 \"2017-08-21 21:15:48,240 INFO: 23997 -- puppet_tags swift_config,swift_container_config,swift_container_sync_realms_config,swift_account_config,swift_object_config,swift_object_expirer_config,rsync::server\", 
 \"2017-08-21 21:15:48,240 INFO: 23997 -- manifest include ::tripleo::profile::base::swift::storage\", 
 \"2017-08-21 21:15:48,241 INFO: 23997 -- Existing service, appending puppet tags and manifest\", 
 \"2017-08-21 21:15:48,241 INFO: 23997 -- Service compilation completed.\", 
 \"2017-08-21 21:15:48,258 INFO: 23998 -- Started processing puppet configs\", 
 \"2017-08-21 21:15:48,258 INFO: 23999 -- Started processing puppet configs\", 
 \"2017-08-21 21:15:48,259 INFO: 24000 -- Started processing puppet configs\", 
 \"2017-08-21 21:15:48,259 INFO: 24001 -- Started processing puppet configs\", 
 \"2017-08-21 21:15:48,259 INFO: 24002 -- Started processing puppet configs\", 
 \"2017-08-21 21:15:48,260 INFO: 24003 -- Started processing puppet configs\", 
 \"2017-08-21 21:15:48,260 INFO: 24004 -- Started processing puppet configs\", 
 \"2017-08-21 21:15:48,261 INFO: 24001 -- Removing container: docker-puppet-ironic_api\", 
 \"2017-08-21 21:15:48,261 INFO: 23999 -- Removing container: docker-puppet-aodh\", 
 \"2017-08-21 21:15:48,261 INFO: 23998 -- Removing container: docker-puppet-nova_placement\", 
 \"2017-08-21 21:15:48,261 INFO: 24003 -- Removing container: docker-puppet-ironic\", 
 \"2017-08-21 21:15:48,262 INFO: 24000 -- Removing container: docker-puppet-heat_api\", 
 \"2017-08-21 21:15:48,262 INFO: 24005 -- Started processing puppet configs\", 
 \"2017-08-21 21:15:48,263 INFO: 24002 -- Removing container: docker-puppet-mysql\", 
 \"2017-08-21 21:15:48,263 INFO: 24004 -- Removing container: docker-puppet-gnocchi\", 
 \"2017-08-21 21:15:48,263 INFO: 24005 -- Removing container: docker-puppet-clustercheck\", 
 \"2017-08-21 21:15:48,298 INFO: 24002 -- Pulling image: 192.168.24.1:8787/rhosp12/openstack-mariadb-docker:2017-08-18.2\", 
 \"2017-08-21 21:15:48,299 INFO: 24003 -- Pulling image: 192.168.24.1:8787/rhosp12/openstack-ironic-pxe-docker:2017-08-18.2\", 
 \"2017-08-21 21:15:48,301 INFO: 24000 -- Pulling image: 192.168.24.1:8787/rhosp12/openstack-heat-api-docker:2017-08-18.2\", 
 \"2017-08-21 21:15:48,302 INFO: 23999 -- Pulling image: 192.168.24.1:8787/rhosp12/openstack-aodh-api-docker:2017-08-18.2\", 
 \"2017-08-21 21:15:48,302 INFO: 24001 -- Pulling image: 192.168.24.1:8787/rhosp12/openstack-ironic-api-docker:2017-08-18.2\", 
 \"2017-08-21 21:15:48,303 INFO: 24004 -- Pulling image: 192.168.24.1:8787/rhosp12/openstack-gnocchi-api-docker:2017-08-18.2\", 
 \"2017-08-21 21:15:48,305 INFO: 24005 -- Pulling image: 192.168.24.1:8787/rhosp12/openstack-mariadb-docker:2017-08-18.2\", 
 \"2017-08-21 21:15:48,306 INFO: 23998 -- Pulling image: 192.168.24.1:8787/rhosp12/openstack-nova-placement-api-docker:2017-08-18.2\", 
 \"2017-08-21 21:16:16,318 INFO: 24002 -- Removing container: docker-puppet-mysql\", 
 \"2017-08-21 21:16:16,362 INFO: 24002 -- Finished processing puppet configs\", 
 \"2017-08-21 21:16:16,363 INFO: 24002 -- Started processing puppet configs\", 
 \"2017-08-21 21:16:16,364 INFO: 24002 -- Removing container: docker-puppet-redis\", 
 \"2017-08-21 21:16:16,400 INFO: 24002 -- Pulling image: 192.168.24.1:8787/rhosp12/openstack-redis-docker:2017-08-18.2\", 
 \"2017-08-21 21:16:17,319 INFO: 24005 -- Removing container: docker-puppet-clustercheck\", 
 \"2017-08-21 21:16:17,374 INFO: 24005 -- Finished processing puppet configs\", 
 \"2017-08-21 21:16:17,374 INFO: 24005 -- Started processing puppet configs\", 
 \"2017-08-21 21:16:17,375 INFO: 24005 -- Removing container: docker-puppet-nova\", 
 \"2017-08-21 21:16:17,455 INFO: 24005 -- Pulling image: 192.168.24.1:8787/rhosp12/openstack-nova-base-docker:2017-08-18.2\", 
 \"2017-08-21 21:16:25,869 INFO: 23999 -- Removing container: docker-puppet-aodh\", 
 \"2017-08-21 21:16:25,952 INFO: 23999 -- Finished processing puppet configs\", 
 \"2017-08-21 21:16:25,953 INFO: 23999 -- Started processing puppet configs\", 
 \"2017-08-21 21:16:25,953 INFO: 23999 -- Removing container: docker-puppet-iscsid\", 
 \"2017-08-21 21:16:25,984 INFO: 23999 -- Pulling image: 192.168.24.1:8787/rhosp12/openstack-iscsid-docker:2017-08-18.2\", 
 \"2017-08-21 21:16:26,897 INFO: 24000 -- Removing container: docker-puppet-heat_api\", 
 \"2017-08-21 21:16:26,971 INFO: 24000 -- Finished processing puppet configs\", 
 \"2017-08-21 21:16:26,971 INFO: 24000 -- Started processing puppet configs\", 
 \"2017-08-21 21:16:26,972 INFO: 24000 -- Removing container: docker-puppet-glance_api\", 
 \"2017-08-21 21:16:27,009 INFO: 24000 -- Pulling image: 192.168.24.1:8787/rhosp12/openstack-glance-api-docker:2017-08-18.2\", 
 \"2017-08-21 21:16:27,739 INFO: 24004 -- Removing container: docker-puppet-gnocchi\", 
 \"2017-08-21 21:16:27,962 INFO: 24004 -- Finished processing puppet configs\", 
 \"2017-08-21 21:16:27,963 INFO: 24004 -- Started processing puppet configs\", 
 \"2017-08-21 21:16:27,964 INFO: 24004 -- Removing container: docker-puppet-keystone\", 
 \"2017-08-21 21:16:28,009 INFO: 24004 -- Pulling image: 192.168.24.1:8787/rhosp12/openstack-keystone-docker:2017-08-18.2\", 
 \"2017-08-21 21:16:28,030 INFO: 24001 -- Removing container: docker-puppet-ironic_api\", 
 \"2017-08-21 21:16:28,143 INFO: 24001 -- Finished processing puppet configs\", 
 \"2017-08-21 21:16:28,143 INFO: 24001 -- Started processing puppet configs\", 
 \"2017-08-21 21:16:28,144 INFO: 24001 -- Removing container: docker-puppet-memcached\", 
 \"2017-08-21 21:16:28,183 INFO: 24001 -- Pulling image: 192.168.24.1:8787/rhosp12/openstack-memcached-docker:2017-08-18.2\", 
 \"2017-08-21 21:16:28,928 INFO: 24003 -- Removing container: docker-puppet-ironic\", 
 \"2017-08-21 21:16:29,054 INFO: 24003 -- Finished processing puppet configs\", 
 \"2017-08-21 21:16:29,054 INFO: 24003 -- Started processing puppet configs\", 
 \"2017-08-21 21:16:29,056 INFO: 24003 -- Removing container: docker-puppet-panko\", 
 \"2017-08-21 21:16:29,125 INFO: 24003 -- Pulling image: 192.168.24.1:8787/rhosp12/openstack-panko-api-docker:2017-08-18.2\", 
 \"2017-08-21 21:16:31,909 INFO: 23998 -- Removing container: docker-puppet-nova_placement\", 
 \"2017-08-21 21:16:31,974 INFO: 23998 -- Finished processing puppet configs\", 
 \"2017-08-21 21:16:31,974 INFO: 23998 -- Started processing puppet configs\", 
 \"2017-08-21 21:16:31,975 INFO: 23998 -- Started processing puppet configs\", 
 \"2017-08-21 21:16:31,976 INFO: 23998 -- Removing container: docker-puppet-horizon\"
 ], 
 \"changed\": false, 
 \"failed\": true, 
 \"failed_when_result\": true
}
	to retry, use: --limit @/var/lib/heat-config/heat-config-ansible/4394b71a-5cf9-4523-94aa-6d26360e895c_playbook.retry

PLAY RECAP *********************************************************************
localhost : ok=5 changed=1 unreachable=0 failed=1 

", "deploy_stderr": "", "deploy_status_code": 2 }, "creation_time": "2017-08-21T21:13:52Z", "updated_time": "2017-08-21T21:16:33Z", "input_values": { "update_identifier": "1503349201", "docker_puppet_debug": "", "role_name": "Controller", "step": 1, "bootstrap_server_id": "802f1c10-ff40-4793-bf48-3ec7d47f10b2" }, "action": "CREATE", "status_reason": "deploy_status_code : Deployment exited with non-zero status code: 2", "id": "daabbd7b-119c-4aa5-9793-3ad7cdbe2a05" }



Version-Release number of selected component (if applicable):
openstack-tripleo-common-containers-7.4.1-0.20170807001945.8c46306.el7ost.noarch
openstack-glance-15.0.0-0.20170807160730.9204583.el7ost.noarch
openstack-neutron-ml2-11.0.0-0.20170807223712.el7ost.noarch
openstack-mistral-common-5.0.0-0.20170807124320.3de1918.el7ost.noarch
openstack-tripleo-common-7.4.1-0.20170807001945.8c46306.el7ost.noarch
openstack-selinux-0.8.7-2.el7ost.noarch
openstack-nova-placement-api-16.0.0-0.20170808024016.6d4fc21.el7ost.noarch
puppet-openstack_extras-11.3.0-0.20170805105506.dae9508.el7ost.noarch
python-openstack-mistral-5.0.0-0.20170807124320.3de1918.el7ost.noarch
openstack-swift-object-2.15.1-0.20170808011400.7b2faca.el7ost.noarch
openstack-neutron-11.0.0-0.20170807223712.el7ost.noarch
openstack-neutron-openvswitch-11.0.0-0.20170807223712.el7ost.noarch
openstack-heat-engine-9.0.0-0.20170807084220.91bb3e8.el7ost.noarch
openstack-ironic-common-8.0.1-0.20170808020307.15c31b9.el7ost.noarch
openstack-mistral-api-5.0.0-0.20170807124320.3de1918.el7ost.noarch
openstack-nova-api-16.0.0-0.20170808024016.6d4fc21.el7ost.noarch
openstack-nova-conductor-16.0.0-0.20170808024016.6d4fc21.el7ost.noarch
openstack-keystone-12.0.0-0.20170808020832.156fa93.el7ost.noarch
openstack-tripleo-heat-templates-7.0.0-0.20170805163048.el7ost.noarch
openstack-tripleo-puppet-elements-7.0.0-0.20170803140906.4e7d35d.el7ost.noarch
puppet-openstacklib-11.3.0-0.20170805105609.cd97f82.el7ost.noarch
openstack-tripleo-image-elements-7.0.0-0.20170725091025.f3f06c7.el7ost.noarch
openstack-swift-container-2.15.1-0.20170808011400.7b2faca.el7ost.noarch
openstack-neutron-common-11.0.0-0.20170807223712.el7ost.noarch
openstack-heat-common-9.0.0-0.20170807084220.91bb3e8.el7ost.noarch
openstack-ironic-api-8.0.1-0.20170808020307.15c31b9.el7ost.noarch
openstack-mistral-engine-5.0.0-0.20170807124320.3de1918.el7ost.noarch
openstack-nova-scheduler-16.0.0-0.20170808024016.6d4fc21.el7ost.noarch
openstack-nova-common-16.0.0-0.20170808024016.6d4fc21.el7ost.noarch
openstack-puppet-modules-10.0.0-0.20170315222135.0333c73.el7.1.noarch
python-openstackclient-3.12.0-0.20170728181821.f67ebce.el7ost.noarch
openstack-swift-account-2.15.1-0.20170808011400.7b2faca.el7ost.noarch
openstack-heat-api-9.0.0-0.20170807084220.91bb3e8.el7ost.noarch
openstack-ironic-conductor-8.0.1-0.20170808020307.15c31b9.el7ost.noarch
openstack-tempest-16.1.1-0.20170808012534.0fc1454.el7ost.noarch
openstack-mistral-executor-5.0.0-0.20170807124320.3de1918.el7ost.noarch
openstack-tripleo-validations-7.2.1-0.20170807182119.1f60b6f.el7ost.noarch
openstack-zaqar-5.0.0-0.20170807074859.f722430.el7ost.noarch
openstack-nova-compute-16.0.0-0.20170808024016.6d4fc21.el7ost.noarch
openstack-swift-proxy-2.15.1-0.20170808011400.7b2faca.el7ost.noarch
openstack-heat-api-cfn-9.0.0-0.20170807084220.91bb3e8.el7ost.noarch
openstack-ironic-inspector-5.1.1-0.20170801061021.b4391de.el7ost.noarch
python-openstacksdk-0.9.17-0.20170621195806.7946243.el7ost.noarch
openstack-tripleo-ui-7.2.1-0.20170805065336.ac9467f.el7ost.noarch
puppet-tripleo-7.2.1-0.20170807233007.4600842.el7ost.noarch


How reproducible:
at least three times in a row today (aug 21st)

Steps to Reproduce:
1. deploy using IR, standard configuration (extra yamls to enable OC ironic per spec)
2.
3.

Actual results:
see above

Expected results:
successful deployment. These steps consistently worked with previous puddle

Additional info:
reproducer setup available

Comment 1 Derek Higgins 2017-08-22 15:20:30 UTC
Looking at the logs on your controller node I came across these errors

Aug 21 21:16:39 controller-0 puppet-user[25106]: (/Stage[main]/Ironic::Pxe/Ironic::Pxe::Tftpboot_file[pxelinux.0]/File[/var/lib/ironic/tftpboot/pxelinux.0]) Could not evaluate: Could not retrieve information from environment production source(s) file:/usr/share/syslinux/pxelinux.0
Aug 21 21:16:39 controller-0 puppet-user[25106]: (/Stage[main]/Ironic::Pxe/Ironic::Pxe::Tftpboot_file[chain.c32]/File[/var/lib/ironic/tftpboot/chain.c32]) Could not evaluate: Could not retrieve information from environment production source(s) file:/usr/share/syslinux/chain.c32

I think that the image your using for 
  DockerIronicPxeImage
mightn't have the syslinux package installed and as a result these files can't be found by puppet inside the container.

Comment 2 Derek Higgins 2017-08-22 17:02:43 UTC
I'm told syslinux-tftpboot is blacklisted and doesn't get installed in the image

 We're missing syslinux which I think isn't getting installed because we relied on it getting pulled in by syslinux-tftpboot but no longer is, so if syslinux-tftpboot is being blacklisted then syslinux needs to be explicitly installed.

Comment 3 Martin André 2017-08-23 12:35:57 UTC
Thierry, can we check again if syslinux-tftpboot is available in the repos, and install the syslinux dependency in the ironic_pxe image otherwise?

Comment 6 Dan Yasny 2017-08-25 15:08:20 UTC
Currently, deployment succeeds, but in the logs on the controllers I see the following:

[root@controller-0 log]# grep -R 'Ironic::Pxe/Ironic::Pxe::Tftpboot_file' *
Binary file journal/fd80cd1d15fa450fa2dcca5ca256cb95/system.journal matches
messages:Aug 25 10:21:40 localhost puppet-user[12]: (/Stage[main]/Ironic::Pxe/Ironic::Pxe::Tftpboot_fil [pxelinux.0]/File[/var/lib/ironic/tftpboot/pxelinux.0]) Could not evaluate: Could not retrieve information from environment production source(s) file:/usr/share/syslinux/pxelinux.0
messages:Aug 25 10:21:40 localhost puppet-user[12]: (/Stage[main]/Ironic::Pxe/Ironic::Pxe::Tftpboot_fil [chain.c32]/File[/var/lib/ironic/tftpboot/chain.c32]) Could not evaluate: Could not retrieve information from environment production source(s) file:/usr/share/syslinux/chain.c32
messages:Aug 25 10:21:40 localhost journal: Error: /Stage[main]/Ironic::Pxe/Ironic::Pxe::Tftpboot_file[pxelinux.0]/File[/var/lib/ironic/tftpboot/pxelinux.0]: Could not evaluate: Could not retrieve information from environment production source(s) file:/usr/share/syslinux/pxelinux.0
messages:Aug 25 10:21:40 localhost journal: Error: /Stage[main]/Ironic::Pxe/Ironic::Pxe::Tftpboot_file[chain.c32]/File[/var/lib/ironic/tftpboot/chain.c32]: Could not evaluate: Could not retrieve information from environment production source(s) file:/usr/share/syslinux/chain.c32

Comment 7 Dan Prince 2017-08-26 20:04:20 UTC
I tried to reproduce this today using containers from the 2017-08-18.2 tag:

rhosp12/openstack-ironic-api-docker           2017-08-18.2        0b75b70186b8        8 days ago          653.4 MB
rhosp12/openstack-ironic-pxe-docker           2017-08-18.2        43bfae3afb8e        8 days ago          657.3 MB

-----

What I did was to slice out the relevant elements in /var/lib/docker-puppet/docker-puppet.json into a file that was just Ironic specific containing just this:

[
{
    "config_image": "172.19.0.3:8787/rhosp12/openstack-ironic-api-docker:2017-08-18.2",
    "step_config": "include ::tripleo::profile::base::ironic::api\n\ninclude ::tripleo::profile::base::database::mysql::client",
    "config_volume": "ironic_api",
    "puppet_tags": "ironic_config"
  },
  {
    "config_image": "172.19.0.3:8787/rhosp12/openstack-ironic-pxe-docker:2017-08-18.2",
    "step_config": "include ::tripleo::profile::base::ironic::conductor\n\ninclude ::tripleo::profile::base::database::mysql::client",
    "config_volume": "ironic",
    "puppet_tags": "ironic_config"
  }
]

---

I called the file ironic.json. The I manually executed a docker puppet run like this:

 CONFIG=ironic.json NET_HOST=true python docker-puppet.py

It ran successfully. Which I think means that the Ironic containers themselves should be fine as far as generating configuration files goes.

Derek: I'm curious if this satisfies your syslinux package concerns as well.

With regards to the general issue here I'm actually wondering if this is perhaps related to concurrency issues with how we execute docker puppet containers. There is another BZ and an upstream patch that might help in both cases:

 https://bugzilla.redhat.com/show_bug.cgi?id=1456986
 https://review.openstack.org/#/c/498139/

Comment 8 Ramon Acedo 2017-08-30 12:53:12 UTC
Dan Yasny reminded that this is still blocking all the OSP 12 QA tests for testing Ironic in the Overcloud.

What's the recommended next step? 

I can see that the patch in BZ#1456986 (https://review.openstack.org/#/c/498139/) is merged. Dan, are you suggesting to rerun this with that patch applied?

Could the errors described in comment #6 be related to the same issue or should those be tracked separately as a different one?

Many thanks.

Comment 12 Bob Fournier 2017-09-14 16:18:24 UTC
This bug as per the summary should be fixed by  https://bugzilla.redhat.com/show_bug.cgi?id=1456986, if so it should be closed as a duplicate.

Once able to retest the problem Derek was seeing in Comment #1 may arise, if so, please open a new bug for that.

Comment 13 Dmitry Tantsur 2017-09-19 18:30:04 UTC
Dan, what's the status of this bug? Can it be closed as per comment 12?

Comment 14 Bob Fournier 2017-09-26 20:28:25 UTC
Problem has no longer been seen and containerized deployment completed, so closing this out. It seems most likely this was fixed elsewhere so marking as a dup.

*** This bug has been marked as a duplicate of bug 1456986 ***

Comment 15 Red Hat Bugzilla 2023-09-14 04:02:45 UTC
The needinfo request[s] on this closed bug have been removed as they have been unresolved for 1000 days