Description of problem: The file containers-default-parameters.yaml was used in OSP 12 and OSP 13, to point to the URLs of the containers, but in OSP 14 the URLs are created dynamically during deployment. In OSP 14 the user is expected to pass an environment file with the parameters that were formerly used in the prepare command, which was used to generate the containers-default-parameters.yaml file. The file looks something like this: parameter_defaults: ContainerImagePrepare: - push_destination: true set: ceph_image: rhceph ceph_namespace: *****.redhat.com:8888 ceph_tag: 3-13 name_prefix: openstack- name_suffix: '' namespace: ******.redhat.com/rhosp14 neutron_driver: null openshift_base_image: ose openshift_cockpit_image: registry-console openshift_cockpit_namespace: registry.access.redhat.com/openshift3 openshift_cockpit_tag: v3.10 openshift_etcd_image: etcd openshift_etcd_namespace: registry.access.redhat.com/rhel7 openshift_etcd_tag: latest openshift_gluster_block_image: rhgs-gluster-block-prov-rhel7 openshift_gluster_image: rhgs-server-rhel7 openshift_gluster_namespace: registry.access.redhat.com/rhgs3 openshift_gluster_tag: latest openshift_heketi_image: rhgs-volmanager-rhel7 openshift_heketi_namespace: registry.access.redhat.com/rhgs3 openshift_heketi_tag: latest openshift_namespace: registry.access.redhat.com/openshift3 openshift_tag: v3.10 tag: 2018-11-06.1 The UI still generates containers-default-parameters.yaml which is not up to date with the new workflow, and as a result all deployments fail! In addition to that, in OSP 14 is seems like this file is created in every deployment, as opposed to only once upon plan creation - as it was in OSP 13. The UI should allow the user to pass the parameters to the prepare command from the plan configuration dialog.
What workflow is the UI using to run the deployment? What should it be instead? tripleo.deployment.v1.deploy_plan certainly still does run the tripleo.container_images.prepare_params action which creates the containers-default-parameters.yaml file.
Possible solution. https://review.openstack.org/618462
GUI code just reflects how things are set up in tripleo-common and t-h-t. To fix the issue, we need to make sure any relevant mistral workflows (create_plan, update_plan, deploy_plan...?) don't generate containers-default-parameters.yaml. Then we can remove the reference from capabilities-map.yaml. Steve, can you please confirm that using containers-default-parameters.yaml is no more valid and help us identify any mistral workflow parts which still generate this file? codesearch still outputs quite a lot of references to this file: http://codesearch.openstack.org/?q=containers-default-parameters&i=nope&files=&repos= http://codesearch.openstack.org/?q=CONTAINER_DEFAULTS_ENVIRONMENT&i=nope&files=&repos=
[1] is the mistral action which is still run on plan_create as honza mentiones above. It creates the containers-default-parameters.yaml environment in the plan and adds it ti plan-environment.yaml [1] https://github.com/openstack/tripleo-common/blob/master/tripleo_common/actions/container_images.py#L55
Having an environment file including container images configuration, including default configuration for ContainerImagePrepare would be very helpful as we could add that to capabilities-map.yaml and let the user configure container images more easily using GUI. Currently user has to go to Controller role configuration (step 3) -> Services -> ContainerImagePrepare and completely provide json for ContainerImagePrepare parameter.
I think you just need to pass the /usr/share/openstack-tripleo-common-containers/container-images/container_image_prepare_defaults.yaml to the deploy command rather than the generated containers-default-parameters.yaml. The upstream doc explains in many details how to work with the image prepare file: https://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/container_image_prepare.html
So the problem is that business logic for generating default container images (populating ContainerImagePrepare parameter) lives in python tripleo-client instead of being implemented as a Mistral Action and available through Mistral workflow. To fix this we need to: 1. Implement [1] as Mistral action to populate the parameter and create a Mistral workflow which will use that action. The workflow should then use UpdateParametersAction by default to save the parameter value in plan-environment.yaml. This action can be applied conditionally, so CLI can transition to use this workflow too. 2. Implement GUI wizard to trigger the workflow and let user further tweak the parameter value after it is generated. 3. Remove leftover logic which generates containers-default-parameters.yaml environment file from tripleo-common as discussed at Comment 4 [2]. 4. Remove containers-default-parameters.yaml from capabilities-map.yaml in t-h-t [1] https://github.com/openstack/python-tripleoclient/blob/master/tripleoclient/v1/container_image.py#L505 [2] https://bugzilla.redhat.com/show_bug.cgi?id=1648918#c4 [3] https://review.openstack.org/618462
Upstream stable/rocky backports for tripleo-ui patches: https://review.openstack.org/624375 Add Prepare Container Images step https://review.openstack.org/624376 Update redux-form, add react-ace dependencies https://review.openstack.org/624377 Add container images configuration wizard https://review.openstack.org/624378 Add advanced configuration of container images
ran this command: openstack object create overcloud tripleo-config-generated-env-files/containers-prepare-parameter.yaml --name environments/containers-prepare-parameters.yaml then: In the GUI, open the plan configuration dialog and deselect “Default Container Images” because they might interfere with the deployment in the “General Deployment Options” section. In addition to that - go to the “other” sections and look for the containers-prepare-parameters.yaml file which you added to the plan, and select it. then i tried to deploy and it succeeded.
The default containers file is still created and still interferes with the deployments, and the user must remove it from the deployment every time as a workaround and upload the "containers prepare" file instead. Re-opening the bug.
Udi I think we missed a better explanation in comment #1 and worked accordingly to what was understood.
The environments/containers-default-parameters.yaml environment file is automatically generated and updated based on ContainerImagePrepare parameter value configured either by GUI wizard or CLI prepare command. containers-default-parameters.yaml then carries the actual values used during deployment. Can you please paste the deployment error you're seeing? environments/containers-default-parameters.yaml should not be needed to manipulate at all.
I tried to deploy without this command: openstack object create overcloud tripleo-config-generated-env-files/containers-prepare-parameter.yaml --name environments/containers-prepare-parameters.yaml and i got this error: " { "outputs.stdout_lines | default([]) | union(outputs.stderr_lines | default([]))": [ "2019-01-02 16:07:52,572 INFO: 21401 -- Running docker-puppet", "2019-01-02 16:07:52,573 DEBUG: 21401 -- CONFIG: /var/lib/docker-puppet/docker-puppet.json", "2019-01-02 16:07:52,573 DEBUG: 21401 -- config_volume ceilometer", "2019-01-02 16:07:52,573 DEBUG: 21401 -- puppet_tags ceilometer_config", "2019-01-02 16:07:52,573 DEBUG: 21401 -- manifest include ::tripleo::profile::base::ceilometer::agent::polling", "", "2019-01-02 16:07:52,574 DEBUG: 21401 -- config_image registry.access.redhat.com/rhosp14/openstack-ceilometer-central:latest", "2019-01-02 16:07:52,574 DEBUG: 21401 -- volumes []", "2019-01-02 16:07:52,574 DEBUG: 21401 -- Adding new service", "2019-01-02 16:07:52,574 DEBUG: 21401 -- config_volume neutron", "2019-01-02 16:07:52,574 DEBUG: 21401 -- puppet_tags neutron_plugin_ml2", "2019-01-02 16:07:52,574 DEBUG: 21401 -- manifest include ::tripleo::profile::base::neutron::plugins::ml2", "2019-01-02 16:07:52,574 DEBUG: 21401 -- config_image registry.access.redhat.com/rhosp14/openstack-neutron-server:latest", "2019-01-02 16:07:52,574 DEBUG: 21401 -- puppet_tags neutron_config,neutron_agent_ovs,neutron_plugin_ml2", "2019-01-02 16:07:52,574 DEBUG: 21401 -- manifest include ::tripleo::profile::base::neutron::ovs", "2019-01-02 16:07:52,575 DEBUG: 21401 -- config_image registry.access.redhat.com/rhosp14/openstack-neutron-server:latest", "2019-01-02 16:07:52,575 DEBUG: 21401 -- volumes [u'/lib/modules:/lib/modules:ro', u'/run/openvswitch:/run/openvswitch']", "2019-01-02 16:07:52,575 DEBUG: 21401 -- Existing service, appending puppet tags and manifest", "2019-01-02 16:07:52,575 DEBUG: 21401 -- config_volume iscsid", "2019-01-02 16:07:52,575 DEBUG: 21401 -- puppet_tags iscsid_config", "2019-01-02 16:07:52,575 DEBUG: 21401 -- manifest include ::tripleo::profile::base::iscsid", "2019-01-02 16:07:52,575 DEBUG: 21401 -- config_image registry.access.redhat.com/rhosp14/openstack-iscsid:latest", "2019-01-02 16:07:52,575 DEBUG: 21401 -- volumes [u'/etc/iscsi:/etc/iscsi']", "2019-01-02 16:07:52,575 DEBUG: 21401 -- Adding new service", "2019-01-02 16:07:52,575 DEBUG: 21401 -- config_volume nova_libvirt", "2019-01-02 16:07:52,575 DEBUG: 21401 -- puppet_tags nova_config,nova_paste_api_ini", "2019-01-02 16:07:52,575 DEBUG: 21401 -- manifest # TODO(emilien): figure how to deal with libvirt profile.", "# We'll probably treat it like we do with Neutron plugins.", "# Until then, just include it in the default nova-compute role.", "include tripleo::profile::base::nova::compute::libvirt", "include ::tripleo::profile::base::database::mysql::client", "2019-01-02 16:07:52,576 DEBUG: 21401 -- config_image registry.access.redhat.com/rhosp14/openstack-nova-compute:latest", "2019-01-02 16:07:52,576 DEBUG: 21401 -- volumes []", "2019-01-02 16:07:52,576 DEBUG: 21401 -- Adding new service", "2019-01-02 16:07:52,576 DEBUG: 21401 -- config_volume nova_libvirt", "2019-01-02 16:07:52,576 DEBUG: 21401 -- puppet_tags libvirtd_config,nova_config,file,libvirt_tls_password", "2019-01-02 16:07:52,576 DEBUG: 21401 -- manifest include tripleo::profile::base::nova::libvirt", "2019-01-02 16:07:52,576 DEBUG: 21401 -- Existing service, appending puppet tags and manifest", "2019-01-02 16:07:52,576 DEBUG: 21401 -- puppet_tags ", "2019-01-02 16:07:52,576 DEBUG: 21401 -- manifest include ::tripleo::profile::base::sshd", "include tripleo::profile::base::nova::migration::target", "2019-01-02 16:07:52,577 DEBUG: 21401 -- volumes []", "2019-01-02 16:07:52,577 DEBUG: 21401 -- Existing service, appending puppet tags and manifest", "2019-01-02 16:07:52,577 DEBUG: 21401 -- config_volume crond", "2019-01-02 16:07:52,577 DEBUG: 21401 -- puppet_tags ", "2019-01-02 16:07:52,577 DEBUG: 21401 -- manifest include ::tripleo::profile::base::logging::logrotate", "2019-01-02 16:07:52,577 DEBUG: 21401 -- config_image registry.access.redhat.com/rhosp14/openstack-cron:latest", "2019-01-02 16:07:52,577 DEBUG: 21401 -- Adding new service", "2019-01-02 16:07:52,577 INFO: 21401 -- Service compilation completed.", "2019-01-02 16:07:52,578 DEBUG: 21401 -- CHECK_MODE: 0", "2019-01-02 16:07:52,578 DEBUG: 21401 -- - [u'ceilometer', u'file,file_line,concat,augeas,cron,ceilometer_config', u'include ::tripleo::profile::base::ceilometer::agent::polling\\n', u'registry.access.redhat.com/rhosp14/openstack-ceilometer-central:latest', [], 0]", "2019-01-02 16:07:52,578 DEBUG: 21401 -- - [u'nova_libvirt', u'file,file_line,concat,augeas,cron,nova_config,nova_paste_api_ini,libvirtd_config,nova_config,file,libvirt_tls_password', u\"# TODO(emilien): figure how to deal with libvirt profile.\\n# We'll probably treat it like we do with Neutron plugins.\\n# Until then, just include it in the default nova-compute role.\\ninclude tripleo::profile::base::nova::compute::libvirt\\n\\ninclude ::tripleo::profile::base::database::mysql::client\\ninclude tripleo::profile::base::nova::libvirt\\n\\ninclude ::tripleo::profile::base::database::mysql::client\\ninclude ::tripleo::profile::base::sshd\\ninclude tripleo::profile::base::nova::migration::target\", u'registry.access.redhat.com/rhosp14/openstack-nova-compute:latest', [], 0]", "2019-01-02 16:07:52,578 DEBUG: 21401 -- - [u'crond', 'file,file_line,concat,augeas,cron', u'include ::tripleo::profile::base::logging::logrotate', u'registry.access.redhat.com/rhosp14/openstack-cron:latest', [], 0]", "2019-01-02 16:07:52,578 DEBUG: 21401 -- - [u'neutron', u'file,file_line,concat,augeas,cron,neutron_plugin_ml2,neutron_config,neutron_agent_ovs,neutron_plugin_ml2', u'include ::tripleo::profile::base::neutron::plugins::ml2\\n\\ninclude ::tripleo::profile::base::neutron::ovs\\n', u'registry.access.redhat.com/rhosp14/openstack-neutron-server:latest', [u'/lib/modules:/lib/modules:ro', u'/run/openvswitch:/run/openvswitch'], 0]", "2019-01-02 16:07:52,578 DEBUG: 21401 -- - [u'iscsid', u'file,file_line,concat,augeas,cron,iscsid_config', u'include ::tripleo::profile::base::iscsid', u'registry.access.redhat.com/rhosp14/openstack-iscsid:latest', [u'/etc/iscsi:/etc/iscsi'], 0]", "2019-01-02 16:07:52,578 INFO: 21401 -- Starting multiprocess configuration steps. Using 3 processes.", "2019-01-02 16:07:52,591 INFO: 21404 -- Starting configuration of ceilometer using image registry.access.redhat.com/rhosp14/openstack-ceilometer-central:latest", "2019-01-02 16:07:52,591 DEBUG: 21404 -- config_volume ceilometer", "2019-01-02 16:07:52,591 INFO: 21405 -- Starting configuration of nova_libvirt using image registry.access.redhat.com/rhosp14/openstack-nova-compute:latest", "2019-01-02 16:07:52,591 DEBUG: 21404 -- puppet_tags file,file_line,concat,augeas,cron,ceilometer_config", "2019-01-02 16:07:52,591 DEBUG: 21405 -- config_volume nova_libvirt", "2019-01-02 16:07:52,591 DEBUG: 21404 -- manifest include ::tripleo::profile::base::ceilometer::agent::polling", "2019-01-02 16:07:52,591 DEBUG: 21405 -- puppet_tags file,file_line,concat,augeas,cron,nova_config,nova_paste_api_ini,libvirtd_config,nova_config,file,libvirt_tls_password", "2019-01-02 16:07:52,591 DEBUG: 21404 -- config_image registry.access.redhat.com/rhosp14/openstack-ceilometer-central:latest", "2019-01-02 16:07:52,592 DEBUG: 21405 -- manifest # TODO(emilien): figure how to deal with libvirt profile.", "include tripleo::profile::base::nova::libvirt", "include ::tripleo::profile::base::sshd", "2019-01-02 16:07:52,592 DEBUG: 21404 -- volumes []", "2019-01-02 16:07:52,592 DEBUG: 21405 -- config_image registry.access.redhat.com/rhosp14/openstack-nova-compute:latest", "2019-01-02 16:07:52,592 DEBUG: 21404 -- check_mode 0", "2019-01-02 16:07:52,592 DEBUG: 21405 -- volumes []", "2019-01-02 16:07:52,592 DEBUG: 21405 -- check_mode 0", "2019-01-02 16:07:52,593 DEBUG: 21404 -- $ docker inspect --type container --format exists docker-puppet-ceilometer", "2019-01-02 16:07:52,593 DEBUG: 21405 -- $ docker inspect --type container --format exists docker-puppet-nova_libvirt", "2019-01-02 16:07:52,594 INFO: 21406 -- Starting configuration of crond using image registry.access.redhat.com/rhosp14/openstack-cron:latest", "2019-01-02 16:07:52,595 DEBUG: 21406 -- config_volume crond", "2019-01-02 16:07:52,595 DEBUG: 21406 -- puppet_tags file,file_line,concat,augeas,cron", "2019-01-02 16:07:52,595 DEBUG: 21406 -- manifest include ::tripleo::profile::base::logging::logrotate", "2019-01-02 16:07:52,595 DEBUG: 21406 -- config_image registry.access.redhat.com/rhosp14/openstack-cron:latest", "2019-01-02 16:07:52,595 DEBUG: 21406 -- volumes []", "2019-01-02 16:07:52,595 DEBUG: 21406 -- check_mode 0", "2019-01-02 16:07:52,596 DEBUG: 21406 -- $ docker inspect --type container --format exists docker-puppet-crond", "2019-01-02 16:07:52,673 DEBUG: 21405 -- ", "2019-01-02 16:07:52,673 DEBUG: 21405 -- Error: No such container: docker-puppet-nova_libvirt", "2019-01-02 16:07:52,674 INFO: 21405 -- Removing container: docker-puppet-nova_libvirt", "2019-01-02 16:07:52,673 DEBUG: 21404 -- ", "2019-01-02 16:07:52,674 DEBUG: 21404 -- Error: No such container: docker-puppet-ceilometer", "2019-01-02 16:07:52,674 INFO: 21404 -- Removing container: docker-puppet-ceilometer", "2019-01-02 16:07:52,676 DEBUG: 21406 -- ", "2019-01-02 16:07:52,677 DEBUG: 21406 -- Error: No such container: docker-puppet-crond", "2019-01-02 16:07:52,677 INFO: 21406 -- Removing container: docker-puppet-crond", "2019-01-02 16:07:52,846 INFO: 21406 -- Pulling image: registry.access.redhat.com/rhosp14/openstack-cron:latest", "2019-01-02 16:07:52,847 INFO: 21405 -- Pulling image: registry.access.redhat.com/rhosp14/openstack-nova-compute:latest", "2019-01-02 16:07:52,881 INFO: 21404 -- Pulling image: registry.access.redhat.com/rhosp14/openstack-ceilometer-central:latest", "2019-01-02 16:07:58,015 WARNING: 21405 -- docker pull failed: unknown: Not Found", "2019-01-02 16:07:58,016 WARNING: 21405 -- retrying pulling image: registry.access.redhat.com/rhosp14/openstack-nova-compute:latest", "2019-01-02 16:07:59,428 WARNING: 21406 -- docker pull failed: unknown: Not Found", "2019-01-02 16:07:59,429 WARNING: 21406 -- retrying pulling image: registry.access.redhat.com/rhosp14/openstack-cron:latest", "2019-01-02 16:07:59,465 WARNING: 21404 -- docker pull failed: unknown: Not Found", "2019-01-02 16:07:59,465 WARNING: 21404 -- retrying pulling image: registry.access.redhat.com/rhosp14/openstack-ceilometer-central:latest", "2019-01-02 16:08:04,547 WARNING: 21404 -- docker pull failed: unknown: Not Found", "2019-01-02 16:08:04,547 WARNING: 21404 -- retrying pulling image: registry.access.redhat.com/rhosp14/openstack-ceilometer-central:latest", "2019-01-02 16:08:05,168 WARNING: 21405 -- docker pull failed: unknown: Not Found", "2019-01-02 16:08:05,169 WARNING: 21405 -- retrying pulling image: registry.access.redhat.com/rhosp14/openstack-nova-compute:latest", "2019-01-02 16:08:05,765 WARNING: 21406 -- docker pull failed: unknown: Not Found", "2019-01-02 16:08:05,766 WARNING: 21406 -- retrying pulling image: registry.access.redhat.com/rhosp14/openstack-cron:latest", "2019-01-02 16:08:09,666 WARNING: 21404 -- docker pull failed: unknown: Not Found", "2019-01-02 16:08:09,667 WARNING: 21404 -- retrying pulling image: registry.access.redhat.com/rhosp14/openstack-ceilometer-central:latest", "2019-01-02 16:08:10,498 WARNING: 21406 -- docker pull failed: unknown: Not Found", "2019-01-02 16:08:10,498 WARNING: 21406 -- retrying pulling image: registry.access.redhat.com/rhosp14/openstack-cron:latest", "2019-01-02 16:08:11,251 WARNING: 21405 -- docker pull failed: unknown: Not Found", "2019-01-02 16:08:11,252 WARNING: 21405 -- retrying pulling image: registry.access.redhat.com/rhosp14/openstack-nova-compute:latest", "2019-01-02 16:08:14,534 WARNING: 21404 -- docker pull failed: unknown: Not Found", "2019-01-02 16:08:14,535 WARNING: 21404 -- retrying pulling image: registry.access.redhat.com/rhosp14/openstack-ceilometer-central:latest", "2019-01-02 16:08:17,073 WARNING: 21406 -- docker pull failed: unknown: Not Found", "2019-01-02 16:08:17,074 WARNING: 21406 -- retrying pulling image: registry.access.redhat.com/rhosp14/openstack-cron:latest", "2019-01-02 16:08:17,539 WARNING: 21405 -- docker pull failed: unknown: Not Found", "2019-01-02 16:08:17,539 WARNING: 21405 -- retrying pulling image: registry.access.redhat.com/rhosp14/openstack-nova-compute:latest", "2019-01-02 16:08:19,673 WARNING: 21404 -- docker pull failed: unknown: Not Found", "2019-01-02 16:08:19,674 WARNING: 21404 -- retrying pulling image: registry.access.redhat.com/rhosp14/openstack-ceilometer-central:latest", "2019-01-02 16:08:19,674 ERROR: 21404 -- Failed to pull image: registry.access.redhat.com/rhosp14/openstack-ceilometer-central:latest", "2019-01-02 16:08:19,674 DEBUG: 21404 -- Trying to pull repository registry.access.redhat.com/rhosp14/openstack-ceilometer-central ... ", "2019-01-02 16:08:19,674 DEBUG: 21404 -- unknown: Not Found", "2019-01-02 16:08:19,678 DEBUG: 21404 -- NET_HOST enabled", "2019-01-02 16:08:19,679 DEBUG: 21404 -- Running docker command: /usr/bin/docker run --user root --name docker-puppet-ceilometer --env PUPPET_TAGS=file,file_line,concat,augeas,cron,ceilometer_config --env NAME=ceilometer --env HOSTNAME=overcloud-compute-0 --env NO_ARCHIVE= --env STEP=6 --volume /etc/localtime:/etc/localtime:ro --volume /tmp/tmpCLSTfX:/etc/config.pp:ro,z --volume /etc/puppet/:/tmp/puppet-etc/:ro,z --volume /usr/share/openstack-puppet/modules/:/usr/share/openstack-puppet/modules/:ro --volume /var/lib/config-data:/var/lib/config-data/:z --volume tripleo_logs:/var/log/tripleo/ --volume /dev/log:/dev/log --volume /etc/pki/ca-trust/extracted:/etc/pki/ca-trust/extracted:ro --volume /etc/pki/tls/certs/ca-bundle.crt:/etc/pki/tls/certs/ca-bundle.crt:ro --volume /etc/pki/tls/certs/ca-bundle.trust.crt:/etc/pki/tls/certs/ca-bundle.trust.crt:ro --volume /etc/pki/tls/cert.pem:/etc/pki/tls/cert.pem:ro --volume /var/lib/docker-puppet/docker-puppet.sh:/var/lib/docker-puppet/docker-puppet.sh:z --entrypoint /var/lib/docker-puppet/docker-puppet.sh --net host --volume /etc/hosts:/etc/hosts:ro registry.access.redhat.com/rhosp14/openstack-ceilometer-central:latest", "2019-01-02 16:08:21,976 ERROR: 21404 -- Failed running docker-puppet.py for ceilometer", "2019-01-02 16:08:21,976 ERROR: 21404 -- Unable to find image 'registry.access.redhat.com/rhosp14/openstack-ceilometer-central:latest' locally", "Trying to pull repository registry.access.redhat.com/rhosp14/openstack-ceilometer-central ... ", "/usr/bin/docker-current: unknown: Not Found.", "See '/usr/bin/docker-current run --help'.", "2019-01-02 16:08:21,976 INFO: 21404 -- Finished processing puppet configs for ceilometer", "2019-01-02 16:08:21,977 INFO: 21404 -- Starting configuration of neutron using image registry.access.redhat.com/rhosp14/openstack-neutron-server:latest", "2019-01-02 16:08:21,977 DEBUG: 21404 -- config_volume neutron", "2019-01-02 16:08:21,977 DEBUG: 21404 -- puppet_tags file,file_line,concat,augeas,cron,neutron_plugin_ml2,neutron_config,neutron_agent_ovs,neutron_plugin_ml2", "2019-01-02 16:08:21,977 DEBUG: 21404 -- manifest include ::tripleo::profile::base::neutron::plugins::ml2", "include ::tripleo::profile::base::neutron::ovs", "2019-01-02 16:08:21,977 DEBUG: 21404 -- config_image registry.access.redhat.com/rhosp14/openstack-neutron-server:latest", "2019-01-02 16:08:21,977 DEBUG: 21404 -- volumes [u'/lib/modules:/lib/modules:ro', u'/run/openvswitch:/run/openvswitch']", "2019-01-02 16:08:21,977 DEBUG: 21404 -- check_mode 0", "2019-01-02 16:08:21,979 DEBUG: 21404 -- $ docker inspect --type container --format exists docker-puppet-neutron", "2019-01-02 16:08:22,042 DEBUG: 21404 -- ", "2019-01-02 16:08:22,042 DEBUG: 21404 -- Error: No such container: docker-puppet-neutron", "2019-01-02 16:08:22,043 INFO: 21404 -- Removing container: docker-puppet-neutron", "2019-01-02 16:08:22,187 INFO: 21404 -- Pulling image: registry.access.redhat.com/rhosp14/openstack-neutron-server:latest", "2019-01-02 16:08:22,936 WARNING: 21405 -- docker pull failed: unknown: Not Found", "2019-01-02 16:08:22,936 WARNING: 21405 -- retrying pulling image: registry.access.redhat.com/rhosp14/openstack-nova-compute:latest", "2019-01-02 16:08:22,936 ERROR: 21405 -- Failed to pull image: registry.access.redhat.com/rhosp14/openstack-nova-compute:latest", "2019-01-02 16:08:22,936 DEBUG: 21405 -- Trying to pull repository registry.access.redhat.com/rhosp14/openstack-nova-compute ... ", "2019-01-02 16:08:22,936 DEBUG: 21405 -- unknown: Not Found", "2019-01-02 16:08:22,940 DEBUG: 21405 -- NET_HOST enabled", "2019-01-02 16:08:22,940 DEBUG: 21405 -- Running docker command: /usr/bin/docker run --user root --name docker-puppet-nova_libvirt --env PUPPET_TAGS=file,file_line,concat,augeas,cron,nova_config,nova_paste_api_ini,libvirtd_config,nova_config,file,libvirt_tls_password --env NAME=nova_libvirt --env HOSTNAME=overcloud-compute-0 --env NO_ARCHIVE= --env STEP=6 --volume /etc/localtime:/etc/localtime:ro --volume /tmp/tmpXjc8x3:/etc/config.pp:ro,z --volume /etc/puppet/:/tmp/puppet-etc/:ro,z --volume /usr/share/openstack-puppet/modules/:/usr/share/openstack-puppet/modules/:ro --volume /var/lib/config-data:/var/lib/config-data/:z --volume tripleo_logs:/var/log/tripleo/ --volume /dev/log:/dev/log --volume /etc/pki/ca-trust/extracted:/etc/pki/ca-trust/extracted:ro --volume /etc/pki/tls/certs/ca-bundle.crt:/etc/pki/tls/certs/ca-bundle.crt:ro --volume /etc/pki/tls/certs/ca-bundle.trust.crt:/etc/pki/tls/certs/ca-bundle.trust.crt:ro --volume /etc/pki/tls/cert.pem:/etc/pki/tls/cert.pem:ro --volume /var/lib/docker-puppet/docker-puppet.sh:/var/lib/docker-puppet/docker-puppet.sh:z --entrypoint /var/lib/docker-puppet/docker-puppet.sh --net host --volume /etc/hosts:/etc/hosts:ro registry.access.redhat.com/rhosp14/openstack-nova-compute:latest", "2019-01-02 16:08:24,236 WARNING: 21406 -- docker pull failed: unknown: Not Found", "2019-01-02 16:08:24,237 WARNING: 21406 -- retrying pulling image: registry.access.redhat.com/rhosp14/openstack-cron:latest", "2019-01-02 16:08:24,237 ERROR: 21406 -- Failed to pull image: registry.access.redhat.com/rhosp14/openstack-cron:latest", "2019-01-02 16:08:24,237 DEBUG: 21406 -- Trying to pull repository registry.access.redhat.com/rhosp14/openstack-cron ... ", "2019-01-02 16:08:24,237 DEBUG: 21406 -- unknown: Not Found", "2019-01-02 16:08:24,241 DEBUG: 21406 -- NET_HOST enabled", "2019-01-02 16:08:24,242 DEBUG: 21406 -- Running docker command: /usr/bin/docker run --user root --name docker-puppet-crond --env PUPPET_TAGS=file,file_line,concat,augeas,cron --env NAME=crond --env HOSTNAME=overcloud-compute-0 --env NO_ARCHIVE= --env STEP=6 --volume /etc/localtime:/etc/localtime:ro --volume /tmp/tmpablkNS:/etc/config.pp:ro,z --volume /etc/puppet/:/tmp/puppet-etc/:ro,z --volume /usr/share/openstack-puppet/modules/:/usr/share/openstack-puppet/modules/:ro --volume /var/lib/config-data:/var/lib/config-data/:z --volume tripleo_logs:/var/log/tripleo/ --volume /dev/log:/dev/log --volume /etc/pki/ca-trust/extracted:/etc/pki/ca-trust/extracted:ro --volume /etc/pki/tls/certs/ca-bundle.crt:/etc/pki/tls/certs/ca-bundle.crt:ro --volume /etc/pki/tls/certs/ca-bundle.trust.crt:/etc/pki/tls/certs/ca-bundle.trust.crt:ro --volume /etc/pki/tls/cert.pem:/etc/pki/tls/cert.pem:ro --volume /var/lib/docker-puppet/docker-puppet.sh:/var/lib/docker-puppet/docker-puppet.sh:z --entrypoint /var/lib/docker-puppet/docker-puppet.sh --net host --volume /etc/hosts:/etc/hosts:ro registry.access.redhat.com/rhosp14/openstack-cron:latest", "2019-01-02 16:08:26,241 ERROR: 21406 -- Failed running docker-puppet.py for crond", "2019-01-02 16:08:26,241 ERROR: 21406 -- Unable to find image 'registry.access.redhat.com/rhosp14/openstack-cron:latest' locally", "Trying to pull repository registry.access.redhat.com/rhosp14/openstack-cron ... ", "2019-01-02 16:08:26,241 INFO: 21406 -- Finished processing puppet configs for crond", "2019-01-02 16:08:26,241 INFO: 21406 -- Starting configuration of iscsid using image registry.access.redhat.com/rhosp14/openstack-iscsid:latest", "2019-01-02 16:08:26,242 DEBUG: 21406 -- config_volume iscsid", "2019-01-02 16:08:26,242 DEBUG: 21406 -- puppet_tags file,file_line,concat,augeas,cron,iscsid_config", "2019-01-02 16:08:26,242 DEBUG: 21406 -- manifest include ::tripleo::profile::base::iscsid", "2019-01-02 16:08:26,242 DEBUG: 21406 -- config_image registry.access.redhat.com/rhosp14/openstack-iscsid:latest", "2019-01-02 16:08:26,242 DEBUG: 21406 -- volumes [u'/etc/iscsi:/etc/iscsi']", "2019-01-02 16:08:26,242 DEBUG: 21406 -- check_mode 0", "2019-01-02 16:08:26,243 DEBUG: 21406 -- $ docker inspect --type container --format exists docker-puppet-iscsid", "2019-01-02 16:08:26,317 DEBUG: 21406 -- ", "2019-01-02 16:08:26,318 DEBUG: 21406 -- Error: No such container: docker-puppet-iscsid", "2019-01-02 16:08:26,318 INFO: 21406 -- Removing container: docker-puppet-iscsid", "2019-01-02 16:08:26,470 INFO: 21406 -- Pulling image: registry.access.redhat.com/rhosp14/openstack-iscsid:latest", "2019-01-02 16:08:26,602 ERROR: 21405 -- Failed running docker-puppet.py for nova_libvirt", "2019-01-02 16:08:26,602 ERROR: 21405 -- Unable to find image 'registry.access.redhat.com/rhosp14/openstack-nova-compute:latest' locally", "Trying to pull repository registry.access.redhat.com/rhosp14/openstack-nova-compute ... ", "2019-01-02 16:08:26,602 INFO: 21405 -- Finished processing puppet configs for nova_libvirt", "2019-01-02 16:08:29,009 WARNING: 21404 -- docker pull failed: unknown: Not Found", "2019-01-02 16:08:29,010 WARNING: 21404 -- retrying pulling image: registry.access.redhat.com/rhosp14/openstack-neutron-server:latest", "2019-01-02 16:08:32,202 WARNING: 21406 -- docker pull failed: unknown: Not Found", "2019-01-02 16:08:32,203 WARNING: 21406 -- retrying pulling image: registry.access.redhat.com/rhosp14/openstack-iscsid:latest", "2019-01-02 16:08:34,141 WARNING: 21404 -- docker pull failed: unknown: Not Found", "2019-01-02 16:08:34,141 WARNING: 21404 -- retrying pulling image: registry.access.redhat.com/rhosp14/openstack-neutron-server:latest", "2019-01-02 16:08:38,060 WARNING: 21406 -- docker pull failed: unknown: Not Found", "2019-01-02 16:08:38,061 WARNING: 21406 -- retrying pulling image: registry.access.redhat.com/rhosp14/openstack-iscsid:latest", "2019-01-02 16:08:43,220 WARNING: 21404 -- docker pull failed: unknown: Not Found", "2019-01-02 16:08:43,220 WARNING: 21404 -- retrying pulling image: registry.access.redhat.com/rhosp14/openstack-neutron-server:latest", "2019-01-02 16:08:45,048 WARNING: 21406 -- docker pull failed: unknown: Not Found", "2019-01-02 16:08:45,048 WARNING: 21406 -- retrying pulling image: registry.access.redhat.com/rhosp14/openstack-iscsid:latest", "2019-01-02 16:08:47,792 WARNING: 21404 -- docker pull failed: unknown: Not Found", "2019-01-02 16:08:47,792 WARNING: 21404 -- retrying pulling image: registry.access.redhat.com/rhosp14/openstack-neutron-server:latest", "2019-01-02 16:08:51,042 WARNING: 21406 -- docker pull failed: unknown: Not Found", "2019-01-02 16:08:51,042 WARNING: 21406 -- retrying pulling image: registry.access.redhat.com/rhosp14/openstack-iscsid:latest", "2019-01-02 16:08:54,425 WARNING: 21404 -- docker pull failed: unknown: Not Found", "2019-01-02 16:08:54,425 WARNING: 21404 -- retrying pulling image: registry.access.redhat.com/rhosp14/openstack-neutron-server:latest", "2019-01-02 16:08:54,426 ERROR: 21404 -- Failed to pull image: registry.access.redhat.com/rhosp14/openstack-neutron-server:latest", "2019-01-02 16:08:54,426 DEBUG: 21404 -- Trying to pull repository registry.access.redhat.com/rhosp14/openstack-neutron-server ... ", "2019-01-02 16:08:54,426 DEBUG: 21404 -- unknown: Not Found", "2019-01-02 16:08:54,429 DEBUG: 21404 -- NET_HOST enabled", "2019-01-02 16:08:54,429 DEBUG: 21404 -- Running docker command: /usr/bin/docker run --user root --name docker-puppet-neutron --env PUPPET_TAGS=file,file_line,concat,augeas,cron,neutron_plugin_ml2,neutron_config,neutron_agent_ovs,neutron_plugin_ml2 --env NAME=neutron --env HOSTNAME=overcloud-compute-0 --env NO_ARCHIVE= --env STEP=6 --volume /etc/localtime:/etc/localtime:ro --volume /tmp/tmpcQQEzQ:/etc/config.pp:ro,z --volume /etc/puppet/:/tmp/puppet-etc/:ro,z --volume /usr/share/openstack-puppet/modules/:/usr/share/openstack-puppet/modules/:ro --volume /var/lib/config-data:/var/lib/config-data/:z --volume tripleo_logs:/var/log/tripleo/ --volume /dev/log:/dev/log --volume /etc/pki/ca-trust/extracted:/etc/pki/ca-trust/extracted:ro --volume /etc/pki/tls/certs/ca-bundle.crt:/etc/pki/tls/certs/ca-bundle.crt:ro --volume /etc/pki/tls/certs/ca-bundle.trust.crt:/etc/pki/tls/certs/ca-bundle.trust.crt:ro --volume /etc/pki/tls/cert.pem:/etc/pki/tls/cert.pem:ro --volume /var/lib/docker-puppet/docker-puppet.sh:/var/lib/docker-puppet/docker-puppet.sh:z --volume /lib/modules:/lib/modules:ro --volume /run/openvswitch:/run/openvswitch --entrypoint /var/lib/docker-puppet/docker-puppet.sh --net host --volume /etc/hosts:/etc/hosts:ro registry.access.redhat.com/rhosp14/openstack-neutron-server:latest", "2019-01-02 16:08:55,895 WARNING: 21406 -- docker pull failed: unknown: Not Found", "2019-01-02 16:08:55,896 WARNING: 21406 -- retrying pulling image: registry.access.redhat.com/rhosp14/openstack-iscsid:latest", "2019-01-02 16:08:55,896 ERROR: 21406 -- Failed to pull image: registry.access.redhat.com/rhosp14/openstack-iscsid:latest", "2019-01-02 16:08:55,896 DEBUG: 21406 -- Trying to pull repository registry.access.redhat.com/rhosp14/openstack-iscsid ... ", "2019-01-02 16:08:55,896 DEBUG: 21406 -- unknown: Not Found", "2019-01-02 16:08:55,899 DEBUG: 21406 -- NET_HOST enabled", "2019-01-02 16:08:55,900 DEBUG: 21406 -- Running docker command: /usr/bin/docker run --user root --name docker-puppet-iscsid --env PUPPET_TAGS=file,file_line,concat,augeas,cron,iscsid_config --env NAME=iscsid --env HOSTNAME=overcloud-compute-0 --env NO_ARCHIVE= --env STEP=6 --volume /etc/localtime:/etc/localtime:ro --volume /tmp/tmptKISil:/etc/config.pp:ro,z --volume /etc/puppet/:/tmp/puppet-etc/:ro,z --volume /usr/share/openstack-puppet/modules/:/usr/share/openstack-puppet/modules/:ro --volume /var/lib/config-data:/var/lib/config-data/:z --volume tripleo_logs:/var/log/tripleo/ --volume /dev/log:/dev/log --volume /etc/pki/ca-trust/extracted:/etc/pki/ca-trust/extracted:ro --volume /etc/pki/tls/certs/ca-bundle.crt:/etc/pki/tls/certs/ca-bundle.crt:ro --volume /etc/pki/tls/certs/ca-bundle.trust.crt:/etc/pki/tls/certs/ca-bundle.trust.crt:ro --volume /etc/pki/tls/cert.pem:/etc/pki/tls/cert.pem:ro --volume /var/lib/docker-puppet/docker-puppet.sh:/var/lib/docker-puppet/docker-puppet.sh:z --volume /etc/iscsi:/etc/iscsi --entrypoint /var/lib/docker-puppet/docker-puppet.sh --net host --volume /etc/hosts:/etc/hosts:ro registry.access.redhat.com/rhosp14/openstack-iscsid:latest", "2019-01-02 16:08:56,027 ERROR: 21404 -- Failed running docker-puppet.py for neutron", "2019-01-02 16:08:56,028 ERROR: 21404 -- Unable to find image 'registry.access.redhat.com/rhosp14/openstack-neutron-server:latest' locally", "Trying to pull repository registry.access.redhat.com/rhosp14/openstack-neutron-server ... ", "2019-01-02 16:08:56,028 INFO: 21404 -- Finished processing puppet configs for neutron", "2019-01-02 16:09:03,689 ERROR: 21406 -- Failed running docker-puppet.py for iscsid", "2019-01-02 16:09:03,690 ERROR: 21406 -- Unable to find image 'registry.access.redhat.com/rhosp14/openstack-iscsid:latest' locally", "Trying to pull repository registry.access.redhat.com/rhosp14/openstack-iscsid ... ", "2019-01-02 16:09:03,690 INFO: 21406 -- Finished processing puppet configs for iscsid", "2019-01-02 16:09:03,690 ERROR: 21401 -- ERROR configuring ceilometer", "2019-01-02 16:09:03,691 ERROR: 21401 -- ERROR configuring nova_libvirt", "2019-01-02 16:09:03,691 ERROR: 21401 -- ERROR configuring crond", "2019-01-02 16:09:03,691 ERROR: 21401 -- ERROR configuring neutron", "2019-01-02 16:09:03,691 ERROR: 21401 -- ERROR configuring iscsid", "2019-01-02 16:09:03,691 DEBUG: 21401 -- CONFIG_VOLUME_PREFIX: /var/lib/config-data", "2019-01-02 16:09:03,691 DEBUG: 21401 -- STARTUP_CONFIG_PATTERN: /var/lib/tripleo-config/docker-container-startup-config-step_*.json", "2019-01-02 16:09:03,693 DEBUG: 21401 -- Looking for hashfile /var/lib/config-data/puppet-generated/neutron.md5sum for config_volume /var/lib/config-data/puppet-generated/neutron", "2019-01-02 16:09:03,693 DEBUG: 21401 -- Looking for hashfile /var/lib/config-data/puppet-generated/nova_libvirt.md5sum for config_volume /var/lib/config-data/puppet-generated/nova_libvirt", "2019-01-02 16:09:03,694 DEBUG: 21401 -- Looking for hashfile /var/lib/config-data/puppet-generated/nova_libvirt.md5sum for config_volume /var/lib/config-data/puppet-generated/nova_libvirt", "2019-01-02 16:09:03,695 DEBUG: 21401 -- Looking for hashfile /var/lib/config-data/puppet-generated/ceilometer.md5sum for config_volume /var/lib/config-data/puppet-generated/ceilometer", "2019-01-02 16:09:03,695 DEBUG: 21401 -- Looking for hashfile /var/lib/config-data/puppet-generated/nova_libvirt/etc.md5sum for config_volume /var/lib/config-data/puppet-generated/nova_libvirt/etc", "2019-01-02 16:09:03,695 DEBUG: 21401 -- Looking for hashfile /var/lib/config-data/puppet-generated/nova_libvirt.md5sum for config_volume /var/lib/config-data/puppet-generated/nova_libvirt", "2019-01-02 16:09:03,695 DEBUG: 21401 -- Looking for hashfile /var/lib/config-data/puppet-generated/crond.md5sum for config_volume /var/lib/config-data/puppet-generated/crond", "2019-01-02 16:09:03,695 DEBUG: 21401 -- Looking for hashfile /var/lib/config-data/puppet-generated/neutron.md5sum for config_volume /var/lib/config-data/puppet-generated/neutron" ], "changed": false, "failed_when_result": true, "_ansible_no_log": false, "_ansible_verbose_always": true } "
Verified that the behavior is according to comment #24 from Jiri. Verified in: openstack-tripleo-ui-9.3.1-0.20180921180345.df30b55.el7ost.noarch
Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory, and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHEA-2019:0045