Description of problem: all Downstream OVN ci jobs failed on overcloud stage because of: Stack overcloud/f3e4bd4f-7fab-4a82-91a6-f7125f92d743 CREATE_FAILED overcloud.ComputeServiceChain.ServiceChain: resource_type: OS::Heat::ResourceChain physical_resource_id: status: CREATE_FAILED status_reason: | resources.ServiceChain: Property error: resources[42].properties: Property DockerOvnControllerImage not assigned overcloud.ControllerServiceChain.ServiceChain: resource_type: OS::Heat::ResourceChain physical_resource_id: status: CREATE_FAILED status_reason: | resources.ServiceChain: Property error: resources[125].properties: Property DockerOvnControllerImage not assigned TASK [Print stack failures] **************************************************** task path: /home/rhos-ci/jenkins/workspace/DFG-network-networking-ovn-14_director-rhel-virthost-3cont_2comp-ipv4-geneve-dvr/infrared/plugins/tripleo-overcloud/deploy.yml:101 Monday 17 September 2018 01:47:34 +0000 (0:00:00.572) 0:41:16.405 ****** changed: [undercloud-0] => { "changed": true, "cmd": "source ~/stackrc\n openstack stack failures list overcloud", "delta": "0:00:04.278828", "end": "2018-09-16 21:47:38.910709", "rc": 0, "start": "2018-09-16 21:47:34.631881" } STDOUT: overcloud.ComputeServiceChain.ServiceChain: resource_type: OS::Heat::ResourceChain physical_resource_id: status: CREATE_FAILED status_reason: | resources.ServiceChain: Property error: resources[42].properties: Property DockerOvnControllerImage not assigned overcloud.ControllerServiceChain.ServiceChain: resource_type: OS::Heat::ResourceChain physical_resource_id: status: CREATE_FAILED status_reason: | resources.ServiceChain: Property error: resources[125].properties: Property DockerOvnControllerImage not assigned Version-Release number of selected component (if applicable): OpenStack/14.0-RHEL-7/2018-09-06.1 How reproducible: 100% Steps to Reproduce: 1. run OVN CI jobs 2. 3. Actual results: Expected results: Additional info:
Created attachment 1487210 [details] openstack tripleo container image prepare default --output-env-file /home/stack/containers-prepare-parameter.yaml --local-push-destination
Created attachment 1487211 [details] openstack tripleo container image prepare
Hi, On the 'tripleo container image prepare' step we specify --roles-file [1], that contains needed services for OVN. But in the 'container_images_prepare' function there is condition that checks if we have defined OpenDayLight or OVN services [2], since both services are defined in roles_data file [2] and in 'if' condition 'OpenDayLight' service is verifying first, as result mapping_args['neutron_driver'] contains value as 'odl'. So container images for OVN is not included if service_filter: if 'OS::TripleO::Services::OpenDaylightApi' in service_filter: mapping_args['neutron_driver'] = 'odl' elif 'OS::TripleO::Services::OVNController' in service_filter: mapping_args['neutron_driver'] = 'ovn' [1] https://github.com/openstack/tripleo-heat-templates/blob/master/roles_data.yaml [2] https://github.com/openstack/tripleo-common/blob/master/tripleo_common/image/kolla_builder.py#L236 [3] https://github.com/openstack/tripleo-heat-templates/blob/master/roles_data.yaml#L156
(In reply to rusichen from comment #8) > Hi, > > On the 'tripleo container image prepare' step we specify --roles-file [1], > that contains needed services for OVN. But in the 'container_images_prepare' > function there is condition that checks if we have defined OpenDayLight or > OVN services [2], since both services are defined in roles_data file [2] and > in 'if' condition 'OpenDayLight' service is verifying first, as result > mapping_args['neutron_driver'] contains value as 'odl'. So container images > for OVN is not included > if service_filter: > if 'OS::TripleO::Services::OpenDaylightApi' in service_filter: > mapping_args['neutron_driver'] = 'odl' > elif 'OS::TripleO::Services::OVNController' in service_filter: > mapping_args['neutron_driver'] = 'ovn' > > > [1] > https://github.com/openstack/tripleo-heat-templates/blob/master/roles_data. > yaml > [2] > https://github.com/openstack/tripleo-common/blob/master/tripleo_common/image/ > kolla_builder.py#L236 > [3] > https://github.com/openstack/tripleo-heat-templates/blob/master/roles_data. > yaml#L156 Can't just infrared call it like in upstream [0]? 2018-09-25 02:57:10 | START with options: [u'tripleo', u'container', u'image', u'prepare', u'--verbose', u'--output-env-file', u'/home/zuul/containers-default-parameters.yaml', u'-e', u'/usr/share/openstack-tripleo-heat-templates/environments/docker.yaml', u'-e', u'/usr/share/openstack-tripleo-heat-templates/ci/environments/scenario007-multinode-containers.yaml', u'-e', u'/home/zuul/containers-prepare-parameter.yaml'] Of course we would need to replace the env files and not using the scenario007 but neutron-ml2-ovn-dvr-ha.yaml or whatever needed but passing in all the yaml files. What do you think? [0] https://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/legacy-periodic-tripleo-ci-centos-7-multinode-1ctlr-featureset030-rocky/c671404/logs/undercloud/home/zuul/overcloud_prep_containers.log.txt.gz#_2018-09-25_02_57_10
(In reply to Daniel Alvarez Sanchez from comment #9) > (In reply to rusichen from comment #8) > > Hi, > > > > On the 'tripleo container image prepare' step we specify --roles-file [1], > > that contains needed services for OVN. But in the 'container_images_prepare' > > function there is condition that checks if we have defined OpenDayLight or > > OVN services [2], since both services are defined in roles_data file [2] and > > in 'if' condition 'OpenDayLight' service is verifying first, as result > > mapping_args['neutron_driver'] contains value as 'odl'. So container images > > for OVN is not included > > if service_filter: > > if 'OS::TripleO::Services::OpenDaylightApi' in service_filter: > > mapping_args['neutron_driver'] = 'odl' > > elif 'OS::TripleO::Services::OVNController' in service_filter: > > mapping_args['neutron_driver'] = 'ovn' > > > > > > [1] > > https://github.com/openstack/tripleo-heat-templates/blob/master/roles_data. > > yaml > > [2] > > https://github.com/openstack/tripleo-common/blob/master/tripleo_common/image/ > > kolla_builder.py#L236 > > [3] > > https://github.com/openstack/tripleo-heat-templates/blob/master/roles_data. > > yaml#L156 > > > Can't just infrared call it like in upstream [0]? No, because the new image workflow doesn't include the container image prepare command per docs @ https://docs.openstack.org/tripleo-docs/latest/install/containers_deployment/overcloud.html Infrared runs it only to workaround BZ#1627946 > 2018-09-25 02:57:10 | START with options: [u'tripleo', u'container', > u'image', u'prepare', u'--verbose', u'--output-env-file', > u'/home/zuul/containers-default-parameters.yaml', u'-e', > u'/usr/share/openstack-tripleo-heat-templates/environments/docker.yaml', > u'-e', > u'/usr/share/openstack-tripleo-heat-templates/ci/environments/scenario007- > multinode-containers.yaml', u'-e', > u'/home/zuul/containers-prepare-parameter.yaml'] > > Of course we would need to replace the env files and not using the > scenario007 but neutron-ml2-ovn-dvr-ha.yaml or whatever needed but passing > in all the yaml files. > What do you think? That won't work either: [stack@undercloud-0 ~]$ openstack tripleo container image prepare -e /home/stack/containers-prepare-parameter.yaml -e /usr/share/openstack-tripleo-heat-templates/environments/services/neutron-ovn-ha.yaml --output-env-file test.yaml Completed upload for image brew-pulp-docker01.web.prod.ext.phx2.redhat.com:8888/rhceph:3-12 Skipping upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-aodh-api:2018-09-20.1 Skipping upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-aodh-evaluator:2018-09-20.1 Skipping upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-aodh-listener:2018-09-20.1 Skipping upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-aodh-notifier:2018-09-20.1 Skipping upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-barbican-api:2018-09-20.1 Skipping upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-barbican-keystone-listener:2018-09-20.1 Skipping upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-barbican-worker:2018-09-20.1 Skipping upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-ceilometer-central:2018-09-20.1 Skipping upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-ceilometer-notification:2018-09-20.1 Skipping upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-cinder-api:2018-09-20.1 Completed upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-ceilometer-compute:2018-09-20.1 Skipping upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-cinder-scheduler:2018-09-20.1 Completed upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-cinder-backup:2018-09-20.1 Skipping upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-cinder-volume:2018-09-20.1 Skipping upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-cron:2018-09-20.1 Completed upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-designate-api:2018-09-20.1 Completed upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-collectd:2018-09-20.1 Completed upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-designate-backend-bind9:2018-09-20.1 Completed upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-designate-central:2018-09-20.1 Completed upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-designate-mdns:2018-09-20.1 Completed upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-designate-producer:2018-09-20.1 Completed upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-designate-sink:2018-09-20.1 Completed upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-designate-worker:2018-09-20.1 Completed upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-ec2-api:2018-09-20.1 Completed upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-etcd:2018-09-20.1 Completed upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-fluentd:2018-09-20.1 Skipping upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-gnocchi-api:2018-09-20.1 Skipping upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-glance-api:2018-09-20.1 Skipping upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-gnocchi-metricd:2018-09-20.1 Skipping upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-gnocchi-statsd:2018-09-20.1 Skipping upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-haproxy:2018-09-20.1 Skipping upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-heat-api-cfn:2018-09-20.1 Skipping upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-heat-api:2018-09-20.1 Skipping upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-heat-engine:2018-09-20.1 Skipping upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-ironic-api:2018-09-20.1 Skipping upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-ironic-conductor:2018-09-20.1 Skipping upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-ironic-inspector:2018-09-20.1 Skipping upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-ironic-pxe:2018-09-20.1 Skipping upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-ironic-neutron-agent:2018-09-20.1 Skipping upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-iscsid:2018-09-20.1 Skipping upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-keepalived:2018-09-20.1 Skipping upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-keystone:2018-09-20.1 Completed upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-horizon:2018-09-20.1 Completed upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-manila-api:2018-09-20.1 Completed upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-manila-scheduler:2018-09-20.1 Skipping upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-mariadb:2018-09-20.1 Skipping upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-memcached:2018-09-20.1 Skipping upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-mistral-api:2018-09-20.1 Skipping upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-mistral-engine:2018-09-20.1 Skipping upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-mistral-executor:2018-09-20.1 Skipping upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-mistral-event-engine:2018-09-20.1 Completed upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-neutron-server-opendaylight:2018-09-20.1 Skipping upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-nova-api:2018-09-20.1 Completed upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-manila-share:2018-09-20.1 Skipping upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-nova-compute-ironic:2018-09-20.1 Skipping upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-nova-conductor:2018-09-20.1 Completed upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-nova-consoleauth:2018-09-20.1 Completed upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-nova-compute:2018-09-20.1 Completed upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-nova-novncproxy:2018-09-20.1 Skipping upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-nova-placement-api:2018-09-20.1 Skipping upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-nova-scheduler:2018-09-20.1 Completed upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-octavia-api:2018-09-20.1 Completed upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-octavia-health-manager:2018-09-20.1 Completed upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-nova-libvirt:2018-09-20.1 Completed upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-octavia-housekeeping:2018-09-20.1 Completed upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-octavia-worker:2018-09-20.1 Skipping upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-panko-api:2018-09-20.1 Skipping upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-rabbitmq:2018-09-20.1 Skipping upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-redis:2018-09-20.1 Completed upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-sahara-api:2018-09-20.1 Completed upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-sahara-engine:2018-09-20.1 Completed upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-sensu-client:2018-09-20.1 Skipping upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-swift-account:2018-09-20.1 Completed upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-opendaylight:2018-09-20.1 Skipping upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-swift-container:2018-09-20.1 Skipping upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-swift-object:2018-09-20.1 Skipping upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-swift-proxy-server:2018-09-20.1 Skipping upload for image rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-zaqar:2018-09-20.1 Removing local copy of 192.168.24.1:8787/rhceph:3-12 Removing local copy of 192.168.24.1:8787/rhosp14/openstack-ceilometer-compute:2018-09-20.1 Removing local copy of 192.168.24.1:8787/rhosp14/openstack-cinder-backup:2018-09-20.1 Removing local copy of 192.168.24.1:8787/rhosp14/openstack-collectd:2018-09-20.1 Removing local copy of 192.168.24.1:8787/rhosp14/openstack-designate-api:2018-09-20.1 Removing local copy of 192.168.24.1:8787/rhosp14/openstack-designate-backend-bind9:2018-09-20.1 Removing local copy of 192.168.24.1:8787/rhosp14/openstack-designate-central:2018-09-20.1 Removing local copy of 192.168.24.1:8787/rhosp14/openstack-designate-mdns:2018-09-20.1 Removing local copy of 192.168.24.1:8787/rhosp14/openstack-designate-producer:2018-09-20.1 Removing local copy of 192.168.24.1:8787/rhosp14/openstack-designate-sink:2018-09-20.1 Removing local copy of 192.168.24.1:8787/rhosp14/openstack-designate-worker:2018-09-20.1 Removing local copy of 192.168.24.1:8787/rhosp14/openstack-ec2-api:2018-09-20.1 Removing local copy of 192.168.24.1:8787/rhosp14/openstack-etcd:2018-09-20.1 Removing local copy of 192.168.24.1:8787/rhosp14/openstack-fluentd:2018-09-20.1 Removing local copy of 192.168.24.1:8787/rhosp14/openstack-horizon:2018-09-20.1 Removing local copy of 192.168.24.1:8787/rhosp14/openstack-manila-api:2018-09-20.1 Removing local copy of 192.168.24.1:8787/rhosp14/openstack-manila-scheduler:2018-09-20.1 Removing local copy of 192.168.24.1:8787/rhosp14/openstack-manila-share:2018-09-20.1 Removing local copy of 192.168.24.1:8787/rhosp14/openstack-neutron-server-opendaylight:2018-09-20.1 Removing local copy of 192.168.24.1:8787/rhosp14/openstack-nova-compute:2018-09-20.1 Removing local copy of 192.168.24.1:8787/rhosp14/openstack-nova-consoleauth:2018-09-20.1 Removing local copy of 192.168.24.1:8787/rhosp14/openstack-nova-libvirt:2018-09-20.1 Removing local copy of 192.168.24.1:8787/rhosp14/openstack-nova-novncproxy:2018-09-20.1 Removing local copy of 192.168.24.1:8787/rhosp14/openstack-octavia-api:2018-09-20.1 Removing local copy of 192.168.24.1:8787/rhosp14/openstack-octavia-health-manager:2018-09-20.1 Removing local copy of 192.168.24.1:8787/rhosp14/openstack-octavia-housekeeping:2018-09-20.1 Removing local copy of 192.168.24.1:8787/rhosp14/openstack-octavia-worker:2018-09-20.1 Removing local copy of 192.168.24.1:8787/rhosp14/openstack-opendaylight:2018-09-20.1 Removing local copy of 192.168.24.1:8787/rhosp14/openstack-sahara-api:2018-09-20.1 Removing local copy of 192.168.24.1:8787/rhosp14/openstack-sahara-engine:2018-09-20.1 Removing local copy of 192.168.24.1:8787/rhosp14/openstack-sensu-client:2018-09-20.1 Removing local copy of brew-pulp-docker01.web.prod.ext.phx2.redhat.com:8888/rhceph:3-12 Removing local copy of rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-ceilometer-compute:2018-09-20.1 Removing local copy of rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-cinder-backup:2018-09-20.1 Removing local copy of rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-collectd:2018-09-20.1 Removing local copy of rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-designate-api:2018-09-20.1 Removing local copy of rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-designate-backend-bind9:2018-09-20.1 Removing local copy of rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-designate-central:2018-09-20.1 Removing local copy of rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-designate-mdns:2018-09-20.1 Removing local copy of rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-designate-producer:2018-09-20.1 Removing local copy of rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-designate-sink:2018-09-20.1 Removing local copy of rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-designate-worker:2018-09-20.1 Removing local copy of rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-ec2-api:2018-09-20.1 Removing local copy of rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-etcd:2018-09-20.1 Removing local copy of rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-fluentd:2018-09-20.1 Removing local copy of rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-horizon:2018-09-20.1 Removing local copy of rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-manila-api:2018-09-20.1 Removing local copy of rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-manila-scheduler:2018-09-20.1 Removing local copy of rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-manila-share:2018-09-20.1 Removing local copy of rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-neutron-server-opendaylight:2018-09-20.1 Removing local copy of rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-nova-compute:2018-09-20.1 Removing local copy of rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-nova-consoleauth:2018-09-20.1 Removing local copy of rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-nova-libvirt:2018-09-20.1 Removing local copy of rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-nova-novncproxy:2018-09-20.1 Removing local copy of rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-octavia-api:2018-09-20.1 Removing local copy of rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-octavia-health-manager:2018-09-20.1 Removing local copy of rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-octavia-housekeeping:2018-09-20.1 Removing local copy of rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-octavia-worker:2018-09-20.1 Removing local copy of rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-opendaylight:2018-09-20.1 Removing local copy of rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-sahara-api:2018-09-20.1 Removing local copy of rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-sahara-engine:2018-09-20.1 Removing local copy of rhos-qe-mirror-rdu2.usersys.redhat.com:5000/rhosp14/openstack-sensu-client:2018-09-20.1 [stack@undercloud-0 ~]$ [stack@undercloud-0 ~]$ [stack@undercloud-0 ~]$ grep -i ovn test.yaml # openstack tripleo container image prepare -e /home/stack/containers-prepare-parameter.yaml -e /usr/share/openstack-tripleo-heat-templates/environments/services/neutron-ovn-ha.yaml --output-env-file test.yaml DockerNovaVncProxyImage: 192.168.24.1:8787/rhosp14/openstack-nova-novncproxy:2018-09-20.1 [stack@undercloud-0 ~]$ cat test.yaml # Generated with the following on 2018-09-26T10:54:14.452895 # # openstack tripleo container image prepare -e /home/stack/containers-prepare-parameter.yaml -e /usr/share/openstack-tripleo-heat-templates/environments/services/neutron-ovn-ha.yaml --output-env-file test.yaml # parameter_defaults: DockerAodhApiImage: 192.168.24.1:8787/rhosp14/openstack-aodh-api:2018-09-20.1 DockerAodhConfigImage: 192.168.24.1:8787/rhosp14/openstack-aodh-api:2018-09-20.1 DockerAodhEvaluatorImage: 192.168.24.1:8787/rhosp14/openstack-aodh-evaluator:2018-09-20.1 DockerAodhListenerImage: 192.168.24.1:8787/rhosp14/openstack-aodh-listener:2018-09-20.1 DockerAodhNotifierImage: 192.168.24.1:8787/rhosp14/openstack-aodh-notifier:2018-09-20.1 DockerBarbicanApiImage: 192.168.24.1:8787/rhosp14/openstack-barbican-api:2018-09-20.1 DockerBarbicanConfigImage: 192.168.24.1:8787/rhosp14/openstack-barbican-api:2018-09-20.1 DockerBarbicanKeystoneListenerConfigImage: 192.168.24.1:8787/rhosp14/openstack-barbican-keystone-listener:2018-09-20.1 DockerBarbicanKeystoneListenerImage: 192.168.24.1:8787/rhosp14/openstack-barbican-keystone-listener:2018-09-20.1 DockerBarbicanWorkerConfigImage: 192.168.24.1:8787/rhosp14/openstack-barbican-worker:2018-09-20.1 DockerBarbicanWorkerImage: 192.168.24.1:8787/rhosp14/openstack-barbican-worker:2018-09-20.1 DockerCeilometerCentralImage: 192.168.24.1:8787/rhosp14/openstack-ceilometer-central:2018-09-20.1 DockerCeilometerComputeImage: 192.168.24.1:8787/rhosp14/openstack-ceilometer-compute:2018-09-20.1 DockerCeilometerConfigImage: 192.168.24.1:8787/rhosp14/openstack-ceilometer-central:2018-09-20.1 DockerCeilometerNotificationImage: 192.168.24.1:8787/rhosp14/openstack-ceilometer-notification:2018-09-20.1 DockerCephDaemonImage: 192.168.24.1:8787/rhceph:3-12 DockerCinderApiImage: 192.168.24.1:8787/rhosp14/openstack-cinder-api:2018-09-20.1 DockerCinderBackupImage: 192.168.24.1:8787/rhosp14/openstack-cinder-backup:2018-09-20.1 DockerCinderConfigImage: 192.168.24.1:8787/rhosp14/openstack-cinder-api:2018-09-20.1 DockerCinderSchedulerImage: 192.168.24.1:8787/rhosp14/openstack-cinder-scheduler:2018-09-20.1 DockerCinderVolumeImage: 192.168.24.1:8787/rhosp14/openstack-cinder-volume:2018-09-20.1 DockerClustercheckConfigImage: 192.168.24.1:8787/rhosp14/openstack-mariadb:2018-09-20.1 DockerClustercheckImage: 192.168.24.1:8787/rhosp14/openstack-mariadb:2018-09-20.1 DockerCollectdConfigImage: 192.168.24.1:8787/rhosp14/openstack-collectd:2018-09-20.1 DockerCollectdImage: 192.168.24.1:8787/rhosp14/openstack-collectd:2018-09-20.1 DockerCrondConfigImage: 192.168.24.1:8787/rhosp14/openstack-cron:2018-09-20.1 DockerCrondImage: 192.168.24.1:8787/rhosp14/openstack-cron:2018-09-20.1 DockerDesignateApiImage: 192.168.24.1:8787/rhosp14/openstack-designate-api:2018-09-20.1 DockerDesignateBackendBIND9Image: 192.168.24.1:8787/rhosp14/openstack-designate-backend-bind9:2018-09-20.1 DockerDesignateCentralImage: 192.168.24.1:8787/rhosp14/openstack-designate-central:2018-09-20.1 DockerDesignateConfigImage: 192.168.24.1:8787/rhosp14/openstack-designate-worker:2018-09-20.1 DockerDesignateMDNSImage: 192.168.24.1:8787/rhosp14/openstack-designate-mdns:2018-09-20.1 DockerDesignateProducerImage: 192.168.24.1:8787/rhosp14/openstack-designate-producer:2018-09-20.1 DockerDesignateSinkImage: 192.168.24.1:8787/rhosp14/openstack-designate-sink:2018-09-20.1 DockerDesignateWorkerImage: 192.168.24.1:8787/rhosp14/openstack-designate-worker:2018-09-20.1 DockerEc2ApiConfigImage: 192.168.24.1:8787/rhosp14/openstack-ec2-api:2018-09-20.1 DockerEc2ApiImage: 192.168.24.1:8787/rhosp14/openstack-ec2-api:2018-09-20.1 DockerEtcdConfigImage: 192.168.24.1:8787/rhosp14/openstack-etcd:2018-09-20.1 DockerEtcdImage: 192.168.24.1:8787/rhosp14/openstack-etcd:2018-09-20.1 DockerFluentdClientImage: 192.168.24.1:8787/rhosp14/openstack-fluentd:2018-09-20.1 DockerFluentdConfigImage: 192.168.24.1:8787/rhosp14/openstack-fluentd:2018-09-20.1 DockerFluentdImage: 192.168.24.1:8787/rhosp14/openstack-fluentd:2018-09-20.1 DockerGlanceApiConfigImage: 192.168.24.1:8787/rhosp14/openstack-glance-api:2018-09-20.1 DockerGlanceApiImage: 192.168.24.1:8787/rhosp14/openstack-glance-api:2018-09-20.1 DockerGnocchiApiImage: 192.168.24.1:8787/rhosp14/openstack-gnocchi-api:2018-09-20.1 DockerGnocchiConfigImage: 192.168.24.1:8787/rhosp14/openstack-gnocchi-api:2018-09-20.1 DockerGnocchiMetricdImage: 192.168.24.1:8787/rhosp14/openstack-gnocchi-metricd:2018-09-20.1 DockerGnocchiStatsdImage: 192.168.24.1:8787/rhosp14/openstack-gnocchi-statsd:2018-09-20.1 DockerHAProxyConfigImage: 192.168.24.1:8787/rhosp14/openstack-haproxy:2018-09-20.1 DockerHAProxyImage: 192.168.24.1:8787/rhosp14/openstack-haproxy:2018-09-20.1 DockerHeatApiCfnConfigImage: 192.168.24.1:8787/rhosp14/openstack-heat-api-cfn:2018-09-20.1 DockerHeatApiCfnImage: 192.168.24.1:8787/rhosp14/openstack-heat-api-cfn:2018-09-20.1 DockerHeatApiConfigImage: 192.168.24.1:8787/rhosp14/openstack-heat-api:2018-09-20.1 DockerHeatApiImage: 192.168.24.1:8787/rhosp14/openstack-heat-api:2018-09-20.1 DockerHeatConfigImage: 192.168.24.1:8787/rhosp14/openstack-heat-api:2018-09-20.1 DockerHeatEngineImage: 192.168.24.1:8787/rhosp14/openstack-heat-engine:2018-09-20.1 DockerHorizonConfigImage: 192.168.24.1:8787/rhosp14/openstack-horizon:2018-09-20.1 DockerHorizonImage: 192.168.24.1:8787/rhosp14/openstack-horizon:2018-09-20.1 DockerInsecureRegistryAddress: - 192.168.24.1:8787 DockerIronicApiConfigImage: 192.168.24.1:8787/rhosp14/openstack-ironic-api:2018-09-20.1 DockerIronicApiImage: 192.168.24.1:8787/rhosp14/openstack-ironic-api:2018-09-20.1 DockerIronicConductorImage: 192.168.24.1:8787/rhosp14/openstack-ironic-conductor:2018-09-20.1 DockerIronicConfigImage: 192.168.24.1:8787/rhosp14/openstack-ironic-pxe:2018-09-20.1 DockerIronicInspectorConfigImage: 192.168.24.1:8787/rhosp14/openstack-ironic-inspector:2018-09-20.1 DockerIronicInspectorImage: 192.168.24.1:8787/rhosp14/openstack-ironic-inspector:2018-09-20.1 DockerIronicNeutronAgentImage: 192.168.24.1:8787/rhosp14/openstack-ironic-neutron-agent:2018-09-20.1 DockerIronicPxeImage: 192.168.24.1:8787/rhosp14/openstack-ironic-pxe:2018-09-20.1 DockerIscsidConfigImage: 192.168.24.1:8787/rhosp14/openstack-iscsid:2018-09-20.1 DockerIscsidImage: 192.168.24.1:8787/rhosp14/openstack-iscsid:2018-09-20.1 DockerKeepalivedConfigImage: 192.168.24.1:8787/rhosp14/openstack-keepalived:2018-09-20.1 DockerKeepalivedImage: 192.168.24.1:8787/rhosp14/openstack-keepalived:2018-09-20.1 DockerKeystoneConfigImage: 192.168.24.1:8787/rhosp14/openstack-keystone:2018-09-20.1 DockerKeystoneImage: 192.168.24.1:8787/rhosp14/openstack-keystone:2018-09-20.1 DockerManilaApiImage: 192.168.24.1:8787/rhosp14/openstack-manila-api:2018-09-20.1 DockerManilaConfigImage: 192.168.24.1:8787/rhosp14/openstack-manila-api:2018-09-20.1 DockerManilaSchedulerImage: 192.168.24.1:8787/rhosp14/openstack-manila-scheduler:2018-09-20.1 DockerManilaShareImage: 192.168.24.1:8787/rhosp14/openstack-manila-share:2018-09-20.1 DockerMemcachedConfigImage: 192.168.24.1:8787/rhosp14/openstack-memcached:2018-09-20.1 DockerMemcachedImage: 192.168.24.1:8787/rhosp14/openstack-memcached:2018-09-20.1 DockerMistralApiImage: 192.168.24.1:8787/rhosp14/openstack-mistral-api:2018-09-20.1 DockerMistralConfigImage: 192.168.24.1:8787/rhosp14/openstack-mistral-api:2018-09-20.1 DockerMistralEngineImage: 192.168.24.1:8787/rhosp14/openstack-mistral-engine:2018-09-20.1 DockerMistralEventEngineImage: 192.168.24.1:8787/rhosp14/openstack-mistral-event-engine:2018-09-20.1 DockerMistralExecutorImage: 192.168.24.1:8787/rhosp14/openstack-mistral-executor:2018-09-20.1 DockerMysqlClientConfigImage: 192.168.24.1:8787/rhosp14/openstack-mariadb:2018-09-20.1 DockerMysqlConfigImage: 192.168.24.1:8787/rhosp14/openstack-mariadb:2018-09-20.1 DockerMysqlImage: 192.168.24.1:8787/rhosp14/openstack-mariadb:2018-09-20.1 DockerNeutronApiImage: 192.168.24.1:8787/rhosp14/openstack-neutron-server-opendaylight:2018-09-20.1 DockerNeutronConfigImage: 192.168.24.1:8787/rhosp14/openstack-neutron-server-opendaylight:2018-09-20.1 DockerNovaApiImage: 192.168.24.1:8787/rhosp14/openstack-nova-api:2018-09-20.1 DockerNovaComputeImage: 192.168.24.1:8787/rhosp14/openstack-nova-compute:2018-09-20.1 DockerNovaComputeIronicImage: 192.168.24.1:8787/rhosp14/openstack-nova-compute-ironic:2018-09-20.1 DockerNovaConductorImage: 192.168.24.1:8787/rhosp14/openstack-nova-conductor:2018-09-20.1 DockerNovaConfigImage: 192.168.24.1:8787/rhosp14/openstack-nova-api:2018-09-20.1 DockerNovaConsoleauthImage: 192.168.24.1:8787/rhosp14/openstack-nova-consoleauth:2018-09-20.1 DockerNovaLibvirtConfigImage: 192.168.24.1:8787/rhosp14/openstack-nova-compute:2018-09-20.1 DockerNovaLibvirtImage: 192.168.24.1:8787/rhosp14/openstack-nova-libvirt:2018-09-20.1 DockerNovaMetadataConfigImage: 192.168.24.1:8787/rhosp14/openstack-nova-api:2018-09-20.1 DockerNovaMetadataImage: 192.168.24.1:8787/rhosp14/openstack-nova-api:2018-09-20.1 DockerNovaPlacementConfigImage: 192.168.24.1:8787/rhosp14/openstack-nova-placement-api:2018-09-20.1 DockerNovaPlacementImage: 192.168.24.1:8787/rhosp14/openstack-nova-placement-api:2018-09-20.1 DockerNovaSchedulerImage: 192.168.24.1:8787/rhosp14/openstack-nova-scheduler:2018-09-20.1 DockerNovaVncProxyImage: 192.168.24.1:8787/rhosp14/openstack-nova-novncproxy:2018-09-20.1 DockerOctaviaApiImage: 192.168.24.1:8787/rhosp14/openstack-octavia-api:2018-09-20.1 DockerOctaviaConfigImage: 192.168.24.1:8787/rhosp14/openstack-octavia-api:2018-09-20.1 DockerOctaviaHealthManagerImage: 192.168.24.1:8787/rhosp14/openstack-octavia-health-manager:2018-09-20.1 DockerOctaviaHousekeepingImage: 192.168.24.1:8787/rhosp14/openstack-octavia-housekeeping:2018-09-20.1 DockerOctaviaWorkerImage: 192.168.24.1:8787/rhosp14/openstack-octavia-worker:2018-09-20.1 DockerOpendaylightApiImage: 192.168.24.1:8787/rhosp14/openstack-opendaylight:2018-09-20.1 DockerOpendaylightConfigImage: 192.168.24.1:8787/rhosp14/openstack-opendaylight:2018-09-20.1 DockerPankoApiImage: 192.168.24.1:8787/rhosp14/openstack-panko-api:2018-09-20.1 DockerPankoConfigImage: 192.168.24.1:8787/rhosp14/openstack-panko-api:2018-09-20.1 DockerRabbitmqConfigImage: 192.168.24.1:8787/rhosp14/openstack-rabbitmq:2018-09-20.1 DockerRabbitmqImage: 192.168.24.1:8787/rhosp14/openstack-rabbitmq:2018-09-20.1 DockerRedisConfigImage: 192.168.24.1:8787/rhosp14/openstack-redis:2018-09-20.1 DockerRedisImage: 192.168.24.1:8787/rhosp14/openstack-redis:2018-09-20.1 DockerSaharaApiImage: 192.168.24.1:8787/rhosp14/openstack-sahara-api:2018-09-20.1 DockerSaharaConfigImage: 192.168.24.1:8787/rhosp14/openstack-sahara-api:2018-09-20.1 DockerSaharaEngineImage: 192.168.24.1:8787/rhosp14/openstack-sahara-engine:2018-09-20.1 DockerSensuClientImage: 192.168.24.1:8787/rhosp14/openstack-sensu-client:2018-09-20.1 DockerSensuConfigImage: 192.168.24.1:8787/rhosp14/openstack-sensu-client:2018-09-20.1 DockerSwiftAccountImage: 192.168.24.1:8787/rhosp14/openstack-swift-account:2018-09-20.1 DockerSwiftConfigImage: 192.168.24.1:8787/rhosp14/openstack-swift-proxy-server:2018-09-20.1 DockerSwiftContainerImage: 192.168.24.1:8787/rhosp14/openstack-swift-container:2018-09-20.1 DockerSwiftObjectImage: 192.168.24.1:8787/rhosp14/openstack-swift-object:2018-09-20.1 DockerSwiftProxyImage: 192.168.24.1:8787/rhosp14/openstack-swift-proxy-server:2018-09-20.1 DockerZaqarConfigImage: 192.168.24.1:8787/rhosp14/openstack-zaqar:2018-09-20.1 DockerZaqarImage: 192.168.24.1:8787/rhosp14/openstack-zaqar:2018-09-20.1
Thanks a lot Marius for your answer. Can't then we just pass in the environment files including neutron-ml2-ovn-dvr.ha there? That should 'mimic' the scenario007 file used in tripleo upstream CI.
Disregard my last comment, you were passing the file already in your last paste and didn't work
These upstream changes will need to be backported as soon as they land. In the meantime, the workaround would be to have a separate call to "openstack tripleo container image prepare" which includes an environment that maps OS::TripleO::Services::OVNController in the resource_registry
Feel free to kick this bug over to DFG:DF. Opendaylight will be similarly affected.
https://review.gerrithub.io/#/c/redhat-openstack/infrared/+/428268/ should fix the infrared side ... using this change while deploying OVN using infrared in CI should generate the image files/variables for OVN... will merge it when it's tested more
(In reply to Waldemar Znoinski from comment #22) > https://review.gerrithub.io/#/c/redhat-openstack/infrared/+/428268/ should > fix the infrared side ... using this change while deploying OVN using > infrared in CI should generate the image files/variables for OVN... > will merge it when it's tested more I believe the Infrared patch is supposed to be just a workaround until the product related patches land in a downstream puddle. The change doesn't reflect the expected workflow for containers image prepare, see https://review.gerrithub.io/#/c/redhat-openstack/infrared/+/427124/
(In reply to Marius Cornea from comment #24) > (In reply to Waldemar Znoinski from comment #22) > > https://review.gerrithub.io/#/c/redhat-openstack/infrared/+/428268/ should > > fix the infrared side ... using this change while deploying OVN using > > infrared in CI should generate the image files/variables for OVN... > > will merge it when it's tested more > > I believe the Infrared patch is supposed to be just a workaround until the > product related patches land in a downstream puddle. The change doesn't > reflect the expected workflow for containers image prepare, see > https://review.gerrithub.io/#/c/redhat-openstack/infrared/+/427124/ I may be missing a piece of a puzzle here but how NeutronMechanismDrivers gets passed to overcloud command ?
(In reply to Waldemar Znoinski from comment #25) > (In reply to Marius Cornea from comment #24) > > (In reply to Waldemar Znoinski from comment #22) > > > https://review.gerrithub.io/#/c/redhat-openstack/infrared/+/428268/ should > > > fix the infrared side ... using this change while deploying OVN using > > > infrared in CI should generate the image files/variables for OVN... > > > will merge it when it's tested more > > > > I believe the Infrared patch is supposed to be just a workaround until the > > product related patches land in a downstream puddle. The change doesn't > > reflect the expected workflow for containers image prepare, see > > https://review.gerrithub.io/#/c/redhat-openstack/infrared/+/427124/ > > I may be missing a piece of a puzzle here but how NeutronMechanismDrivers > gets passed to overcloud command ? also, just to be clear, we need to have odl images available before overcloud deploy command in scenarios when we patch the container (i.e.: install new version of ODL RPM) before deployment
(In reply to Waldemar Znoinski from comment #25) > (In reply to Marius Cornea from comment #24) > > (In reply to Waldemar Znoinski from comment #22) > > > https://review.gerrithub.io/#/c/redhat-openstack/infrared/+/428268/ should > > > fix the infrared side ... using this change while deploying OVN using > > > infrared in CI should generate the image files/variables for OVN... > > > will merge it when it's tested more > > > > I believe the Infrared patch is supposed to be just a workaround until the > > product related patches land in a downstream puddle. The change doesn't > > reflect the expected workflow for containers image prepare, see > > https://review.gerrithub.io/#/c/redhat-openstack/infrared/+/427124/ > > I may be missing a piece of a puzzle here but how NeutronMechanismDrivers > gets passed to overcloud command ? The NeutronMechanismDrivers parameter is set inside the environment files that enable the services: https://github.com/openstack/tripleo-heat-templates/blob/master/environments/services/neutron-opendaylight.yaml#L17 https://github.com/openstack/tripleo-heat-templates/blob/master/environments/services/neutron-ovn-ha.yaml#L17
(In reply to Waldemar Znoinski from comment #26) > (In reply to Waldemar Znoinski from comment #25) > > (In reply to Marius Cornea from comment #24) > > > (In reply to Waldemar Znoinski from comment #22) > > > > https://review.gerrithub.io/#/c/redhat-openstack/infrared/+/428268/ should > > > > fix the infrared side ... using this change while deploying OVN using > > > > infrared in CI should generate the image files/variables for OVN... > > > > will merge it when it's tested more > > > > > > I believe the Infrared patch is supposed to be just a workaround until the > > > product related patches land in a downstream puddle. The change doesn't > > > reflect the expected workflow for containers image prepare, see > > > https://review.gerrithub.io/#/c/redhat-openstack/infrared/+/427124/ > > > > I may be missing a piece of a puzzle here but how NeutronMechanismDrivers > > gets passed to overcloud command ? > > also, just to be clear, we need to have odl images available before > overcloud deploy command in scenarios when we patch the container (i.e.: > install new version of ODL RPM) before deployment I guess this should be doable via the tripleo-modify-image role as described in https://docs.openstack.org/tripleo-docs/latest/install/advanced_deployment/container_image_prepare.html#modifying-images-during-prepare
Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory, and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHEA-2019:0045