Description of problem: Deployment fails with: ~~~ 2024-03-04 16:28:56,660 p=690876 u=stack n=ansible | 2024-03-04 16:28:56.657501 | | WARNING | ERROR: Can't run container container-puppet-neutron stderr: Error: /run/openvswitch: duplicate mount destination 2024-03-04 16:28:56,662 p=690876 u=stack n=ansible | 2024-03-04 16:28:56.661723 | 000c29ab-81c7-5829-16bd-0000000035c8 | FATAL | Create containers managed by Podman for /var/lib/tripleo-config/container-puppet-`` config/step_1 | compute-0 | error={"changed": false, "msg": "Failed containers: container-puppet-neutron"} ~~~ From compute logs: ~~~ Mar 4 14:27:24 compute-0 python3[17714]: ansible-tripleo_container_manage PODMAN-CONTAINER-DEBUG: podman run --name container-puppet-neutron --conmon-pidfile /run/container-puppet-neutron.pid --detach=False --entrypoint /var/lib/container-puppet/container-puppet.sh --env STEP=6 --env NET_HOST=true --env DEBUG=false --env HOSTNAME=compute-0 --env NO_ARCHIVE= --env PUPPET_TAGS=file,file_line,concat,augeas,cron,neutron_config,neutron_agent_ovs,neutron_plugin_ml2,neutron_config,ovn_metadata_agent_config --env NAME=neutron --env STEP_CONFIG=include ::tripleo::packages#012include tripleo::profile::base::neutron::ovs#012#012include tripleo::profile::base::neutron::ovn_metadata#012 --label config_id=tripleo_puppet_step1 --label container_name=container-puppet-neutron --label managed_by=tripleo_ansible --label config_data={'security_opt': ['label=disable'], 'user': 0, 'detach': False, 'recreate': True, 'entrypoint': '/var/lib/container-puppet/container-puppet.sh', 'environment': {'STEP': 6, 'NET_HOST': 'true', 'DEBUG': 'false', 'HOSTNAME': 'compute-0', 'NO_ARCHIVE': '', 'PUPPET_TAGS': 'file,file_line,concat,augeas,cron,neutron_config,neutron_agent_ovs,neutron_plugin_ml2,neutron_config,ovn_metadata_agent_config', 'NAME': 'neutron', 'STEP_CONFIG': 'include ::tripleo::packages\ninclude tripleo::profile::base::neutron::ovs\n\ninclude tripleo::profile::base::neutron::ovn_metadata\n'}, 'net': ['host'], 'image': 'fijocloud-char-u2.ctlplane.localdomain:8787/rhosp-rhel9/openstack-neutron-server:17.1', 'volumes': ['/dev/log:/dev/log:rw', '/etc/hosts:/etc/hosts:ro', '/etc/localtime:/etc/localtime:ro', '/etc/modules-load.d:/etc/modules-load.d', '/etc/pki/ca-trust/extracted:/etc/pki/ca-trust/extracted:ro', '/etc/pki/tls/cert.pem:/etc/pki/tls/cert.pem:ro', '/etc/pki/tls/certs/ca-bundle.crt:/etc/pki/tls/certs/ca-bundle.crt:ro', '/etc/pki/tls/certs/ca-bundle.trust.crt:/etc/pki/tls/certs/ca-bundle.trust.crt:ro', '/etc/puppet:/tmp/puppet-etc:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch', '/run/openvswitch:/run/openvswitch:shared,z', '/usr/share/openstack-puppet/modules:/usr/share/openstack-puppet/modules:ro', '/var/lib/config-data:/var/lib/config-data:rw', '/var/lib/container-puppet/container-puppet.sh:/var/lib/container-puppet/container-puppet.sh:ro', '/var/lib/container-puppet/puppetlabs/facter.conf:/etc/puppetlabs/facter/facter.conf:ro', '/var/lib/container-puppet/puppetlabs:/opt/puppetlabs:ro']} --log-driver k8s-file --log-opt path=/var/log/containers/stdouts/container-puppet-neutron.log --network host --security-opt label=disable --user 0 --volume /dev/log:/dev/log:rw --volume /etc/hosts:/etc/hosts:ro --volume /etc/localtime:/etc/localtime:ro --volume /etc/modules-load.d:/etc/modules-load.d --volume /etc/pki/ca-trust/extracted:/etc/pki/ca-trust/extracted:ro --volume /etc/pki/tls/cert.pem:/etc/pki/tls/cert.pem:ro --volume /etc/pki/tls/certs/ca-bundle.crt:/etc/pki/tls/certs/ca-bundle.crt:ro --volume /etc/pki/tls/certs/ca-bundle.trust.crt:/etc/pki/tls/certs/ca-bundle.trust.crt:ro --volume /etc/puppet:/tmp/puppet-etc:ro --volume /lib/modules:/lib/modules:ro --volume /run/openvswitch:/run/openvswitch --volume /run/openvswitch:/run/openvswitch:shared,z --volume /usr/share/openstack-puppet/modules:/usr/share/openstack-puppet/modules:ro --volume /var/lib/config-data:/var/lib/config-data:rw --volume /var/lib/container-puppet/container-puppet.sh:/var/lib/container-puppet/container-puppet.sh:ro --volume /var/lib/container-puppet/puppetlabs/facter.conf:/etc/puppetlabs/facter/facter.conf:ro --volume /var/lib/container-puppet/puppetlabs:/opt/puppetlabs:ro fijocloud-char-u2.ctlplane.localdomain:8787/rhosp-rhel9/openstack-neutron-server:17.1 Mar 4 14:27:24 compute-0 python3[17714]: ansible-tripleo_container_manage [WARNING] ERROR: Can't run container container-puppet-neutron#012stderr: Error: /run/openvswitch: duplicate mount destination ~~~ Version-Release number of selected component (if applicable): Red Hat Openstack 17.1 (RHOSP17.1) How reproducible: All the time. additional note: The customer applied patchs from 2 BZs: https://bugzilla.redhat.com/show_bug.cgi?id=2265697 https://bugzilla.redhat.com/show_bug.cgi?id=2266206
What is the version of tripleo-heat-templates in-use here? Are they using the default templates, or using the `--templates` option in openstack overcloud deploy to specify their own template directory? AFAIK, we haven't seen this issue anywhere else. Adding in the networking team to this BZ for their consultation.
openstack-tripleo-heat-templates-14.3.1-17.1.20231103010826.el9ost.noarch Thu Feb 1 11:56:03 2024
The customer applied a patch from upstream code[1], do you think it could be bound with it? [1] https://code.engineering.redhat.com/gerrit/c/tripleo-ansible/+/450416
Hi, The NFV customer doc has been updated. See BZ 2241212 for the details. Best, --Greg
The needinfo request[s] on this closed bug have been removed as they have been unresolved for 120 days