Bug 2267924 - Task Create containers managed by Podman for step 1 fails with /run/openvswitch duplicate mount destination
Summary: Task Create containers managed by Podman for step 1 fails with /run/openvswit...
Keywords:
Status: CLOSED CURRENTRELEASE
Alias: None
Product: Red Hat OpenStack
Classification: Red Hat
Component: documentation
Version: 17.1 (Wallaby)
Hardware: x86_64
OS: Linux
medium
medium
Target Milestone: ---
: ---
Assignee: RHOS Documentation Team
QA Contact: RHOS Documentation Team
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2024-03-05 15:52 UTC by Luigi Tamagnone
Modified: 2024-08-15 04:25 UTC (History)
8 users (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2024-04-16 13:29:10 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Red Hat Bugzilla 2265697 0 high CLOSED at compute node openstack-neutron-openvswitch-agent container is pulled always from registry.redhat.io despite underclou... 2024-05-22 20:40:54 UTC
Red Hat Bugzilla 2266206 0 high CLOSED Task Generate container puppet configs for step 1 fails with TypeError 2024-05-22 20:44:57 UTC
Red Hat Issue Tracker OSP-31559 0 None None None 2024-03-05 15:58:11 UTC

Description Luigi Tamagnone 2024-03-05 15:52:02 UTC
Description of problem:

Deployment fails with:
~~~
2024-03-04 16:28:56,660 p=690876 u=stack n=ansible | 2024-03-04 16:28:56.657501 |                                      |    WARNING | ERROR: Can't run container container-puppet-neutron stderr: Error: /run/openvswitch: duplicate mount destination
2024-03-04 16:28:56,662 p=690876 u=stack n=ansible | 2024-03-04 16:28:56.661723 | 000c29ab-81c7-5829-16bd-0000000035c8 |      FATAL | Create containers managed by Podman for /var/lib/tripleo-config/container-puppet-``
config/step_1 | compute-0 | error={"changed": false, "msg": "Failed containers: container-puppet-neutron"}
~~~

From compute logs:
~~~
Mar  4 14:27:24 compute-0 python3[17714]: ansible-tripleo_container_manage PODMAN-CONTAINER-DEBUG: podman run --name container-puppet-neutron --conmon-pidfile /run/container-puppet-neutron.pid --detach=False --entrypoint /var/lib/container-puppet/container-puppet.sh --env STEP=6 --env NET_HOST=true --env DEBUG=false --env HOSTNAME=compute-0 --env NO_ARCHIVE= --env PUPPET_TAGS=file,file_line,concat,augeas,cron,neutron_config,neutron_agent_ovs,neutron_plugin_ml2,neutron_config,ovn_metadata_agent_config --env NAME=neutron --env STEP_CONFIG=include ::tripleo::packages#012include tripleo::profile::base::neutron::ovs#012#012include tripleo::profile::base::neutron::ovn_metadata#012 --label config_id=tripleo_puppet_step1 --label container_name=container-puppet-neutron --label managed_by=tripleo_ansible --label config_data={'security_opt': ['label=disable'], 'user': 0, 'detach': False, 'recreate': True, 'entrypoint': '/var/lib/container-puppet/container-puppet.sh', 'environment': {'STEP': 6, 'NET_HOST': 'true', 'DEBUG': 'false', 'HOSTNAME': 'compute-0', 'NO_ARCHIVE': '', 'PUPPET_TAGS': 'file,file_line,concat,augeas,cron,neutron_config,neutron_agent_ovs,neutron_plugin_ml2,neutron_config,ovn_metadata_agent_config', 'NAME': 'neutron', 'STEP_CONFIG': 'include ::tripleo::packages\ninclude tripleo::profile::base::neutron::ovs\n\ninclude tripleo::profile::base::neutron::ovn_metadata\n'}, 'net': ['host'], 'image': 'fijocloud-char-u2.ctlplane.localdomain:8787/rhosp-rhel9/openstack-neutron-server:17.1', 
'volumes': ['/dev/log:/dev/log:rw', '/etc/hosts:/etc/hosts:ro', '/etc/localtime:/etc/localtime:ro', '/etc/modules-load.d:/etc/modules-load.d', '/etc/pki/ca-trust/extracted:/etc/pki/ca-trust/extracted:ro', '/etc/pki/tls/cert.pem:/etc/pki/tls/cert.pem:ro', '/etc/pki/tls/certs/ca-bundle.crt:/etc/pki/tls/certs/ca-bundle.crt:ro', '/etc/pki/tls/certs/ca-bundle.trust.crt:/etc/pki/tls/certs/ca-bundle.trust.crt:ro', '/etc/puppet:/tmp/puppet-etc:ro', '/lib/modules:/lib/modules:ro', '/run/openvswitch:/run/openvswitch', '/run/openvswitch:/run/openvswitch:shared,z', '/usr/share/openstack-puppet/modules:/usr/share/openstack-puppet/modules:ro', '/var/lib/config-data:/var/lib/config-data:rw', '/var/lib/container-puppet/container-puppet.sh:/var/lib/container-puppet/container-puppet.sh:ro', '/var/lib/container-puppet/puppetlabs/facter.conf:/etc/puppetlabs/facter/facter.conf:ro', '/var/lib/container-puppet/puppetlabs:/opt/puppetlabs:ro']} --log-driver k8s-file --log-opt path=/var/log/containers/stdouts/container-puppet-neutron.log --network host --security-opt label=disable --user 0 --volume /dev/log:/dev/log:rw --volume /etc/hosts:/etc/hosts:ro --volume /etc/localtime:/etc/localtime:ro --volume /etc/modules-load.d:/etc/modules-load.d --volume /etc/pki/ca-trust/extracted:/etc/pki/ca-trust/extracted:ro --volume /etc/pki/tls/cert.pem:/etc/pki/tls/cert.pem:ro --volume /etc/pki/tls/certs/ca-bundle.crt:/etc/pki/tls/certs/ca-bundle.crt:ro --volume /etc/pki/tls/certs/ca-bundle.trust.crt:/etc/pki/tls/certs/ca-bundle.trust.crt:ro --volume /etc/puppet:/tmp/puppet-etc:ro --volume /lib/modules:/lib/modules:ro --volume /run/openvswitch:/run/openvswitch --volume /run/openvswitch:/run/openvswitch:shared,z --volume /usr/share/openstack-puppet/modules:/usr/share/openstack-puppet/modules:ro --volume /var/lib/config-data:/var/lib/config-data:rw --volume /var/lib/container-puppet/container-puppet.sh:/var/lib/container-puppet/container-puppet.sh:ro --volume /var/lib/container-puppet/puppetlabs/facter.conf:/etc/puppetlabs/facter/facter.conf:ro --volume /var/lib/container-puppet/puppetlabs:/opt/puppetlabs:ro fijocloud-char-u2.ctlplane.localdomain:8787/rhosp-rhel9/openstack-neutron-server:17.1
Mar  4 14:27:24 compute-0 python3[17714]: ansible-tripleo_container_manage [WARNING] ERROR: Can't run container container-puppet-neutron#012stderr: Error: /run/openvswitch: duplicate mount destination
~~~

Version-Release number of selected component (if applicable):
Red Hat Openstack 17.1 (RHOSP17.1)

How reproducible:
All the time.

additional note:
The customer applied patchs from 2 BZs:
https://bugzilla.redhat.com/show_bug.cgi?id=2265697
https://bugzilla.redhat.com/show_bug.cgi?id=2266206

Comment 1 Brendan Shephard 2024-03-06 02:54:40 UTC
What is the version of tripleo-heat-templates in-use here?

Are they using the default templates, or using the `--templates` option in openstack overcloud deploy to specify their own template directory?

AFAIK, we haven't seen this issue anywhere else. Adding in the networking team to this BZ for their consultation.

Comment 2 Luigi Tamagnone 2024-03-06 09:10:05 UTC
openstack-tripleo-heat-templates-14.3.1-17.1.20231103010826.el9ost.noarch Thu Feb  1 11:56:03 2024

Comment 3 Luigi Tamagnone 2024-03-06 09:13:53 UTC
The customer applied a patch from upstream code[1], do you think it could be bound with it?


[1] https://code.engineering.redhat.com/gerrit/c/tripleo-ansible/+/450416

Comment 11 Greg Rakauskas 2024-04-16 13:21:30 UTC
Hi,

The NFV customer doc has been updated.

See BZ 2241212 for the details.

Best,
--Greg

Comment 12 Red Hat Bugzilla 2024-08-15 04:25:05 UTC
The needinfo request[s] on this closed bug have been removed as they have been unresolved for 120 days


Note You need to log in before you can comment on or make changes to this bug.