Bug 1705059 - OSP15 | Overcloud deployment fails when deploying with collectd template
Summary: OSP15 | Overcloud deployment fails when deploying with collectd template
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat OpenStack
Classification: Red Hat
Component: openstack-tripleo-heat-templates
Version: 15.0 (Stein)
Hardware: Unspecified
OS: Unspecified
urgent
urgent
Target Milestone: rc
: 15.0 (Stein)
Assignee: Matthias Runge
QA Contact: Leonid Natapov
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2019-05-01 10:55 UTC by Leonid Natapov
Modified: 2019-10-22 04:49 UTC (History)
8 users (show)

Fixed In Version: openstack-tripleo-heat-templates-10.5.1-0.20190505170356.8f563a7.el8ost
Doc Type: No Doc Update
Doc Text:
Clone Of:
Environment:
Last Closed: 2019-09-21 11:21:38 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
OpenStack gerrit 656794 0 'None' MERGED Avoid issues with non-existing directories 2020-12-03 02:24:38 UTC
OpenStack gerrit 656923 0 'None' MERGED Avoid issues with non-existing directories 2020-12-03 02:24:12 UTC
Red Hat Product Errata RHEA-2019:2811 0 None None None 2019-09-21 11:21:53 UTC

Description Leonid Natapov 2019-05-01 10:55:36 UTC
OSP15 | Overcloud deployment fails when deploying with collectd template
--------

"failed_when_result": true,
    "outputs.stdout_lines | default([]) | union(outputs.stderr_lines | default([]))": [
        "Error running ['podman', 'create', '--name', 'collectd', '--label', 'config_id=tripleo_step5', '--label', 'container_name=collectd', '--label', 'managed_by=paunch', '--label', 'config_data={\"environment\": [\"KOLLA_CONFIG_STRATEGY=COPY_ALWAYS\", \"TRIPLEO_CONFIG_HASH=9995b489fafa7e68eb0d8f0b41a2d636\"], \"healthcheck\": {\"test\": \"/openstack/healthcheck\"}, \"image\": \"192.168.24.1:8787/rhosp15/openstack-collectd:20190426.1\", \"net\": \"host\", \"pid\": \"host\", \"privileged\": true, \"restart\": \"always\", \"user\": \"root\", \"volumes\": [\"/etc/hosts:/etc/hosts:ro\", \"/etc/localtime:/etc/localtime:ro\", \"/etc/pki/ca-trust/extracted:/etc/pki/ca-trust/extracted:ro\", \"/etc/pki/ca-trust/source/anchors:/etc/pki/ca-trust/source/anchors:ro\", \"/etc/pki/tls/certs/ca-bundle.crt:/etc/pki/tls/certs/ca-bundle.crt:ro\", \"/etc/pki/tls/certs/ca-bundle.trust.crt:/etc/pki/tls/certs/ca-bundle.trust.crt:ro\", \"/etc/pki/tls/cert.pem:/etc/pki/tls/cert.pem:ro\", \"/dev/log:/dev/log\", \"/etc/ssh/ssh_known_hosts:/etc/ssh/ssh_known_hosts:ro\", \"/etc/puppet:/etc/puppet:ro\", \"/var/lib/kolla/config_files/collectd.json:/var/lib/kolla/config_files/config.json:ro\", \"/var/lib/config-data/puppet-generated/collectd/:/var/lib/kolla/config_files/src:ro\", \"/var/log/containers/collectd:/var/log/collectd:rw,z\", \"/var/run/openvswitch:/var/run/openvswitch:ro\", \"/var/run/ceph:/var/run/ceph:ro\", \"/var/run/libvirt:/var/run/libvirt:ro\"]}', '--conmon-pidfile=/var/run/collectd.pid', '--detach=true', '--log-driver', 'json-file', '--log-opt', 'path=/var/log/containers/stdouts/collectd.log', '--env=KOLLA_CONFIG_STRATEGY=COPY_ALWAYS', '--env=TRIPLEO_CONFIG_HASH=9995b489fafa7e68eb0d8f0b41a2d636', '--net=host', '--pid=host', '--privileged=true', '--user=root', '--volume=/etc/hosts:/etc/hosts:ro', '--volume=/etc/localtime:/etc/localtime:ro', '--volume=/etc/pki/ca-trust/extracted:/etc/pki/ca-trust/extracted:ro', '--volume=/etc/pki/ca-trust/source/anchors:/etc/pki/ca-trust/source/anchors:ro', '--volume=/etc/pki/tls/certs/ca-bundle.crt:/etc/pki/tls/certs/ca-bundle.crt:ro', '--volume=/etc/pki/tls/certs/ca-bundle.trust.crt:/etc/pki/tls/certs/ca-bundle.trust.crt:ro', '--volume=/etc/pki/tls/cert.pem:/etc/pki/tls/cert.pem:ro', '--volume=/dev/log:/dev/log', '--volume=/etc/ssh/ssh_known_hosts:/etc/ssh/ssh_known_hosts:ro', '--volume=/etc/puppet:/etc/puppet:ro', '--volume=/var/lib/kolla/config_files/collectd.json:/var/lib/kolla/config_files/config.json:ro', '--volume=/var/lib/config-data/puppet-generated/collectd/:/var/lib/kolla/config_files/src:ro', '--volume=/var/log/containers/collectd:/var/log/collectd:rw,z', '--volume=/var/run/openvswitch:/var/run/openvswitch:ro', '--volume=/var/run/ceph:/var/run/ceph:ro', '--volume=/var/run/libvirt:/var/run/libvirt:ro', '192.168.24.1:8787/rhosp15/openstack-collectd:20190426.1']. [125]",
        "",
        "stdout: ",
        "stderr: error checking path \"/var/run/ceph\": stat /var/run/ceph: no such file or directory",
        "stdout: Found 2 cell mappings.",
        "Skipping cell0 since it does not contain hosts.",
        "Getting computes from cell 'default': fae9868c-3d0c-44a4-9723-feb21faface1",
        "Creating host mapping for service compute-0.localdomain",
        "Found 1 unmapped computes in cell: fae9868c-3d0c-44a4-9723-feb21faface1",
        "stderr: + command -v python3",
        "+ python3 /container-config-scripts/nova_cell_v2_discover_hosts.py"
    ]

Comment 3 Matthias Runge 2019-05-02 14:42:24 UTC
please provide more info, based on the output, it looks like tripleo (something) messed up. Are you using ceph? Are you using ceph related plugins?

Comment 4 Matthias Runge 2019-05-02 14:48:05 UTC
Leonid, please provide more info. I can not see, where ceph gets into picture here, especially given that you mentioned on irc, you're not using ceph.

Comment 5 Matthias Runge 2019-05-02 15:13:34 UTC
https://github.com/openstack/tripleo-heat-templates/blob/master/deployment/metrics/collectd-container-puppet.yaml#L487

that line adds a hard reference to ceph, even if there is no ceph.

Comment 6 Matthias Runge 2019-05-02 15:23:29 UTC
Ok, the same is included in rocky
https://github.com/openstack/tripleo-heat-templates/blob/stable/queens/docker/services/collectd.yaml#L114

Does podman behave differently than docker?

Comment 7 Matthias Runge 2019-05-03 06:12:13 UTC
Fix to master was merged, proposed https://review.opendev.org/656923 as backport to stein.

Comment 8 Leonid Natapov 2019-05-03 08:14:47 UTC
(In reply to Matthias Runge from comment #5)
> https://github.com/openstack/tripleo-heat-templates/blob/master/deployment/
> metrics/collectd-container-puppet.yaml#L487
> 
> that line adds a hard reference to ceph, even if there is no ceph.

Hey,Matthias !

I am not using ceph at all. ceph not mentioned in any conf file that I am using in deploy command.
Probably podman vs docker issue as I didn't see such behavior before OSP15.

Comment 10 Matthias Runge 2019-05-06 05:48:22 UTC
The fix was merged into stein.

Comment 20 errata-xmlrpc 2019-09-21 11:21:38 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHEA-2019:2811


Note You need to log in before you can comment on or make changes to this bug.