Bug 1608903
| Summary: | [OSP14] unhealthy state for heat_api_cnf and heat_api containers on Undercloud node | ||
|---|---|---|---|
| Product: | Red Hat OpenStack | Reporter: | Artem Hrechanychenko <ahrechan> |
| Component: | openstack-heat | Assignee: | Thomas Hervé <therve> |
| Status: | CLOSED ERRATA | QA Contact: | Victor Voronkov <vvoronko> |
| Severity: | medium | Docs Contact: | |
| Priority: | medium | ||
| Version: | 14.0 (Rocky) | CC: | ahrechan, aschultz, jcoufal, jschluet, m.andre, mburns, mcornea, ramishra, sasha, sbaker, shardy, slinaber, therve, vvoronko |
| Target Milestone: | Upstream M3 | Keywords: | Triaged |
| Target Release: | 14.0 (Rocky) | ||
| Hardware: | x86_64 | ||
| OS: | Linux | ||
| Whiteboard: | |||
| Fixed In Version: | openstack-heat-11.0.1-0.20181010161427.46aacab.el7 | Doc Type: | If docs needed, set a value |
| Doc Text: | Story Points: | --- | |
| Clone Of: | Environment: | ||
| Last Closed: | 2019-01-11 11:50:58 UTC | Type: | Bug |
| Regression: | --- | Mount Type: | --- |
| Documentation: | --- | CRM: | |
| Verified Versions: | Category: | --- | |
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |
| Cloudforms Team: | --- | Target Upstream Version: | |
| Embargoed: | |||
*** Bug 1609963 has been marked as a duplicate of this bug. *** Did the undercloud deployment complete? A couple of questions: 1. Did the undercloud deployment complete? 2. Did you have SSL enabled (default) ? (In reply to Alexander Chuzhoy from comment #3) > A couple of questions: > > 1. Did the undercloud deployment complete? > 2. Did you have SSL enabled (default) ? Hey! 1) Yes, undercloud deployment was complete 2) Yes, SSL is default option for Undercloud since OSP14(afaik) OK, so the issue is that you're using a recent tripleo common, with a heat package that is ancient. The change landed there: https://review.openstack.org/#/c/574697/ It required the fixed in tripleo linked https://review.openstack.org/581904. So we need a more recent heat. Issue is still present with the attached patch included, could you please check?
[root@undercloud-0 stack]# cat /usr/share/openstack-tripleo-common/healthcheck/heat-api
#!/bin/sh
. ${HEALTHCHECK_SCRIPTS:-/usr/share/openstack-tripleo-common/healthcheck}/common.sh
check_url=$(get_url_from_vhost /etc/httpd/conf.d/10-heat_api_wsgi.conf)
healthcheck_curl ${check_url}
[root@undercloud-0 stack]#
[root@undercloud-0 stack]#
[root@undercloud-0 stack]#
[root@undercloud-0 stack]# rpm -q openstack-tripleo-common
openstack-tripleo-common-9.3.1-0.20180923215327.d22cb3e.el7ost.noarch
[root@undercloud-0 stack]# cat /usr/share/openstack-tripleo-common/healthcheck/heat-api
#!/bin/sh
. ${HEALTHCHECK_SCRIPTS:-/usr/share/openstack-tripleo-common/healthcheck}/common.sh
check_url=$(get_url_from_vhost /etc/httpd/conf.d/10-heat_api_wsgi.conf)
healthcheck_curl ${check_url}
[root@undercloud-0 stack]# docker ps | grep unhealthy
2ee724246dec 192.168.24.1:8787/rhosp14/openstack-nova-api:2018-10-08.4 "kolla_start" 4 hours ago Up 4 hours (unhealthy) nova_metadata
80d54861bc3c 192.168.24.1:8787/rhosp14/openstack-heat-api-cfn:2018-10-08.4 "kolla_start" 4 hours ago Up 4 hours (unhealthy) heat_api_cfn
d2e27ffb11ec 192.168.24.1:8787/rhosp14/openstack-heat-api:2018-10-08.4 "kolla_start" 4 hours ago Up 4 hours (unhealthy) heat_api
Works for me on BUILD 14 2018-11-07.2
root@undercloud-0 ~]# docker inspect --format='{{ .State.Health.Status}}' heat_api
healthy
[root@undercloud-0 ~]# docker inspect --format='{{ .State.Health.Status}}' heat_api_cfn
healthy
Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory, and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHEA-2019:0045 |
Description of problem: a9d8aae113eb docker-registry.engineering.redhat.com/rhosp14/openstack-heat-api-cfn:14.0-26 "kolla_start" 24 minutes ago Up 24 minutes (unhealthy) heat_api_cfn b67e08a8b25e docker-registry.engineering.redhat.com/rhosp14/openstack-heat-api:14.0-26 "kolla_start" 24 minutes ago Up 24 minutes (unhealthy) heat_api [stack@undercloud-0 ~]$ sudo docker inspect heat_api_cfn [ { "Id": "a9d8aae113eb0263df789d320378df537a24fe91de20374703e3d32910cbd92f", "Created": "2018-07-26T13:10:14.073674914Z", "Path": "kolla_start", "Args": [], "State": { "Status": "running", "Running": true, "Paused": false, "Restarting": false, "OOMKilled": false, "Dead": false, "Pid": 22736, "ExitCode": 0, "Error": "", "StartedAt": "2018-07-26T13:10:14.382851482Z", "FinishedAt": "0001-01-01T00:00:00Z", "Health": { "Status": "unhealthy", "FailingStreak": 34, "Log": [ { "Start": "2018-07-26T09:25:16.874693323-04:00", "End": "2018-07-26T09:25:16.971174755-04:00", "ExitCode": 1, "Output": "curl: (22) The requested URL returned error: 400 IncompleteSignature\n\n400 192.168.24.1:8000 0.006 seconds\n" }, { "Start": "2018-07-26T09:25:46.971369777-04:00", "End": "2018-07-26T09:25:47.071636248-04:00", "ExitCode": 1, "Output": "curl: (22) The requested URL returned error: 400 IncompleteSignature\n\n400 192.168.24.1:8000 0.006 seconds\n" }, { "Start": "2018-07-26T09:26:17.071968841-04:00", "End": "2018-07-26T09:26:17.169939379-04:00", "ExitCode": 1, "Output": "curl: (22) The requested URL returned error: 400 IncompleteSignature\n\n400 192.168.24.1:8000 0.006 seconds\n" }, { "Start": "2018-07-26T09:26:47.170104512-04:00", "End": "2018-07-26T09:26:47.277947768-04:00", "ExitCode": 1, "Output": "\n400 192.168.24.1:8000 0.006 seconds\ncurl: (22) The requested URL returned error: 400 IncompleteSignature\n" }, { "Start": "2018-07-26T09:27:17.278810541-04:00", "End": "2018-07-26T09:27:17.380393398-04:00", "ExitCode": 1, "Output": "curl: (22) The requested URL returned error: 400 IncompleteSignature\n\n400 192.168.24.1:8000 0.008 seconds\n" } ] } Version-Release number of selected component (if applicable): OSP14 puddle from 2018-07-25.2 How reproducible: Alway Steps to Reproduce: 1.Deploy OSP14 undercloud 2. Check containers Actual results: heat_api and heat_api_cnf containers in unhealthy state Expected results: all containers is a healthy Additional info: