Bug 1246525
| Summary: | rhel-osp-director: Repeating "ironic-api" errors in /var/log/messages on the undercloud node. | ||||||
|---|---|---|---|---|---|---|---|
| Product: | Red Hat OpenStack | Reporter: | Alexander Chuzhoy <sasha> | ||||
| Component: | openstack-puppet-modules | Assignee: | Ivan Chavero <ichavero> | ||||
| Status: | CLOSED DUPLICATE | QA Contact: | Raviv Bar-Tal <rbartal> | ||||
| Severity: | medium | Docs Contact: | |||||
| Priority: | high | ||||||
| Version: | 7.0 (Kilo) | CC: | augol, calfonso, dblack, dcain, dhill, dmacpher, felipe.alfaro, gtrellu, jmelvin, jslagle, lmartins, mburns, michele, mori, oblaut, rhel-osp-director-maint, rhosp-bugs-internal, sclewis, ukalifon, yeylon | ||||
| Target Milestone: | z3 | Keywords: | Triaged, ZStream | ||||
| Target Release: | 7.0 (Kilo) | ||||||
| Hardware: | Unspecified | ||||||
| OS: | Unspecified | ||||||
| Whiteboard: | |||||||
| Fixed In Version: | openstack-puppet-modules-2015.1.8-22.el7ost | Doc Type: | Known Issue | ||||
| Doc Text: |
On the Undercloud, HAProxy is configured to run a HTTP check against the openstack-ironic-api service every 2 seconds. The check causes openstack-ironic-api to log a traceback to stderr with the errors:
error: [Errno 104] Connection reset by peer
error: [Errno 32] Broken pipe
Since the check runs every 2 seconds, these messages repeat frequently in /var/log/messages. As a workaround, switch to root permissions, edit /etc/haproxy/haproxy.cfg, and comment out the "option httpchk GET /" line from the ironic listener configuration:
listen ironic
bind 192.0.2.2:6385
bind 192.0.2.3:6385
# option httpchk GET /
server 192.0.2.1 192.0.2.1:6385 check fall 5 inter 2000 rise 2
Save the file, then restart haproxy:
sudo systemctl restart haproxy
No tracebacks from openstack-ironic-api are written to stderr.
|
Story Points: | --- | ||||
| Clone Of: | Environment: | ||||||
| Last Closed: | 2015-12-15 12:51:20 UTC | Type: | Bug | ||||
| Regression: | --- | Mount Type: | --- | ||||
| Documentation: | --- | CRM: | |||||
| Verified Versions: | Category: | --- | |||||
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |||||
| Cloudforms Team: | --- | Target Upstream Version: | |||||
| Embargoed: | |||||||
| Attachments: |
|
||||||
|
Description
Alexander Chuzhoy
2015-07-24 13:57:06 UTC
Created attachment 1055876 [details]
messages file
i can reproduce this on my non-SSL undercloud as well. It's the haproxy check, it must terminate the connection early for some reason, even though it gets a 200 OK from the ironic-api. If you comment out the check in /etc/haproxy/haproxy.cfg so that the ironic listener section looks like: listen ironic bind 192.0.2.2:6385 bind 192.0.2.3:6385 # option httpchk GET / server 192.0.2.1 192.0.2.1:6385 check fall 5 inter 2000 rise 2 Then the messages stop. I definitely don't consider this a blocker for GA, but will add the doc text as a known issue with the workaround. *** Bug 1257784 has been marked as a duplicate of this bug. *** *** Bug 1258979 has been marked as a duplicate of this bug. *** *** Bug 1263645 has been marked as a duplicate of this bug. *** *** Bug 1264200 has been marked as a duplicate of this bug. *** *** Bug 1262596 has been marked as a duplicate of this bug. *** the fix for this will be on the openstack-puppet-modules side. the upstream fix was included in https://review.openstack.org/#/c/197904 i see there is a downstream patch for that in the openstack-puppet-modules source (0023-Remove-httpchk-option-from-haproxy-listeners.patch) but it is actually missing the diff from the patch that removed this code from the haproxy::listen class for ironic: options => { 'option' => [ 'httpchk GET /' ], }, I believe this patch just needs to be updated or carry a new patch that removes the above lines from the ironic haproxy::listen class This bug has been fixed, but i need acks. can i have them please? (In reply to James Slagle from comment #11) > the fix for this will be on the openstack-puppet-modules side. > > the upstream fix was included in https://review.openstack.org/#/c/197904 > > i see there is a downstream patch for that in the openstack-puppet-modules > source (0023-Remove-httpchk-option-from-haproxy-listeners.patch) but it is > actually missing the diff from the patch that removed this code from the > haproxy::listen class for ironic: > > options => { > 'option' => [ 'httpchk GET /' ], > }, > > > I believe this patch just needs to be updated or carry a new patch that > removes the above lines from the ironic haproxy::listen class The patch does not have the removal of this code because the ironic section for haproxy::listen does not contain it. This bug is fixed in current OPM package. Can you confirm this? Updated OPM package with latest patch *** Bug 1286407 has been marked as a duplicate of this bug. *** (In reply to Ivan Chavero from comment #13) > (In reply to James Slagle from comment #11) > > the fix for this will be on the openstack-puppet-modules side. > > > > the upstream fix was included in https://review.openstack.org/#/c/197904 > > > > i see there is a downstream patch for that in the openstack-puppet-modules > > source (0023-Remove-httpchk-option-from-haproxy-listeners.patch) but it is > > actually missing the diff from the patch that removed this code from the > > haproxy::listen class for ironic: > > > > options => { > > 'option' => [ 'httpchk GET /' ], > > }, > > > > > > I believe this patch just needs to be updated or carry a new patch that > > removes the above lines from the ironic haproxy::listen class > > The patch does not have the removal of this code because the ironic section > for haproxy::listen does not contain it. This bug is fixed in current OPM > package. > > Can you confirm this? qe is reporting it's not fixed. The bug seems duplicated with https://bugzilla.redhat.com/show_bug.cgi?id=1287309 The triggers for this bug in python http://bugs.python.org/issue14574 that raise an exception. once we change to oslo.service this will stop. But it we only can add a dependency on oslo.service for osp8+ *** This bug has been marked as a duplicate of bug 1287309 *** |