Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 1573603

Summary: Collectd on computes cannot connect to gnocchi.
Product: Red Hat OpenStack Reporter: Leonid Natapov <lnatapov>
Component: openstack-tripleo-heat-templatesAssignee: Martin Magr <mmagr>
Status: CLOSED ERRATA QA Contact: Leonid Natapov <lnatapov>
Severity: high Docs Contact:
Priority: high    
Version: 13.0 (Queens)CC: apannu, mburns, pkilambi
Target Milestone: betaKeywords: Triaged
Target Release: 13.0 (Queens)   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: openstack-tripleo-heat-templates-8.0.2-11.el7ost Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2018-06-27 13:54:52 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Leonid Natapov 2018-05-01 18:44:57 UTC 
Description of problem:

Collectd on computes cannot connect to gnocchi.

collectd.log files:
-----------------------------
[2018-05-01 04:41:36] Unable to establish connection to http://172.17.1.17:8041/v1/batch/resources/metrics/measures: ('Connection aborted.', error(32, 'Broken pipe'))
[2018-05-01 04:41:36] Unable to establish connection to http://172.17.1.17:8041/v1/batch/resources/metrics/measures: ('Connection aborted.', error(32, 'Broken pipe'))
[2018-05-01 04:41:36] Unable to establish connection to http://172.17.1.17:8041/v1/batch/resources/metrics/measures: ('Connection aborted.', error(32, 'Broken pipe'))
[2018-05-01 04:41:36] Unable to establish connection to http://172.17.1.17:8041/v1/batch/resources/metrics/measures: ('Connection aborted.', error(32, 'Broken pipe'))
[2018-05-01 04:41:36] Unable to establish connection to http://172.17.1.17:8041/v1/batch/resources/metrics/measures: ('Connection aborted.', error(32, 'Broken pipe'))
[2018-05-01 04:41:36] Unable to establish connection to http://172.17.1.17:8041/v1/batch/resources/metrics/measures: ('Connection aborted.', error(32, 'Broken pipe'))
[2018-05-01 04:41:36] Unable to establish connection to http://172.17.1.17:8041/v1/batch/resources/metrics/measures: ('Connection aborted.', error(32, 'Broken pipe'))
[2018-05-01 04:41:36] Unable to establish connection to http://172.17.1.17:8041/v1/batch/resources/metrics/measures: ('Connection aborted.', error(32, 'Broken pipe'))
[2018-05-01 04:41:36] Unable to establish connection to http://172.17.1.17:8041/v1/batch/resources/metrics/measures: ('Connection aborted.', error(32, 'Broken pipe'))
[2018-05-01 04:41:37] Unable to establish connection to http://172.17.1.17:8041/v1/batch/resources/metrics/measures: ('Connection aborted.', error(32, 'Broken pipe'))



[2018-05-01 04:41:35] Unauthorized: The request you have made requires authentication. (HTTP 401) (Request-ID: req-ca20a341-818a-495f-ab9a-18c335ad9f12)
[2018-05-01 04:41:36] Unable to establish connection to http://172.17.1.17:8041/v1/batch/resources/metrics/measures: ('Connection aborted.', error(32, 'Broken pipe'))
[2018-05-01 04:41:36] Traceback (most recent call last):
[2018-05-01 04:41:36] File "/usr/lib/python2.7/site-packages/collectd_gnocchi/__init__.py", line 79, in inner_func
    return func(*args, **kwargs)
[2018-05-01 04:41:36] Traceback (most recent call last):
[2018-05-01 04:41:36] Traceback (most recent call last):
[2018-05-01 04:41:36] File "/usr/lib/python2.7/site-packages/collectd_gnocchi/__init__.py", line 227, in flush
    self._batch(host, values)
[2018-05-01 04:41:36] File "/usr/lib/python2.7/site-packages/collectd_gnocchi/__init__.py", line 79, in inner_func
    return func(*args, **kwargs)
[2018-05-01 04:41:36] Unable to establish connection to http://172.17.1.17:8041/v1/batch/resources/metrics/measures: ('Connection aborted.', error(32, 'Broken pipe'))
[2018-05-01 04:41:36] File "/usr/lib/python2.7/site-packages/collectd_gnocchi/__init__.py", line 79, in inner_func
    return func(*args, **kwargs)
[2018-05-01 04:41:36] File "/usr/lib/python2.7/site-packages/collectd_gnocchi/__init__.py", line 244, in _batch
    measures, create_metrics=True)
[2018-05-01 04:41:36] File "/usr/lib/python2.7/site-packages/gnocchiclient/v1/metric.py", line 236, in batch_resources_metrics_measures
    params=dict(create_metrics=create_metrics))
[2018-05-01 04:41:36] File "/usr/lib/python2.7/site-packages/collectd_gnocchi/__init__.py", line 227, in flush
    self._batch(host, values)
[2018-05-01 04:41:36] File "/usr/lib/python2.7/site-packages/gnocchiclient/v1/base.py", line 41, in _post
    return self.client.api.post(*args, **kwargs)
[2018-05-01 04:41:36] File "/usr/lib/python2.7/site-packages/collectd_gnocchi/__init__.py", line 227, in flush
    self._batch(host, values)
[2018-05-01 04:41:36] File "/usr/lib/python2.7/site-packages/collectd_gnocchi/__init__.py", line 244, in _batch
    measures, create_metrics=True)
[2018-05-01 04:41:36] File "/usr/lib/python2.7/site-packages/gnocchiclient/v1/metric.py", line 236, in batch_resources_metrics_measures
    params=dict(create_metrics=create_metrics))
[2018-05-01 04:41:36] File "/usr/lib/python2.7/site-packages/gnocchiclient/v1/base.py", line 41, in _post
    return self.client.api.post(*args, **kwargs)
[2018-05-01 04:41:36] File "/usr/lib/python2.7/site-packages/keystoneauth1/adapter.py", line 310, in post
    return self.request(url, 'POST', **kwargs)
[2018-05-01 04:41:36] File "/usr/lib/python2.7/site-packages/gnocchiclient/client.py", line 52, in request
    raise exceptions.from_response(resp, method)
[2018-05-01 04:41:36] ClientException: <html><body><h1>503 Service Unavailable</h1>
No server is available to handle this request.
</body></html>
Comment 2 Martin Magr 2018-05-03 14:46:48 UTC 
The connection issues are caused by deploying collectd two steps ahead of working Keystone and Gnocchi.
Comment 10 Leonid Natapov 2018-05-08 12:29:20 UTC 
connection from compute to gnocchi is ok. metrics are coming.
Comment 12 errata-xmlrpc 2018-06-27 13:54:52 UTC 
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHEA-2018:2086