Red Hat Bugzilla – Bug 1573603
Collectd on computes cannot connect to gnocchi.
Last modified: 2018-06-27 09:55:51 EDT
Description of problem: Collectd on computes cannot connect to gnocchi. collectd.log files: ----------------------------- [2018-05-01 04:41:36] Unable to establish connection to http://172.17.1.17:8041/v1/batch/resources/metrics/measures: ('Connection aborted.', error(32, 'Broken pipe')) [2018-05-01 04:41:36] Unable to establish connection to http://172.17.1.17:8041/v1/batch/resources/metrics/measures: ('Connection aborted.', error(32, 'Broken pipe')) [2018-05-01 04:41:36] Unable to establish connection to http://172.17.1.17:8041/v1/batch/resources/metrics/measures: ('Connection aborted.', error(32, 'Broken pipe')) [2018-05-01 04:41:36] Unable to establish connection to http://172.17.1.17:8041/v1/batch/resources/metrics/measures: ('Connection aborted.', error(32, 'Broken pipe')) [2018-05-01 04:41:36] Unable to establish connection to http://172.17.1.17:8041/v1/batch/resources/metrics/measures: ('Connection aborted.', error(32, 'Broken pipe')) [2018-05-01 04:41:36] Unable to establish connection to http://172.17.1.17:8041/v1/batch/resources/metrics/measures: ('Connection aborted.', error(32, 'Broken pipe')) [2018-05-01 04:41:36] Unable to establish connection to http://172.17.1.17:8041/v1/batch/resources/metrics/measures: ('Connection aborted.', error(32, 'Broken pipe')) [2018-05-01 04:41:36] Unable to establish connection to http://172.17.1.17:8041/v1/batch/resources/metrics/measures: ('Connection aborted.', error(32, 'Broken pipe')) [2018-05-01 04:41:36] Unable to establish connection to http://172.17.1.17:8041/v1/batch/resources/metrics/measures: ('Connection aborted.', error(32, 'Broken pipe')) [2018-05-01 04:41:37] Unable to establish connection to http://172.17.1.17:8041/v1/batch/resources/metrics/measures: ('Connection aborted.', error(32, 'Broken pipe')) [2018-05-01 04:41:35] Unauthorized: The request you have made requires authentication. (HTTP 401) (Request-ID: req-ca20a341-818a-495f-ab9a-18c335ad9f12) [2018-05-01 04:41:36] Unable to establish connection to http://172.17.1.17:8041/v1/batch/resources/metrics/measures: ('Connection aborted.', error(32, 'Broken pipe')) [2018-05-01 04:41:36] Traceback (most recent call last): [2018-05-01 04:41:36] File "/usr/lib/python2.7/site-packages/collectd_gnocchi/__init__.py", line 79, in inner_func return func(*args, **kwargs) [2018-05-01 04:41:36] Traceback (most recent call last): [2018-05-01 04:41:36] Traceback (most recent call last): [2018-05-01 04:41:36] File "/usr/lib/python2.7/site-packages/collectd_gnocchi/__init__.py", line 227, in flush self._batch(host, values) [2018-05-01 04:41:36] File "/usr/lib/python2.7/site-packages/collectd_gnocchi/__init__.py", line 79, in inner_func return func(*args, **kwargs) [2018-05-01 04:41:36] Unable to establish connection to http://172.17.1.17:8041/v1/batch/resources/metrics/measures: ('Connection aborted.', error(32, 'Broken pipe')) [2018-05-01 04:41:36] File "/usr/lib/python2.7/site-packages/collectd_gnocchi/__init__.py", line 79, in inner_func return func(*args, **kwargs) [2018-05-01 04:41:36] File "/usr/lib/python2.7/site-packages/collectd_gnocchi/__init__.py", line 244, in _batch measures, create_metrics=True) [2018-05-01 04:41:36] File "/usr/lib/python2.7/site-packages/gnocchiclient/v1/metric.py", line 236, in batch_resources_metrics_measures params=dict(create_metrics=create_metrics)) [2018-05-01 04:41:36] File "/usr/lib/python2.7/site-packages/collectd_gnocchi/__init__.py", line 227, in flush self._batch(host, values) [2018-05-01 04:41:36] File "/usr/lib/python2.7/site-packages/gnocchiclient/v1/base.py", line 41, in _post return self.client.api.post(*args, **kwargs) [2018-05-01 04:41:36] File "/usr/lib/python2.7/site-packages/collectd_gnocchi/__init__.py", line 227, in flush self._batch(host, values) [2018-05-01 04:41:36] File "/usr/lib/python2.7/site-packages/collectd_gnocchi/__init__.py", line 244, in _batch measures, create_metrics=True) [2018-05-01 04:41:36] File "/usr/lib/python2.7/site-packages/gnocchiclient/v1/metric.py", line 236, in batch_resources_metrics_measures params=dict(create_metrics=create_metrics)) [2018-05-01 04:41:36] File "/usr/lib/python2.7/site-packages/gnocchiclient/v1/base.py", line 41, in _post return self.client.api.post(*args, **kwargs) [2018-05-01 04:41:36] File "/usr/lib/python2.7/site-packages/keystoneauth1/adapter.py", line 310, in post return self.request(url, 'POST', **kwargs) [2018-05-01 04:41:36] File "/usr/lib/python2.7/site-packages/gnocchiclient/client.py", line 52, in request raise exceptions.from_response(resp, method) [2018-05-01 04:41:36] ClientException: <html><body><h1>503 Service Unavailable</h1> No server is available to handle this request. </body></html>
The connection issues are caused by deploying collectd two steps ahead of working Keystone and Gnocchi.
connection from compute to gnocchi is ok. metrics are coming.
Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory, and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHEA-2018:2086