Bug 1318583 - Ceilometer-central-agent failed to gather meters
Summary: Ceilometer-central-agent failed to gather meters
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat OpenStack
Classification: Red Hat
Component: rhosp-director
Version: 8.0 (Liberty)
Hardware: Unspecified
OS: Unspecified
unspecified
urgent
Target Milestone: ---
: 8.0 (Liberty)
Assignee: Marios Andreou
QA Contact: Yurii Prokulevych
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2016-03-17 09:54 UTC by Yurii Prokulevych
Modified: 2016-05-16 07:08 UTC (History)
9 users (show)

Fixed In Version:
Doc Type: Bug Fix
Doc Text:
Previously, the os_tenant_name variable in the Ceilometer configuration was incorrectly set to the 'admin' tenant instead of the 'service' tenant. This caused the ceilometer-central-agent to fail with the error "ERROR ceilometer.agent.manager Skipping tenant, keystone issue: User 739a3abf8504498e91044d6d2a6830b1 is unauthorized for tenant d097e6c45c494c2cbef4071c2c273a58". Now, Ceilometer is correctly configured to use the 'service' tenant.
Clone Of:
Environment:
Last Closed: 2016-04-07 21:49:27 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Red Hat Product Errata RHEA-2016:0604 0 normal SHIPPED_LIVE Red Hat OpenStack Platform 8 director Enhancement Advisory 2016-04-08 01:03:56 UTC

Description Yurii Prokulevych 2016-03-17 09:54:14 UTC
Description of problem:
ceilometer-central-agent is failed to gather meters due to misconfigued os_tenant_name in ceilometer.conf

excerpt:
[service_credentials]
os_tenant_name = admin

This leads to error in ceilometer/central.log:
...
2016-03-17 05:42:54.282 27978 ERROR ceilometer.agent.manager [-] Skipping tenant, keystone issue: User 739a3abf8504498e91044d6d2a6830b1 is unauthorized for tenant d097e6c45c494c2cbef4071c2c273a58 (Disable debug mode to suppress these details.) (HTTP 401) (Request-ID: req-2feb0ebd-0940-4e4f-98c8-101f41e911c0) (HTTP 401)
2016-03-17 05:42:54.283 27978 ERROR ceilometer.agent.manager [-] Skipping endpoint, keystone issue: User 739a3abf8504498e91044d6d2a6830b1 is unauthorized for tenant d097e6c45c494c2cbef4071c2c273a58 (Disable debug mode to suppress these details.) (HTTP 401) (Request-ID: req-2feb0ebd-0940-4e4f-98c8-101f41e911c0) (HTTP 401)
2016-03-17 05:42:54.285 27978 ERROR ceilometer.agent.manager [-] Skipping lb_members, keystone issue: User 739a3abf8504498e91044d6d2a6830b1 is unauthorized for tenant d097e6c45c494c2cbef4071c2c273a58 (Disable debug mode to suppress these details.) (HTTP 401) (Request-ID: req-2feb0ebd-0940-4e4f-98c8-101f41e911c0) (HTTP 401)
2016-03-17 05:42:54.286 27978 ERROR ceilometer.agent.manager [-] Skipping ipsec_connections, keystone issue: User 739a3abf8504498e91044d6d2a6830b1 is unauthorized for tenant d097e6c45c494c2cbef4071c2c273a58 (Disable debug mode to suppress these details.) (HTTP 401) (Request-ID: req-2feb0ebd-0940-4e4f-98c8-101f41e911c0) (HTTP 401)
...

ceilometer meter-list
+------+------+------+-------------+---------+------------+
| Name | Type | Unit | Resource ID | User ID | Project ID |
+------+------+------+-------------+---------+------------+
+------+------+------+-------------+---------+------------+

Changing tenant-name to 'service' allows ceilometer-central-agent to poll meters.

Version-Release number of selected component (if applicable):
openstack-ceilometer-notification-5.0.2-2.el7ost.noarch
openstack-ceilometer-collector-5.0.2-2.el7ost.noarch
openstack-ceilometer-polling-5.0.2-2.el7ost.noarch
openstack-ceilometer-common-5.0.2-2.el7ost.noarch
openstack-ceilometer-api-5.0.2-2.el7ost.noarch
openstack-ceilometer-alarm-5.0.2-2.el7ost.noarch
openstack-ceilometer-central-5.0.2-2.el7ost.noarch
python-ceilometer-5.0.2-2.el7ost.noarch
python-ceilometerclient-1.5.2-1.el7ost.noarch

openstack-tripleo-common-0.2.1-1.el7ost.noarch
openstack-tripleo-image-elements-0.9.9-1.el7ost.noarch
openstack-tripleo-puppet-elements-0.0.4-1.el7ost.noarch
openstack-tripleo-heat-templates-kilo-0.8.10-2.el7ost.noarch
python-tripleoclient-0.2.0-1.el7ost.noarch
openstack-tripleo-heat-templates-0.8.10-2.el7ost.noarch
openstack-tripleo-0.0.7-1.el7ost.noarch

openstack-tripleo-puppet-elements-0.0.4-1.el7ost.noarch
puppet-3.6.2-2.el7.noarch
openstack-puppet-modules-7.0.13-1.el7ost.noarch

Expected results:
ceilometer-central-agent gathers meters from openstack services

Additional info:
Virtual setup - 3controller + 2computes +2ceph

Comment 1 Marios Andreou 2016-03-18 14:22:03 UTC
Hi, on my (7.3, poodle) setup i see that we *do* have 'os_tenant_name' as admin in ceilometer.conf, however I also see 'admin_tenant_name' set to 'service' - so from my undercloud I can 'source overcloudrc; ceilometer meter-list'). 

This setting to 'service' for the tenant_name is delivered for 8 at  "Use service tenant for ceilometer" https://review.openstack.org/#/q/Ia14695eb23a1ff551fd27f74b4cb864e80b100e3,n,z - I see this landed into stable/liberty only in the last few days (that is where the tripleo-heat-templates for 8 come from). 

In particular, looking at https://brewweb.devel.redhat.com/packageinfo?packageID=48664 - you are using openstack-tripleo-heat-templates-0.8.10-2.el7ost.noarch which was built 09th March but that review ^^^ landed 11th. Can you please check that a newer version of the openstack-tripleo-heat-templates fixes this as it should? (I guess anything openstack-tripleo-heat-templates-0.8.11-1.el7ost or newer)

thanks

Comment 2 Yurii Prokulevych 2016-03-22 15:42:20 UTC
Hi Marios,

Yeah, I've checked with openstack-tripleo-heat-templates-0.8.12-1.el7ost.noarch and os_tenant_name is set to 'service'.

---
Yurii

Comment 3 Jaromir Coufal 2016-03-23 16:24:56 UTC
Seems like it is working with the latest version of heat-templates - can we close the bug?

Comment 4 James Slagle 2016-03-24 00:02:02 UTC
(In reply to Jaromir Coufal from comment #3)
> Seems like it is working with the latest version of heat-templates - can we
> close the bug?

i think we can, i can move this to on_qa and TestOnly for confirmation

Comment 5 Yurii Prokulevych 2016-03-29 13:29:24 UTC
Verified in openstack-tripleo-heat-templates-0.8.12-2.el7ost.noarch

Comment 7 errata-xmlrpc 2016-04-07 21:49:27 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://rhn.redhat.com/errata/RHEA-2016-0604.html


Note You need to log in before you can comment on or make changes to this bug.