Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 1623828

Summary: ceph client.openstack stops working in OPS13z2 when telemetry is disabled
Product: Red Hat OpenStack Reporter: Federico Iezzi <fiezzi>
Component: openstack-tripleo-heat-templatesAssignee: John Fulton <johfulto>
Status: CLOSED DUPLICATE QA Contact: Yogev Rabl <yrabl>
Severity: medium Docs Contact:
Priority: medium    
Version: 13.0 (Queens)CC: gfidente, johfulto, mburns, yrabl
Target Milestone: z3Keywords: Triaged, ZStream
Target Release: 13.0 (Queens)   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2018-09-20 11:42:50 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Federico Iezzi 2018-08-30 09:48:59 UTC
Description of problem:

The problem description is on the following LP
https://bugs.launchpad.net/tripleo/+bug/1776987

I do also confirm that the following patch fixes the issues
https://review.openstack.org/#/c/585911/

This issue is quite a big one since all overcloud from now on without telemetry enabled (and there are quite a few out there) will not have any working Ceph environment affecting Cinder, Glance, and Nova.

Version-Release number of selected component (if applicable):


How reproducible:
100%


Steps to Reproduce:
Deploy OSP13 z2 with Ceph and disabled telemetry

Actual results:

cat /etc/ceph/ceph.client.openstack.keyring 
[client.openstack]
        key = AQDxRXRbAAAAABAAqcUTKcE8EhoQ18pBpEzL0g==
        caps mds = "''"
        caps mgr = "'allow *'"
        caps mon = "'profile rbd'"
        caps osd = "'profile rbd pool=volumes, profile rbd pool=backups, profile rbd pool=vms, profile rbd pool=images, profile rbd pool='"

tail /var/log/containers/cinder/cinder-volume.log
2018-08-30 11:11:08.985 107820 ERROR oslo_service.service     rv = execute(f, *args, **kwargs)
2018-08-30 11:11:08.985 107820 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 125, in execute
2018-08-30 11:11:08.985 107820 ERROR oslo_service.service     six.reraise(c, e, tb)
2018-08-30 11:11:08.985 107820 ERROR oslo_service.service   File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 83, in tworker
2018-08-30 11:11:08.985 107820 ERROR oslo_service.service     rv = meth(*args, **kwargs)
2018-08-30 11:11:08.985 107820 ERROR oslo_service.service   File "rbd.pyx", line 843, in rbd.RBD.list (/builddir/build/BUILD/ceph-12.2.4/build/src/pybind/rbd/pyrex/rbd.c:5904)
2018-08-30 11:11:08.985 107820 ERROR oslo_service.service PermissionError: [errno 1] error listing images
2018-08-30 11:11:08.985 107820 ERROR oslo_service.service 

Expected results:

cat /etc/ceph/ceph.client.openstack.keyring 
[client.openstack]
        key = AQDxRXRbAAAAABAAqcUTKcE8EhoQ18pBpEzL0g==
        caps mds = "''"
        caps mgr = "'allow *'"
        caps mon = "'profile rbd'"
        caps osd = "'profile rbd pool=volumes, profile rbd pool=backups, profile rbd pool=vms, profile rbd pool=images, profile rbd pool=metrics'"


Workaround:
sed -e "s/rbd pool='\"/rbd pool=metrics'\"/g" -i /etc/ceph/ceph.client.openstack.keyring
ceph auth import -i /etc/ceph/ceph.client.openstack.keyring

Comment 1 John Fulton 2018-09-05 13:41:31 UTC
WORKAROUND: 

Update environments/disable-telemetry.yaml to look like this:

 https://review.openstack.org/#/c/585911/1/environments/disable-telemetry.yaml

Comment 3 Giulio Fidente 2018-09-20 11:42:50 UTC

*** This bug has been marked as a duplicate of bug 1613474 ***