Bug 1434883 - Can't create shares with manila and CephFS [NEEDINFO]
Summary: Can't create shares with manila and CephFS
Keywords:
Status: CLOSED NOTABUG
Alias: None
Product: Red Hat OpenStack
Classification: Red Hat
Component: openstack-manila
Version: 10.0 (Newton)
Hardware: All
OS: Linux
unspecified
high
Target Milestone: ---
: 12.0 (Pike)
Assignee: Tom Barron
QA Contact: Dustin Schoenbrun
Don Domingo
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2017-03-22 14:37 UTC by Nilesh
Modified: 2020-05-14 15:48 UTC (History)
8 users (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
: 1469410 (view as bug list)
Environment:
Last Closed: 2017-07-17 11:19:26 UTC
Target Upstream Version:
Embargoed:
tech: needinfo?


Attachments (Terms of Use)

Description Nilesh 2017-03-22 14:37:38 UTC
Description of problem:

I have deployed the manial service using the templates provided by director.

I am able to create a share type. But I can't create a share using the CephFS driver.


Version-Release number of selected component (if applicable):

OSP 10 

Error - 

#tail -f /var/log/manila/share.log

2017-03-17 09:18:46.263 288646 WARNING oslo_config.cfg [-] Option "rpc_backend" from group "DEFAULT" is deprecated for removal.  Its value may be silently ignored in the future.
2017-03-17 09:18:46.365 288646 INFO oslo_service.service [req-343c23d1-98e0-4e01-bc30-a9a866809219 - - - - -] Starting 1 workers
2017-03-17 09:18:46.368 288665 INFO manila.service [-] Starting manila-share node (version 3.0.0)
2017-03-17 09:18:46.371 288646 WARNING oslo_config.cfg [req-343c23d1-98e0-4e01-bc30-a9a866809219 - - - - -] Option "rabbit_hosts" from group "oslo_messaging_rabbit" is deprecated for removal.  Its value may be silently ignored in the future.
2017-03-17 09:18:46.372 288646 WARNING oslo_config.cfg [req-343c23d1-98e0-4e01-bc30-a9a866809219 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal.  Its value may be silently ignored in the future.
2017-03-17 09:18:46.373 288646 WARNING oslo_config.cfg [req-343c23d1-98e0-4e01-bc30-a9a866809219 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal.  Its value may be silently ignored in the future.
2017-03-17 09:18:46.610 288665 WARNING oslo_config.cfg [req-6010a8c9-9c2d-4b03-98a0-a188192be771 - - - - -] Option "rabbit_hosts" from group "oslo_messaging_rabbit" is deprecated for removal.  Its value may be silently ignored in the future.
2017-03-17 09:18:46.611 288665 WARNING oslo_config.cfg [req-6010a8c9-9c2d-4b03-98a0-a188192be771 - - - - -] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal.  Its value may be silently ignored in the future.
2017-03-17 09:18:46.611 288665 WARNING oslo_config.cfg [req-6010a8c9-9c2d-4b03-98a0-a188192be771 - - - - -] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal.  Its value may be silently ignored in the future.
2017-03-17 09:18:46.659 288665 INFO manila.share.drivers.cephfs.cephfs_native [req-6010a8c9-9c2d-4b03-98a0-a188192be771 - - - - -] [cephfs}] Ceph client found, connecting...
2017-03-17 09:18:46.678 288665 ERROR manila.share.manager [req-6010a8c9-9c2d-4b03-98a0-a188192be771 - - - - -] Error encountered during initialization of driver 'CephFSNativeDriver' on 'clcldhr1.probtp@cephfsnative' host. error connecting to the cluster
2017-03-17 09:18:46.678 288665 ERROR manila.share.manager Traceback (most recent call last):
2017-03-17 09:18:46.678 288665 ERROR manila.share.manager   File "/usr/lib/python2.7/site-packages/manila/share/manager.py", line 269, in init_host
2017-03-17 09:18:46.678 288665 ERROR manila.share.manager     self.driver.check_for_setup_error()
2017-03-17 09:18:46.678 288665 ERROR manila.share.manager   File "/usr/lib/python2.7/site-packages/manila/share/drivers/cephfs/cephfs_native.py", line 88, in check_for_setup_error
2017-03-17 09:18:46.678 288665 ERROR manila.share.manager     self.volume_client
2017-03-17 09:18:46.678 288665 ERROR manila.share.manager   File "/usr/lib/python2.7/site-packages/manila/share/drivers/cephfs/cephfs_native.py", line 156, in volume_client
2017-03-17 09:18:46.678 288665 ERROR manila.share.manager     self._volume_client.connect(premount_evict=premount_evict)
2017-03-17 09:18:46.678 288665 ERROR manila.share.manager   File "/usr/lib/python2.7/site-packages/ceph_volume_client.py", line 457, in connect
2017-03-17 09:18:46.678 288665 ERROR manila.share.manager     self.rados.connect()
2017-03-17 09:18:46.678 288665 ERROR manila.share.manager   File "rados.pyx", line 785, in rados.Rados.connect (rados.c:8969)
2017-03-17 09:18:46.678 288665 ERROR manila.share.manager ObjectNotFound: error connecting to the cluster
2017-03-17 09:18:46.678 288665 ERROR manila.share.manager
2017-03-17 09:18:46.680 288665 INFO ceph_volume_client [req-6010a8c9-9c2d-4b03-98a0-a188192be771 - - - - -] disconnect
2017-03-17 09:18:54.948 288665 WARNING manila.context [req-d68471e4-437e-4e26-967b-15d7b2eb7c42 - - - - -] Arguments dropped when creating context: {u'is_admin_project': True}.


Actual results:


Expected results:


Additional info:

Comment 16 Tom Barron 2017-04-04 19:31:13 UTC
I have raised https://bugzilla.redhat.com/show_bug.cgi?id=1438932 to get manila plugin support backported to RHEL 7.3.

Comment 29 Won Young Choi 2017-07-01 00:36:12 UTC
neutron_admin_auth_url=http://10.0.122.9:9696 --> this is invalid value 'NeutronAdmin' 

This have to be changed to KeystoneInternal.

Comment 30 Won Young Choi 2017-07-04 01:21:19 UTC
you can change value as below.

/usr/share/openstack-tripleo-heat-templates/puppet/services/manila-scheduler.yaml

outputs:
  role_data:
    description: Role data for the Manila-scheduler role.
    value:
      service_name: manila_scheduler
      monitoring_subscription: {get_param: MonitoringSubscriptionManilaScheduler}
      config_settings:
        map_merge:
          - get_attr: [ManilaBase, role_data, config_settings]
          - manila::compute::nova::nova_admin_auth_url: {get_param: [EndpointMap, KeystoneInternal, uri]}
            manila::compute::nova::nova_admin_password: {get_param: NovaPassword}
            manila::compute::nova::nova_admin_tenant_name: 'service'
            manila::network::neutron::neutron_url: {get_param: [EndpointMap, NeutronInternal, uri]}
-            manila::network::neutron::neutron_admin_auth_url: {get_param: [EndpointMap, NeutronAdmin, uri]}
+            manila::network::neutron::neutron_admin_auth_url: {get_param: [EndpointMap, KeystoneInternal, uri]}
            manila::network::neutron::neutron_admin_password: {get_param: NeutronPassword}

Comment 31 Tom Barron 2017-07-11 18:50:26 UTC
(In reply to Won Young Choi from comment #29)
> neutron_admin_auth_url=http://10.0.122.9:9696 --> this is invalid value
> 'NeutronAdmin' 
> 
> This have to be changed to KeystoneInternal.

Agree and we'll take this up in https://bugzilla.redhat.com/show_bug.cgi?id=1469410.

Note, however, that these settings should not have any effect on using manila with the native CephFS driver, as in *this* BZ.  The neutron admin credentials are used only by some of the DHSS=True drivers and the native CephFS driver is a DHSS driver.  That implies among other things that all required networking has been set up by the cloud administrator prior to startup of manila so the manila driver has no need to interact with neutron.

Comment 32 Tom Barron 2017-07-11 18:52:11 UTC
(In reply to Tom Barron from comment #31)
> (In reply to Won Young Choi from comment #29)
> > neutron_admin_auth_url=http://10.0.122.9:9696 --> this is invalid value
> > 'NeutronAdmin' 
> > 
> > This have to be changed to KeystoneInternal.
> 
> Agree and we'll take this up in
> https://bugzilla.redhat.com/show_bug.cgi?id=1469410.
> 
> Note, however, that these settings should not have any effect on using
> manila with the native CephFS driver, as in *this* BZ.  The neutron admin
> credentials are used only by some of the DHSS=True drivers and the native
> CephFS driver is a DHSS driver.  That implies among other things that all
> required networking has been set up by the cloud administrator prior to
> startup of manila so the manila driver has no need to interact with neutron.

Since the issues are independent of one another I am removing 'blocks 1469410'.

Comment 33 Tom Barron 2017-07-17 11:19:26 UTC
As mentioned above, OSP10 does not support integrated deploy of CephFS in OSP Director so use of CephFS back end for manila presupposes that the customer successfully deploys CephFS outside of Director first and then configures manila to point to that external CephFS deployment.  The issue reported was that manila shares could not be created but this was due to manila itself not installing correctly with CephFS backend, which was in turn due to CephFS backend not being installed correctly -- and that step has to be done manually in OSP10 and had not been done.


Closing as NOTABUG.  OSP11 introduces integrated deploy of CephFS in OSPDirector, which seems like what the customer really needs here since they are already using OSPDirector to deploy Ceph MONs and OSDs without CephFS.


Note You need to log in before you can comment on or make changes to this bug.