Description of problem: Setting of `init_args = "--{arg}={arg-value}";` in RGW{} FSAL definition is not sufficient to properly start ganesha due to missing credentials. Instead, the path to keyring must be set to allow access of RGW FSAL to cluster. With default setting, the startup of ganesha fails with messages: 28/11/2018 09:00:38 : epoch 5bfe4b26 : ceph31-rgw1.private-eval.local : ganesha.nfsd-2582[main] create_export :FSAL :CRIT :RGW module: librgw init failed (-5) 28/11/2018 09:00:38 : epoch 5bfe4b26 : ceph31-rgw1.private-eval.local : ganesha.nfsd-2582[main] mdcache_fsal_create_export :FSAL :MAJ :Failed to call create_export on underlying FSAL RGW 28/11/2018 09:00:38 : epoch 5bfe4b26 : ceph31-rgw1.private-eval.local : ganesha.nfsd-2582[main] fsal_cfg_commit :CONFIG :CRIT :Could not create export for (/) to (/) 28/11/2018 09:00:38 : epoch 5bfe4b26 : ceph31-rgw1.private-eval.local : ganesha.nfsd-2582[main] main :NFS STARTUP :WARN :No export entries found in configuration file !!! 28/11/2018 09:00:38 : epoch 5bfe4b26 : ceph31-rgw1.private-eval.local : ganesha.nfsd-2582[main] config_errs_to_log :CONFIG :CRIT :Config File (/etc/ganesha/ganesha.conf:11): 1 validation errors in block FSAL 28/11/2018 09:00:38 : epoch 5bfe4b26 : ceph31-rgw1.private-eval.local : ganesha.nfsd-2582[main] config_errs_to_log :CONFIG :CRIT :Config File (/etc/ganesha/ganesha.conf:11): Errors processing block (FSAL) 28/11/2018 09:00:38 : epoch 5bfe4b26 : ceph31-rgw1.private-eval.local : ganesha.nfsd-2582[main] config_errs_to_log :CONFIG :CRIT :Config File (/etc/ganesha/ganesha.conf:1): 1 validation errors in block EXPORT 28/11/2018 09:00:38 : epoch 5bfe4b26 : ceph31-rgw1.private-eval.local : ganesha.nfsd-2582[main] config_errs_to_log :CONFIG :CRIT :Config File (/etc/ganesha/ganesha.conf:1): Errors processing block (EXPORT) 28/11/2018 09:00:38 : epoch 5bfe4b26 : ceph31-rgw1.private-eval.local : ganesha.nfsd-2582[main] lower_my_caps :NFS STARTUP :EVENT :CAP_SYS_RESOURCE was successfully removed for proper quota management in FSAL Version-Release number of selected component (if applicable): nfs-ganesha-2.5.5-100.el7cp.x86_64 nfs-ganesha-rgw-2.5.5-100.el7cp.x86_64 How reproducible: always Steps to Reproduce: 1. take default configuration from docs for RGW FSAL definition in /etc/ganesha/ganesha.conf: EXPORT { Export_Id = 2; Path = "/"; Pseudo = "/"; Access_Type = RW; SecType = "sys"; # NFS_Protocols = 4; # Transport_Protocols = "TCP"; Squash = "No_Root_Squash"; FSAL { Name = RGW; User_Id = produser1; Access_Key_Id ="k8aR0VcnTlVszUx2SmJB"; Secret_Access_Key = "AM2yE4LDpsAcGD20lqNph1k1umSyOo3aXFh2Ail4"; } } RGW { name = "client.rgw.ceph31-rgw1"; ceph_conf = "/etc/ceph/ceph.conf"; init_args = "--{arg}={arg-value}"; } 2. systemctl restart nfs-ganesha 3. observe messages in /var/log/ganesha/ganesha.log Actual results: 28/11/2018 09:00:38 : epoch 5bfe4b26 : ceph31-rgw1.private-eval.local : ganesha.nfsd-2582[main] create_export :FSAL :CRIT :RGW module: librgw init failed (-5) 28/11/2018 09:00:38 : epoch 5bfe4b26 : ceph31-rgw1.private-eval.local : ganesha.nfsd-2582[main] mdcache_fsal_create_export :FSAL :MAJ :Failed to call create_export on underlying FSAL RGW 28/11/2018 09:00:38 : epoch 5bfe4b26 : ceph31-rgw1.private-eval.local : ganesha.nfsd-2582[main] fsal_cfg_commit :CONFIG :CRIT :Could not create export for (/) to (/) 28/11/2018 09:00:38 : epoch 5bfe4b26 : ceph31-rgw1.private-eval.local : ganesha.nfsd-2582[main] main :NFS STARTUP :WARN :No export entries found in configuration file !!! 28/11/2018 09:00:38 : epoch 5bfe4b26 : ceph31-rgw1.private-eval.local : ganesha.nfsd-2582[main] config_errs_to_log :CONFIG :CRIT :Config File (/etc/ganesha/ganesha.conf:11): 1 validation errors in block FSAL 28/11/2018 09:00:38 : epoch 5bfe4b26 : ceph31-rgw1.private-eval.local : ganesha.nfsd-2582[main] config_errs_to_log :CONFIG :CRIT :Config File (/etc/ganesha/ganesha.conf:11): Errors processing block (FSAL) 28/11/2018 09:00:38 : epoch 5bfe4b26 : ceph31-rgw1.private-eval.local : ganesha.nfsd-2582[main] config_errs_to_log :CONFIG :CRIT :Config File (/etc/ganesha/ganesha.conf:1): 1 validation errors in block EXPORT 28/11/2018 09:00:38 : epoch 5bfe4b26 : ceph31-rgw1.private-eval.local : ganesha.nfsd-2582[main] config_errs_to_log :CONFIG :CRIT :Config File (/etc/ganesha/ganesha.conf:1): Errors processing block (EXPORT) 28/11/2018 09:00:38 : epoch 5bfe4b26 : ceph31-rgw1.private-eval.local : ganesha.nfsd-2582[main] lower_my_caps :NFS STARTUP :EVENT :CAP_SYS_RESOURCE was successfully removed for proper quota management in FSAL Expected results: RGW Ganesha should figure out automatically proper location of keyring file for RGW, or documentation should be fixed. Additional info: Setting `init_args = "--keyring=/var/lib/ceph/radosgw/ceph-rgw.ceph31-rgw1/keyring";` fixes the problem.
Updating the QA Contact to a Hemant. Hemant will be rerouting them to the appropriate QE Associate. Regards, Giri