Description of problem: ====================== - Unable to create nfs export with rgw backend. - NFS service is getting failed with the error "gsh_dbus_pkginit :DBUS :CRIT :dbus_bus_get failed" Version-Release number of selected component (if applicable): ============================================================= Red Hat Ceph Storage 7.1 How reproducible: ================= Create nfs export and check the service. Steps to Reproduce: =================== 1. Create RADOS cluster. 2. Deploy RGW and create bucket. 3. Create nfs cluster. 4. Create nfs export with the backend as rgw. 5. Check the status of nfs service. Actual results: ============== One service is failed state. Expected results: ================ The nfs services should not be in failed state.
Additional info: These are the steps which I followed to reproduce the issue in my lab: 1. Create NFS cluster: ~~~ [root@rhcs7node1 ~]# ceph nfs cluster ls [] [root@rhcs7node1 ~]# ceph orch apply nfs nfsganesha1 --placement="2 rhcs7node1 rhcs7node3" Scheduled nfs.nfsganesha1 update... [root@rhcs7node1 ~]# ceph nfs cluster ls [ "nfsganesha1" ] [root@rhcs7node1 ~]# ceph nfs cluster info nfsganesha1 { "nfsganesha1": { "backend": [ { "hostname": "rhcs7node1", "ip": "192.168.122.89", "port": 2049 }, { "hostname": "rhcs7node3", "ip": "192.168.122.111", "port": 2049 } ], "virtual_ip": null } } [root@rhcs7node1 ~]# [root@rhcs7node1 ~]# ceph dashboard set-ganesha-clusters-rados-pool-namespace nfs-ganesha/nfsganesha1 Option GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE updated [root@rhcs7node1 ~]# ~~~ 2. Create export either from dashboard or via cli: ~~~ https://<dashboard URL>/#/nfs Object > NFS https://<dashboard URL>/#/nfs/create Create Details: Cluster: nfsganesha1 Storage Backend: Object Gateway Bucket: testbucket NFS Protocol: NFSv4 Pseudo: /testbucket Access Type: RO Squash: no_root_squash Transport Protocol: TCP, UDP ~~~ "Create NFS Export" 3. Verify the export: ~~~ [root@rhcs7node2 ~]# ceph nfs export ls nfsganesha1 --detailed [ { "access_type": "RO", "clients": [], "cluster_id": "nfsganesha1", "export_id": 1, "fsal": { "access_key_id": "nokey", "name": "RGW", "secret_access_key": "unknown", "user_id": "project1" }, "path": "testbucket", "protocols": [ 4 ], "pseudo": "/testbucket", "security_label": false, "squash": "no_root_squash", "transports": [ "TCP", "UDP" ] } ] [root@rhcs7node2 ~]# ~~~ 4. Check the nfs service: ~~~ [root@rhcs7node2 ~]# ceph orch ps --daemon_type nfs NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID nfs.nfsganesha1.0.0.rhcs7node1.yirkes rhcs7node1 *:2049 error 8m ago 19m - - <unknown> <unknown> <unknown> nfs.nfsganesha1.1.0.rhcs7node3.wbvlig rhcs7node3 *:2049 running (17m) 8m ago 19m 24.9M - 5.7 5412073bd769 065070dd5902 [root@rhcs7node2 ~]# ~~~ 5. Review the logs: ~~~ [root@rhcs7node1 ~]# systemctl --type=service | grep nfs ● ceph-ab3fb642-f7c0-11ee-a35b-525400251b44.0.0.rhcs7node1.yirkes.service loaded failed failed Ceph nfs.nfsganesha1.0.0.rhcs7node1.yirkes for ab3fb642-f7c0-11ee-a35b-525400251b44 [root@rhcs7node1 ~]# [root@rhcs7node1 ~]# journalctl -u ceph-ab3fb642-f7c0-11ee-a35b-525400251b44.0.0.rhcs7node1.yirkes.service --no-pager Feb 27 21:01:21 rhcs7node1 systemd[1]: Starting Ceph nfs.nfsganesha1.0.0.rhcs7node1.yirkes for ab3fb642-f7c0-11ee-a35b-525400251b44... Feb 27 21:01:21 rhcs7node1 podman[48634]: 2025-02-27 21:01:21.815348026 +0530 IST m=+0.024913219 container create 3576d98f36885b9659cf132fc724533e245b3e0a5d8b7802ab27c110aa619c26 (image=registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:3d75ca419b9ef00cf2c944680737e84e6e1059e0f33156bc21d4dbf76a7da5b1, name=ceph-ab3fb642-f7c0-11ee-a35b-525400251b44-nfs-nfsganesha1-0-0-rhcs7node1-yirkes, ceph=True, name=rhceph, vendor=Red Hat, Inc., io.k8s.display-name=Red Hat Ceph Storage 7 on RHEL 9, io.openshift.tags=rhceph ceph, io.k8s.description=Red Hat Ceph Storage 7, maintainer=Guillaume Abrioux <gabrioux>, version=7, vcs-ref=cba612d428f1498c8ae5570dd75a670ccf94c03d, io.buildah.version=1.29.0, CEPH_POINT_RELEASE=, url=https://access.redhat.com/containers/#/registry.access.redhat.com/rhceph/images/7-385, com.redhat.component=rhceph-container, io.openshift.expose-services=, GIT_BRANCH=main, com.redhat.license_terms=https://www.redhat.com/agreements, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, summary=Provides the latest Red Hat Ceph Storage 7 on RHEL 9 in a fully featured and supported base image., GIT_CLEAN=True, release=385, vcs-type=git, architecture=x86_64, build-date=2024-05-31T19:34:18, description=Red Hat Ceph Storage 7, distribution-scope=public, RELEASE=main) Feb 27 21:01:21 rhcs7node1 podman[48634]: 2025-02-27 21:01:21.841598773 +0530 IST m=+0.051163968 container init 3576d98f36885b9659cf132fc724533e245b3e0a5d8b7802ab27c110aa619c26 (image=registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:3d75ca419b9ef00cf2c944680737e84e6e1059e0f33156bc21d4dbf76a7da5b1, name=ceph-ab3fb642-f7c0-11ee-a35b-525400251b44-nfs-nfsganesha1-0-0-rhcs7node1-yirkes, url=https://access.redhat.com/containers/#/registry.access.redhat.com/rhceph/images/7-385, release=385, vcs-type=git, GIT_REPO=https://github.com/ceph/ceph-container.git, description=Red Hat Ceph Storage 7, vcs-ref=cba612d428f1498c8ae5570dd75a670ccf94c03d, ceph=True, io.k8s.display-name=Red Hat Ceph Storage 7 on RHEL 9, GIT_BRANCH=main, distribution-scope=public, name=rhceph, RELEASE=main, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, com.redhat.component=rhceph-container, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux <gabrioux>, io.k8s.description=Red Hat Ceph Storage 7, build-date=2024-05-31T19:34:18, architecture=x86_64, io.buildah.version=1.29.0, vendor=Red Hat, Inc., io.openshift.expose-services=, com.redhat.license_terms=https://www.redhat.com/agreements, summary=Provides the latest Red Hat Ceph Storage 7 on RHEL 9 in a fully featured and supported base image., GIT_CLEAN=True, io.openshift.tags=rhceph ceph, version=7) Feb 27 21:01:21 rhcs7node1 podman[48634]: 2025-02-27 21:01:21.853459797 +0530 IST m=+0.063024993 container start 3576d98f36885b9659cf132fc724533e245b3e0a5d8b7802ab27c110aa619c26 (image=registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:3d75ca419b9ef00cf2c944680737e84e6e1059e0f33156bc21d4dbf76a7da5b1, name=ceph-ab3fb642-f7c0-11ee-a35b-525400251b44-nfs-nfsganesha1-0-0-rhcs7node1-yirkes, io.openshift.expose-services=, com.redhat.license_terms=https://www.redhat.com/agreements, name=rhceph, io.openshift.tags=rhceph ceph, version=7, description=Red Hat Ceph Storage 7, io.k8s.description=Red Hat Ceph Storage 7, io.buildah.version=1.29.0, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, vcs-ref=cba612d428f1498c8ae5570dd75a670ccf94c03d, GIT_BRANCH=main, summary=Provides the latest Red Hat Ceph Storage 7 on RHEL 9 in a fully featured and supported base image., GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, vcs-type=git, distribution-scope=public, ceph=True, build-date=2024-05-31T19:34:18, url=https://access.redhat.com/containers/#/registry.access.redhat.com/rhceph/images/7-385, vendor=Red Hat, Inc., architecture=x86_64, RELEASE=main, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux <gabrioux>, io.k8s.display-name=Red Hat Ceph Storage 7 on RHEL 9, com.redhat.component=rhceph-container, release=385) Feb 27 21:01:21 rhcs7node1 bash[48634]: 3576d98f36885b9659cf132fc724533e245b3e0a5d8b7802ab27c110aa619c26 Feb 27 21:01:21 rhcs7node1 podman[48634]: 2025-02-27 21:01:21.802278875 +0530 IST m=+0.011844063 image pull 5412073bd7693a6a3dd757df8ea45c8442acb7666bd993355de4e44342b0b240 registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:3d75ca419b9ef00cf2c944680737e84e6e1059e0f33156bc21d4dbf76a7da5b1 Feb 27 21:01:21 rhcs7node1 ceph-ab3fb642-f7c0-11ee-a35b-525400251b44-nfs-nfsganesha1-0-0-rhcs7node1-yirkes[48644]: 27/02/2025 15:31:21 : epoch 67c08549 : rhcs7node1 : ganesha.nfsd-2[main] init_logging :LOG :NULL :LOG: Setting log level for all components to NIV_EVENT Feb 27 21:01:21 rhcs7node1 ceph-ab3fb642-f7c0-11ee-a35b-525400251b44-nfs-nfsganesha1-0-0-rhcs7node1-yirkes[48644]: 27/02/2025 15:31:21 : epoch 67c08549 : rhcs7node1 : ganesha.nfsd-2[main] main :MAIN :EVENT :ganesha.nfsd Starting: Ganesha Version 5.7-2 Feb 27 21:01:21 rhcs7node1 systemd[1]: Started Ceph nfs.nfsganesha1.0.0.rhcs7node1.yirkes for ab3fb642-f7c0-11ee-a35b-525400251b44. Feb 27 21:01:21 rhcs7node1 ceph-ab3fb642-f7c0-11ee-a35b-525400251b44-nfs-nfsganesha1-0-0-rhcs7node1-yirkes[48644]: 27/02/2025 15:31:21 : epoch 67c08549 : rhcs7node1 : ganesha.nfsd-2[main] nfs_set_param_from_conf :NFS STARTUP :EVENT :Configuration file successfully parsed Feb 27 21:01:21 rhcs7node1 ceph-ab3fb642-f7c0-11ee-a35b-525400251b44-nfs-nfsganesha1-0-0-rhcs7node1-yirkes[48644]: 27/02/2025 15:31:21 : epoch 67c08549 : rhcs7node1 : ganesha.nfsd-2[main] monitoring_init :NFS STARTUP :EVENT :Init monitoring at 0.0.0.0:9587 Feb 27 21:01:21 rhcs7node1 ceph-ab3fb642-f7c0-11ee-a35b-525400251b44-nfs-nfsganesha1-0-0-rhcs7node1-yirkes[48644]: 27/02/2025 15:31:21 : epoch 67c08549 : rhcs7node1 : ganesha.nfsd-2[main] fsal_init_fds_limit :MDCACHE LRU :EVENT :Setting the system-imposed limit on FDs to 1048576. Feb 27 21:01:21 rhcs7node1 ceph-ab3fb642-f7c0-11ee-a35b-525400251b44-nfs-nfsganesha1-0-0-rhcs7node1-yirkes[48644]: 27/02/2025 15:31:21 : epoch 67c08549 : rhcs7node1 : ganesha.nfsd-2[main] init_server_pkgs :NFS STARTUP :EVENT :Initializing ID Mapper. Feb 27 21:01:21 rhcs7node1 ceph-ab3fb642-f7c0-11ee-a35b-525400251b44-nfs-nfsganesha1-0-0-rhcs7node1-yirkes[48644]: 27/02/2025 15:31:21 : epoch 67c08549 : rhcs7node1 : ganesha.nfsd-2[main] init_server_pkgs :NFS STARTUP :EVENT :ID Mapper successfully initialized. Feb 27 21:01:21 rhcs7node1 ceph-ab3fb642-f7c0-11ee-a35b-525400251b44-nfs-nfsganesha1-0-0-rhcs7node1-yirkes[48644]: 27/02/2025 15:31:21 : epoch 67c08549 : rhcs7node1 : ganesha.nfsd-2[main] nfs_start_grace :STATE :EVENT :NFS Server Now IN GRACE, duration 90 Feb 27 21:01:21 rhcs7node1 ceph-ab3fb642-f7c0-11ee-a35b-525400251b44-nfs-nfsganesha1-0-0-rhcs7node1-yirkes[48644]: 27/02/2025 15:31:21 : epoch 67c08549 : rhcs7node1 : ganesha.nfsd-2[main] rados_kv_traverse :CLIENT ID :EVENT :Failed to lst kv ret=-2 Feb 27 21:01:21 rhcs7node1 ceph-ab3fb642-f7c0-11ee-a35b-525400251b44-nfs-nfsganesha1-0-0-rhcs7node1-yirkes[48644]: 27/02/2025 15:31:21 : epoch 67c08549 : rhcs7node1 : ganesha.nfsd-2[main] rados_cluster_read_clids :CLIENT ID :EVENT :Failed to traverse recovery db: -2 Feb 27 21:01:21 rhcs7node1 ceph-ab3fb642-f7c0-11ee-a35b-525400251b44-nfs-nfsganesha1-0-0-rhcs7node1-yirkes[48644]: 27/02/2025 15:31:21 : epoch 67c08549 : rhcs7node1 : ganesha.nfsd-2[main] nfs_start_grace :STATE :EVENT :grace reload client info completed from backend Feb 27 21:01:21 rhcs7node1 ceph-ab3fb642-f7c0-11ee-a35b-525400251b44-nfs-nfsganesha1-0-0-rhcs7node1-yirkes[48644]: 27/02/2025 15:31:21 : epoch 67c08549 : rhcs7node1 : ganesha.nfsd-2[main] nfs_try_lift_grace :STATE :EVENT :check grace:reclaim complete(0) clid count(0) Feb 27 21:01:24 rhcs7node1 ceph-ab3fb642-f7c0-11ee-a35b-525400251b44-nfs-nfsganesha1-0-0-rhcs7node1-yirkes[48644]: 27/02/2025 15:31:24 : epoch 67c08549 : rhcs7node1 : ganesha.nfsd-2[main] rados_cluster_end_grace :CLIENT ID :EVENT :Failed to remove rec-0000000000000001:nfs.nfsganesha1.0: -2 Feb 27 21:01:24 rhcs7node1 ceph-ab3fb642-f7c0-11ee-a35b-525400251b44-nfs-nfsganesha1-0-0-rhcs7node1-yirkes[48644]: 27/02/2025 15:31:24 : epoch 67c08549 : rhcs7node1 : ganesha.nfsd-2[main] nfs_lift_grace_locked :STATE :EVENT :NFS Server Now NOT IN GRACE Feb 27 21:01:24 rhcs7node1 ceph-ab3fb642-f7c0-11ee-a35b-525400251b44-nfs-nfsganesha1-0-0-rhcs7node1-yirkes[48644]: 27/02/2025 15:31:24 : epoch 67c08549 : rhcs7node1 : ganesha.nfsd-2[main] main :NFS STARTUP :WARN :No export entries found in configuration file !!! Feb 27 21:01:24 rhcs7node1 ceph-ab3fb642-f7c0-11ee-a35b-525400251b44-nfs-nfsganesha1-0-0-rhcs7node1-yirkes[48644]: 27/02/2025 15:31:24 : epoch 67c08549 : rhcs7node1 : ganesha.nfsd-2[main] config_errs_to_log :CONFIG :WARN :Config File (/etc/ganesha/ganesha.conf:24): Unknown block (RADOS_URLS) Feb 27 21:01:24 rhcs7node1 ceph-ab3fb642-f7c0-11ee-a35b-525400251b44-nfs-nfsganesha1-0-0-rhcs7node1-yirkes[48644]: 27/02/2025 15:31:24 : epoch 67c08549 : rhcs7node1 : ganesha.nfsd-2[main] config_errs_to_log :CONFIG :WARN :Config File (/etc/ganesha/ganesha.conf:29): Unknown block (RGW) Feb 27 21:01:24 rhcs7node1 ceph-ab3fb642-f7c0-11ee-a35b-525400251b44-nfs-nfsganesha1-0-0-rhcs7node1-yirkes[48644]: 27/02/2025 15:31:24 : epoch 67c08549 : rhcs7node1 : ganesha.nfsd-2[main] lower_my_caps :NFS STARTUP :EVENT :CAP_SYS_RESOURCE was successfully removed for proper quota management in FSAL Feb 27 21:01:24 rhcs7node1 ceph-ab3fb642-f7c0-11ee-a35b-525400251b44-nfs-nfsganesha1-0-0-rhcs7node1-yirkes[48644]: 27/02/2025 15:31:24 : epoch 67c08549 : rhcs7node1 : ganesha.nfsd-2[main] lower_my_caps :NFS STARTUP :EVENT :currently set capabilities are: cap_chown,cap_dac_override,cap_fowner,cap_fsetid,cap_kill,cap_setgid,cap_setuid,cap_setpcap,cap_net_bind_service,cap_sys_chroot,cap_setfcap=ep Feb 27 21:01:24 rhcs7node1 ceph-ab3fb642-f7c0-11ee-a35b-525400251b44-nfs-nfsganesha1-0-0-rhcs7node1-yirkes[48644]: 27/02/2025 15:31:24 : epoch 67c08549 : rhcs7node1 : ganesha.nfsd-2[main] gsh_dbus_pkginit :DBUS :CRIT :dbus_bus_get failed (Failed to connect to socket /run/dbus/system_bus_socket: No such file or directory) Feb 27 21:01:24 rhcs7node1 ceph-ab3fb642-f7c0-11ee-a35b-525400251b44-nfs-nfsganesha1-0-0-rhcs7node1-yirkes[48644]: 27/02/2025 15:31:24 : epoch 67c08549 : rhcs7node1 : ganesha.nfsd-2[main] gsh_dbus_register_path :DBUS :CRIT :dbus_connection_register_object_path called with no DBUS connection Feb 27 21:01:24 rhcs7node1 ceph-ab3fb642-f7c0-11ee-a35b-525400251b44-nfs-nfsganesha1-0-0-rhcs7node1-yirkes[48644]: 27/02/2025 15:31:24 : epoch 67c08549 : rhcs7node1 : ganesha.nfsd-2[main] gsh_dbus_register_path :DBUS :CRIT :dbus_connection_register_object_path called with no DBUS connection Feb 27 21:01:24 rhcs7node1 ceph-ab3fb642-f7c0-11ee-a35b-525400251b44-nfs-nfsganesha1-0-0-rhcs7node1-yirkes[48644]: 27/02/2025 15:31:24 : epoch 67c08549 : rhcs7node1 : ganesha.nfsd-2[main] gsh_dbus_register_path :DBUS :CRIT :dbus_connection_register_object_path called with no DBUS connection Feb 27 21:01:25 rhcs7node1 ceph-ab3fb642-f7c0-11ee-a35b-525400251b44-nfs-nfsganesha1-0-0-rhcs7node1-yirkes[48644]: 27/02/2025 15:31:25 : epoch 67c08549 : rhcs7node1 : ganesha.nfsd-2[main] nfs_Init_svc :DISP :CRIT :Cannot acquire credentials for principal nfs Feb 27 21:01:25 rhcs7node1 ceph-ab3fb642-f7c0-11ee-a35b-525400251b44-nfs-nfsganesha1-0-0-rhcs7node1-yirkes[48644]: 27/02/2025 15:31:25 : epoch 67c08549 : rhcs7node1 : ganesha.nfsd-2[main] __Register_program :DISP :MAJ :Cannot register NFS V3 on UDP Feb 27 21:01:25 rhcs7node1 podman[48713]: 2025-02-27 21:01:25.026688405 +0530 IST m=+0.014838954 container died 3576d98f36885b9659cf132fc724533e245b3e0a5d8b7802ab27c110aa619c26 (image=registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:3d75ca419b9ef00cf2c944680737e84e6e1059e0f33156bc21d4dbf76a7da5b1, name=ceph-ab3fb642-f7c0-11ee-a35b-525400251b44-nfs-nfsganesha1-0-0-rhcs7node1-yirkes, io.k8s.display-name=Red Hat Ceph Storage 7 on RHEL 9, architecture=x86_64, description=Red Hat Ceph Storage 7, com.redhat.component=rhceph-container, CEPH_POINT_RELEASE=, RELEASE=main, vendor=Red Hat, Inc., build-date=2024-05-31T19:34:18, io.openshift.tags=rhceph ceph, summary=Provides the latest Red Hat Ceph Storage 7 on RHEL 9 in a fully featured and supported base image., name=rhceph, GIT_REPO=https://github.com/ceph/ceph-container.git, distribution-scope=public, version=7, io.openshift.expose-services=, vcs-ref=cba612d428f1498c8ae5570dd75a670ccf94c03d, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, GIT_BRANCH=main, url=https://access.redhat.com/containers/#/registry.access.redhat.com/rhceph/images/7-385, release=385, com.redhat.license_terms=https://www.redhat.com/agreements, GIT_CLEAN=True, vcs-type=git, ceph=True, io.k8s.description=Red Hat Ceph Storage 7, io.buildah.version=1.29.0, maintainer=Guillaume Abrioux <gabrioux>) Feb 27 21:01:25 rhcs7node1 podman[48713]: 2025-02-27 21:01:25.082710004 +0530 IST m=+0.070860554 container remove 3576d98f36885b9659cf132fc724533e245b3e0a5d8b7802ab27c110aa619c26 (image=registry.redhat.io/rhceph/rhceph-7-rhel9@sha256:3d75ca419b9ef00cf2c944680737e84e6e1059e0f33156bc21d4dbf76a7da5b1, name=ceph-ab3fb642-f7c0-11ee-a35b-525400251b44-nfs-nfsganesha1-0-0-rhcs7node1-yirkes, io.openshift.tags=rhceph ceph, io.k8s.description=Red Hat Ceph Storage 7, maintainer=Guillaume Abrioux <gabrioux>, description=Red Hat Ceph Storage 7, CEPH_POINT_RELEASE=, io.openshift.expose-services=, GIT_REPO=https://github.com/ceph/ceph-container.git, io.k8s.display-name=Red Hat Ceph Storage 7 on RHEL 9, com.redhat.license_terms=https://www.redhat.com/agreements, RELEASE=main, architecture=x86_64, vendor=Red Hat, Inc., ceph=True, build-date=2024-05-31T19:34:18, summary=Provides the latest Red Hat Ceph Storage 7 on RHEL 9 in a fully featured and supported base image., vcs-ref=cba612d428f1498c8ae5570dd75a670ccf94c03d, version=7, release=385, com.redhat.component=rhceph-container, GIT_BRANCH=main, GIT_CLEAN=True, io.buildah.version=1.29.0, name=rhceph, GIT_COMMIT=12717c0777377369ea674892da98b0d85250f5b0, distribution-scope=public, vcs-type=git, url=https://access.redhat.com/containers/#/registry.access.redhat.com/rhceph/images/7-385) Feb 27 21:01:25 rhcs7node1 systemd[1]: ceph-ab3fb642-f7c0-11ee-a35b-525400251b44.0.0.rhcs7node1.yirkes.service: Main process exited, code=exited, status=2/INVALIDARGUMENT Feb 27 21:01:25 rhcs7node1 systemd[1]: ceph-ab3fb642-f7c0-11ee-a35b-525400251b44.0.0.rhcs7node1.yirkes.service: Failed with result 'exit-code'. ~~~ Regards, Geo Jose
Hello, After disabling nfsv3, the service is starting: ~~~ [root@rhcs7node1 nfs.nfsganesha1.0.0.rhcs7node1.yirkes]# cat etc/ganesha/ganesha.conf # This file is generated by cephadm. NFS_CORE_PARAM { Enable_NLM = false; Enable_RQUOTA = false; Protocols = 4; mount_path_pseudo = true; NFS_Port = 2049; Enable_UDP = false; } NFSv4 { Delegations = false; RecoveryBackend = 'rados_cluster'; Minor_Versions = 1, 2; IdmapConf = "/etc/ganesha/idmap.conf"; } RADOS_KV { UserId = "nfs.nfsganesha1.0.0.rhcs7node1.yirkes"; nodeid = "nfs.nfsganesha1.0"; pool = ".nfs"; namespace = "nfsganesha1"; } RADOS_URLS { UserId = "nfs.nfsganesha1.0.0.rhcs7node1.yirkes"; watch_url = "rados://.nfs/nfsganesha1/conf-nfs.nfsganesha1"; } RGW { cluster = "ceph"; name = "client.nfs.nfsganesha1.0.0.rhcs7node1.yirkes-rgw"; } %url rados://.nfs/nfsganesha1/conf-nfs.nfsganesha1 [root@rhcs7node1 nfs.nfsganesha1.0.0.rhcs7node1.yirkes]# systemctl stop ceph-ab3fb642-f7c0-11ee-a35b-525400251b44.0.0.rhcs7node1.yirkes.service [root@rhcs7node1 nfs.nfsganesha1.0.0.rhcs7node1.yirkes]# systemctl reset-failed [root@rhcs7node1 nfs.nfsganesha1.0.0.rhcs7node1.yirkes]# systemctl start ceph-ab3fb642-f7c0-11ee-a35b-525400251b44.0.0.rhcs7node1.yirkes.service [root@rhcs7node1 nfs.nfsganesha1.0.0.rhcs7node1.yirkes]# systemctl status ceph-ab3fb642-f7c0-11ee-a35b-525400251b44.0.0.rhcs7node1.yirkes.service ● ceph-ab3fb642-f7c0-11ee-a35b-525400251b44.0.0.rhcs7node1.yirkes.service - Ceph nfs.nfsganesha1.0.0.rhcs7node1.yirkes for ab3fb642-f7c0-11ee-a35b-525400251b44 Loaded: loaded (/etc/systemd/system/ceph-ab3fb642-f7c0-11ee-a35b-525400251b44@.service; enabled; preset: disabled) Active: active (running) since Mon 2025-03-03 18:46:06 IST; 5s ago Process: 2014974 ExecStartPre=/bin/rm -f /run/ceph-ab3fb642-f7c0-11ee-a35b-525400251b44.0.0.rhcs7node1.yirkes.service-pid /run/ceph-ab3fb642-f7c0-11ee-a35b-525400251b44.0.0.r> Process: 2014975 ExecStart=/bin/bash /var/lib/ceph/ab3fb642-f7c0-11ee-a35b-525400251b44/nfs.nfsganesha1.0.0.rhcs7node1.yirkes/unit.run (code=exited, status=0/SUCCESS) Main PID: 2015015 (conmon) Tasks: 34 (limit: 11023) Memory: 30.5M CPU: 203ms CGroup: /system.slice/system-ceph\x2dab3fb642\x2df7c0\x2d11ee\x2da35b\x2d525400251b44.slice/ceph-ab3fb642-f7c0-11ee-a35b-525400251b44.0.0.rhcs7node1.yirkes.service ├─libpod-payload-2baa4fbb4e35296f388776b04e690ba579e5577c34a372fe4b127e74a90f8835 │ ├─2015017 /run/podman-init -- /usr/bin/ganesha.nfsd -F -L STDERR -N NIV_EVENT │ └─2015019 /usr/bin/ganesha.nfsd -F -L STDERR -N NIV_EVENT └─runtime └─2015015 /usr/bin/conmon --api-version 1 -c 2baa4fbb4e35296f388776b04e690ba579e5577c34a372fe4b127e74a90f8835 -u 2baa4fbb4e35296f388776b04e690ba579e5577c34a372fe4b127e74a90f8835 -r /usr/bin/crun > Mar 03 18:46:06 rhcs7node1 ceph-ab3fb642-f7c0-11ee-a35b-525400251b44-nfs-nfsganesha1-0-0-rhcs7node1-yirkes[2015015]: 03/03/2025 13:16:06 : epoch 67c5ab96 : rhcs7node1 : ganesha.nfsd-2[main] init_logging :LOG :N> Mar 03 18:46:06 rhcs7node1 ceph-ab3fb642-f7c0-11ee-a35b-525400251b44-nfs-nfsganesha1-0-0-rhcs7node1-yirkes[2015015]: 03/03/2025 13:16:06 : epoch 67c5ab96 : rhcs7node1 : ganesha.nfsd-2[main] main :MAIN :EVENT :g> Mar 03 18:46:06 rhcs7node1 ceph-ab3fb642-f7c0-11ee-a35b-525400251b44-nfs-nfsganesha1-0-0-rhcs7node1-yirkes[2015015]: 03/03/2025 13:16:06 : epoch 67c5ab96 : rhcs7node1 : ganesha.nfsd-2[main] nfs_set_param_from_c> Mar 03 18:46:06 rhcs7node1 ceph-ab3fb642-f7c0-11ee-a35b-525400251b44-nfs-nfsganesha1-0-0-rhcs7node1-yirkes[2015015]: 03/03/2025 13:16:06 : epoch 67c5ab96 : rhcs7node1 : ganesha.nfsd-2[main] monitoring_init :NFS> Mar 03 18:46:06 rhcs7node1 ceph-ab3fb642-f7c0-11ee-a35b-525400251b44-nfs-nfsganesha1-0-0-rhcs7node1-yirkes[2015015]: 03/03/2025 13:16:06 : epoch 67c5ab96 : rhcs7node1 : ganesha.nfsd-2[main] fsal_init_fds_limit > Mar 03 18:46:06 rhcs7node1 ceph-ab3fb642-f7c0-11ee-a35b-525400251b44-nfs-nfsganesha1-0-0-rhcs7node1-yirkes[2015015]: 03/03/2025 13:16:06 : epoch 67c5ab96 : rhcs7node1 : ganesha.nfsd-2[main] init_server_pkgs :NF> Mar 03 18:46:06 rhcs7node1 ceph-ab3fb642-f7c0-11ee-a35b-525400251b44-nfs-nfsganesha1-0-0-rhcs7node1-yirkes[2015015]: 03/03/2025 13:16:06 : epoch 67c5ab96 : rhcs7node1 : ganesha.nfsd-2[main] init_server_pkgs :NF> Mar 03 18:46:06 rhcs7node1 ceph-ab3fb642-f7c0-11ee-a35b-525400251b44-nfs-nfsganesha1-0-0-rhcs7node1-yirkes[2015015]: 03/03/2025 13:16:06 : epoch 67c5ab96 : rhcs7node1 : ganesha.nfsd-2[main] nfs_start_grace :STA> Mar 03 18:46:06 rhcs7node1 ceph-ab3fb642-f7c0-11ee-a35b-525400251b44-nfs-nfsganesha1-0-0-rhcs7node1-yirkes[2015015]: 03/03/2025 13:16:06 : epoch 67c5ab96 : rhcs7node1 : ganesha.nfsd-2[main] nfs_start_grace :STA> Mar 03 18:46:06 rhcs7node1 ceph-ab3fb642-f7c0-11ee-a35b-525400251b44-nfs-nfsganesha1-0-0-rhcs7node1-yirkes[2015015]: 03/03/2025 13:16:06 : epoch 67c5ab96 : rhcs7node1 : ganesha.nfsd-2[main] nfs_try_lift_grace :> [root@rhcs7node1 nfs.nfsganesha1.0.0.rhcs7node1.yirkes]# systemctl --type=service | grep nfs ceph-ab3fb642-f7c0-11ee-a35b-525400251b44.0.0.rhcs7node1.yirkes.service loaded active running Ceph nfs.nfsganesha1.0.0.rhcs7node1.yirkes for ab3fb642-f7c0-11ee-a35b-525400251b44 ~~~ After disabling the nfs v3 on all nfs nodes, services are starting: ~~~ [root@rhcs7node1 nfs.nfsganesha1.0.0.rhcs7node1.yirkes]# ceph orch ps --daemon_type nfs NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID nfs.nfsganesha1.0.0.rhcs7node1.yirkes rhcs7node1 *:2049 running (4m) 0s ago 3d 98.2M - 5.7 5412073bd769 2baa4fbb4e35 nfs.nfsganesha1.1.0.rhcs7node3.wbvlig rhcs7node3 *:2049 running (50s) 0s ago 3d 87.4M - 5.7 5412073bd769 37b9174958fd [root@rhcs7node1 nfs.nfsganesha1.0.0.rhcs7node1.yirkes]# ~~~ Regards, Geo Jose
Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory (Important: Red Hat Ceph Storage 7.1 security, bug fix, and enhancement updates), and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHSA-2025:4664