Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.
This project is now read‑only. Starting Monday, February 2, please use https://ibm-ceph.atlassian.net/ for all bug tracking management.

Bug 2307931

Summary: Fuse mount caps not working on upgraded setup
Product: [Red Hat Storage] Red Hat Ceph Storage Reporter: Amarnath <amk>
Component: CephFSAssignee: Kotresh HR <khiremat>
Status: CLOSED ERRATA QA Contact: Amarnath <amk>
Severity: high Docs Contact:
Priority: unspecified    
Version: 8.0CC: akraj, ceph-eng-bugs, cephqe-warriors, gfarnum, khiremat, ngangadh, rpollack, tserlin, vshankar
Target Milestone: ---Keywords: Automation, Regression
Target Release: 8.0Flags: khiremat: needinfo-
khiremat: needinfo-
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: ceph-19.1.1-3.el9cp Doc Type: Bug Fix
Doc Text:
.CephFS FUSE clients can now correctly access the specified `mds auth caps` path Previously, when parsing a path while validating `mds auth caps` FUSE clients were not able to access a specific path, even when the path was specified as `rw` for the `mds auth caps`. With this fix, the parsing issue of the path while validating `mds auth caps` is fixed and the paths can be accessed as expected.
 Story Points: ---
Clone Of: Environment:
Last Closed: 2024-11-25 09:07:19 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On: 2299930    
Bug Blocks: 2317218    

Description Amarnath 2024-08-26 15:30:12 UTC 
Description of problem:
Fuse mount caps not working on upgraded setup

Similar to BZ : 2299930

Commands : 
root@ceph-amk-upgrade-v6rizv-node8 ~]# mkdir /mnt/cephfs_post_upgrade_kernel
[root@ceph-amk-upgrade-v6rizv-node8 ~]# mount -t ceph 10.0.67.29,10.0.64.177,10.0.67.109:/ /mnt/cephfs_post_upgrade_kernel -o name=test_auth,secretfile=/etc/ceph/test_auth.secret,fs=cephfs
[root@ceph-amk-upgrade-v6rizv-node8 ~]# cd /mnt/cephfs_post_upgrade_kernel/volumes/upgrade_svg_0/upgrade_sv_0/11095360-8237-4f3b-8392-3d01cea2ca25/
[root@ceph-amk-upgrade-v6rizv-node8 11095360-8237-4f3b-8392-3d01cea2ca25]# 
[root@ceph-amk-upgrade-v6rizv-node8 11095360-8237-4f3b-8392-3d01cea2ca25]# 

[root@ceph-amk-upgrade-v6rizv-node8 11095360-8237-4f3b-8392-3d01cea2ca25]# ceph auth get client.test_auth
[client.test_auth]
	key = AQD2hcxm6X1rLxAA01o+VeBRFWvDodnbXYt+fw==
	caps mds = "allow r fsname=cephfs, allow rw fsname=cephfs path=/volumes/upgrade_svg_0/upgrade_sv_0/11095360-8237-4f3b-8392-3d01cea2ca25/"
	caps mon = "allow r fsname=cephfs"
	caps osd = "allow rw tag cephfs data=cephfs"
[root@ceph-amk-upgrade-v6rizv-node8 11095360-8237-4f3b-8392-3d01cea2ca25]# rm -rf auth_test_file 
[root@ceph-amk-upgrade-v6rizv-node8 11095360-8237-4f3b-8392-3d01cea2ca25]# ls -lrt
total 204800
-rw-r--r--. 1 root root 104857600 Aug 26 09:39 dd_test_file
drwxr-xr-x. 2 root root         0 Aug 26 09:41 upgrade_pin_dir_1
drwxr-xr-x. 2 root root         0 Aug 26 09:41 upgrade_pin_dir_3
drwxr-xr-x. 2 root root         0 Aug 26 09:41 upgrade_pin_dir_2
drwxr-xr-x. 2 root root         0 Aug 26 09:41 upgrade_pin_dir_4
drwxr-xr-x. 3 root root         1 Aug 26 09:42 file_srcdir
drwxr-xr-x. 3 root root         1 Aug 26 09:42 file_dstdir
drwxr-xr-x. 2 root root         2 Aug 26 09:43 network_shared
drwxr-xr-x. 5 root root         3 Aug 26 09:53 run_ios
-rw-r--r--. 1 root root 104857600 Aug 26 10:04 dd_test_file_uz
drwxr-xr-x. 5 root root         3 Aug 26 10:05 smallfile_io_dir_v2pv
[root@ceph-amk-upgrade-v6rizv-node8 11095360-8237-4f3b-8392-3d01cea2ca25]# touch auth_test_file 
[root@ceph-amk-upgrade-v6rizv-node8 11095360-8237-4f3b-8392-3d01cea2ca25]# ls -lrt
total 204805
-rw-r--r--. 1 root root 104857600 Aug 26 09:39 dd_test_file
drwxr-xr-x. 2 root root         0 Aug 26 09:41 upgrade_pin_dir_1
drwxr-xr-x. 2 root root         0 Aug 26 09:41 upgrade_pin_dir_3
drwxr-xr-x. 2 root root         0 Aug 26 09:41 upgrade_pin_dir_2
drwxr-xr-x. 2 root root         0 Aug 26 09:41 upgrade_pin_dir_4
drwxr-xr-x. 3 root root         0 Aug 26 09:42 file_srcdir
drwxr-xr-x. 3 root root         0 Aug 26 09:42 file_dstdir
drwxr-xr-x. 2 root root        10 Aug 26 09:43 network_shared
drwxr-xr-x. 5 root root        10 Aug 26 09:53 run_ios
-rw-r--r--. 1 root root 104857600 Aug 26 10:04 dd_test_file_uz
drwxr-xr-x. 5 root root        10 Aug 26 10:05 smallfile_io_dir_v2pv
-rw-r--r--. 1 root root         0 Aug 26 11:10 auth_test_file


ON fuse mount not working 
[root@ceph-amk-upgrade-v6rizv-node8 11095360-8237-4f3b-8392-3d01cea2ca25]# mkdir /mnt/cephfs_post_upgrade_fuse
[root@ceph-amk-upgrade-v6rizv-node8 11095360-8237-4f3b-8392-3d01cea2ca25]# ceph-fuse -n client.test_auth /mnt/cephfs_post_upgrade_fuse -r / --client_fs cephfs
2024-08-26T11:12:02.100-0400 7f09c3c40480 -1 init, newargv = 0x564f6e878e00 newargc=15
ceph-fuse[25553]: starting ceph client
ceph-fuse[25553]: starting fuse

[root@ceph-amk-upgrade-v6rizv-node8 11095360-8237-4f3b-8392-3d01cea2ca25]# ls -lrt
total 204805
-rw-r--r--. 1 root root 104857600 Aug 26 09:39 dd_test_file
drwxr-xr-x. 2 root root         0 Aug 26 09:41 upgrade_pin_dir_1
drwxr-xr-x. 2 root root         0 Aug 26 09:41 upgrade_pin_dir_3
drwxr-xr-x. 2 root root         0 Aug 26 09:41 upgrade_pin_dir_2
drwxr-xr-x. 2 root root         0 Aug 26 09:41 upgrade_pin_dir_4
drwxr-xr-x. 3 root root         0 Aug 26 09:42 file_srcdir
drwxr-xr-x. 3 root root         0 Aug 26 09:42 file_dstdir
drwxr-xr-x. 2 root root        10 Aug 26 09:43 network_shared
drwxr-xr-x. 5 root root        10 Aug 26 09:53 run_ios
-rw-r--r--. 1 root root 104857600 Aug 26 10:04 dd_test_file_uz
drwxr-xr-x. 5 root root        10 Aug 26 10:05 smallfile_io_dir_v2pv
-rw-r--r--. 1 root root         0 Aug 26 11:13 auth_test_file
[root@ceph-amk-upgrade-v6rizv-node8 11095360-8237-4f3b-8392-3d01cea2ca25]# touch test
touch: setting times of 'test': Permission denied
[root@ceph-amk-upgrade-v6rizv-node8 11095360-8237-4f3b-8392-3d01cea2ca25]# ls -lrt
total 204805
-rw-r--r--. 1 root root 104857600 Aug 26 09:39 dd_test_file
drwxr-xr-x. 2 root root         0 Aug 26 09:41 upgrade_pin_dir_1
drwxr-xr-x. 2 root root         0 Aug 26 09:41 upgrade_pin_dir_3
drwxr-xr-x. 2 root root         0 Aug 26 09:41 upgrade_pin_dir_2
drwxr-xr-x. 2 root root         0 Aug 26 09:41 upgrade_pin_dir_4
drwxr-xr-x. 3 root root         0 Aug 26 09:42 file_srcdir
drwxr-xr-x. 3 root root         0 Aug 26 09:42 file_dstdir
drwxr-xr-x. 2 root root        10 Aug 26 09:43 network_shared
drwxr-xr-x. 5 root root        10 Aug 26 09:53 run_ios
-rw-r--r--. 1 root root 104857600 Aug 26 10:04 dd_test_file_uz
drwxr-xr-x. 5 root root        10 Aug 26 10:05 smallfile_io_dir_v2pv
-rw-r--r--. 1 root root         0 Aug 26 11:13 auth_test_file
-rw-r--r--. 1 root root         0 Aug 26 11:27 test


But ls still creates the file but we are seeing permission denied error


Logs : http://magna002.ceph.redhat.com/cephci-jenkins/cephci-run-V6RIZV/

Version-Release number of selected component (if applicable):
[root@ceph-amk-upgrade-v6rizv-node8 11095360-8237-4f3b-8392-3d01cea2ca25]# ceph versions
{
    "mon": {
        "ceph version 19.1.0-45.el9cp (7db979d7caa5483bb0c1e2d206ead532c940adcb) squid (rc)": 3
    },
    "mgr": {
        "ceph version 19.1.0-45.el9cp (7db979d7caa5483bb0c1e2d206ead532c940adcb) squid (rc)": 2
    },
    "osd": {
        "ceph version 19.1.0-45.el9cp (7db979d7caa5483bb0c1e2d206ead532c940adcb) squid (rc)": 16
    },
    "mds": {
        "ceph version 19.1.0-45.el9cp (7db979d7caa5483bb0c1e2d206ead532c940adcb) squid (rc)": 5
    },
    "overall": {
        "ceph version 19.1.0-45.el9cp (7db979d7caa5483bb0c1e2d206ead532c940adcb) squid (rc)": 26
    }
}


How reproducible:


Steps to Reproduce:
1.
2.
3.

Actual results:


Expected results:


Additional info:
Comment 1 Storage PM bot 2024-08-26 15:30:23 UTC 
Please specify the severity of this bug. Severity is defined here:
https://bugzilla.redhat.com/page.cgi?id=fields.html#bug_severity.
Comment 13 errata-xmlrpc 2024-11-25 09:07:19 UTC 
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Red Hat Ceph Storage 8.0 security, bug fix, and enhancement updates), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2024:10216