Bug 2307931 - Fuse mount caps not working on upgraded setup
Summary: Fuse mount caps not working on upgraded setup
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat Ceph Storage
Classification: Red Hat Storage
Component: CephFS
Version: 8.0
Hardware: Unspecified
OS: Unspecified
unspecified
high
Target Milestone: ---
: 8.0
Assignee: Kotresh HR
QA Contact: Amarnath
URL:
Whiteboard:
Depends On: 2299930
Blocks: 2317218
TreeView+ depends on / blocked
 
Reported: 2024-08-26 15:30 UTC by Amarnath
Modified: 2024-11-25 09:07 UTC (History)
9 users (show)

Fixed In Version: ceph-19.1.1-3.el9cp
Doc Type: Bug Fix
Doc Text:
.CephFS FUSE clients can now correctly access the specified `mds auth caps` path Previously, when parsing a path while validating `mds auth caps` FUSE clients were not able to access a specific path, even when the path was specified as `rw` for the `mds auth caps`. With this fix, the parsing issue of the path while validating `mds auth caps` is fixed and the paths can be accessed as expected.
Clone Of:
Environment:
Last Closed: 2024-11-25 09:07:19 UTC
Embargoed:
khiremat: needinfo-
khiremat: needinfo-


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Ceph Project Bug Tracker 67212 0 None None None 2024-08-27 13:15:07 UTC
Red Hat Issue Tracker RHCEPH-9560 0 None None None 2024-08-26 15:32:01 UTC
Red Hat Product Errata RHBA-2024:10216 0 None None None 2024-11-25 09:07:24 UTC

Description Amarnath 2024-08-26 15:30:12 UTC
Description of problem:
Fuse mount caps not working on upgraded setup

Similar to BZ : 2299930

Commands : 
root@ceph-amk-upgrade-v6rizv-node8 ~]# mkdir /mnt/cephfs_post_upgrade_kernel
[root@ceph-amk-upgrade-v6rizv-node8 ~]# mount -t ceph 10.0.67.29,10.0.64.177,10.0.67.109:/ /mnt/cephfs_post_upgrade_kernel -o name=test_auth,secretfile=/etc/ceph/test_auth.secret,fs=cephfs
[root@ceph-amk-upgrade-v6rizv-node8 ~]# cd /mnt/cephfs_post_upgrade_kernel/volumes/upgrade_svg_0/upgrade_sv_0/11095360-8237-4f3b-8392-3d01cea2ca25/
[root@ceph-amk-upgrade-v6rizv-node8 11095360-8237-4f3b-8392-3d01cea2ca25]# 
[root@ceph-amk-upgrade-v6rizv-node8 11095360-8237-4f3b-8392-3d01cea2ca25]# 

[root@ceph-amk-upgrade-v6rizv-node8 11095360-8237-4f3b-8392-3d01cea2ca25]# ceph auth get client.test_auth
[client.test_auth]
	key = AQD2hcxm6X1rLxAA01o+VeBRFWvDodnbXYt+fw==
	caps mds = "allow r fsname=cephfs, allow rw fsname=cephfs path=/volumes/upgrade_svg_0/upgrade_sv_0/11095360-8237-4f3b-8392-3d01cea2ca25/"
	caps mon = "allow r fsname=cephfs"
	caps osd = "allow rw tag cephfs data=cephfs"
[root@ceph-amk-upgrade-v6rizv-node8 11095360-8237-4f3b-8392-3d01cea2ca25]# rm -rf auth_test_file 
[root@ceph-amk-upgrade-v6rizv-node8 11095360-8237-4f3b-8392-3d01cea2ca25]# ls -lrt
total 204800
-rw-r--r--. 1 root root 104857600 Aug 26 09:39 dd_test_file
drwxr-xr-x. 2 root root         0 Aug 26 09:41 upgrade_pin_dir_1
drwxr-xr-x. 2 root root         0 Aug 26 09:41 upgrade_pin_dir_3
drwxr-xr-x. 2 root root         0 Aug 26 09:41 upgrade_pin_dir_2
drwxr-xr-x. 2 root root         0 Aug 26 09:41 upgrade_pin_dir_4
drwxr-xr-x. 3 root root         1 Aug 26 09:42 file_srcdir
drwxr-xr-x. 3 root root         1 Aug 26 09:42 file_dstdir
drwxr-xr-x. 2 root root         2 Aug 26 09:43 network_shared
drwxr-xr-x. 5 root root         3 Aug 26 09:53 run_ios
-rw-r--r--. 1 root root 104857600 Aug 26 10:04 dd_test_file_uz
drwxr-xr-x. 5 root root         3 Aug 26 10:05 smallfile_io_dir_v2pv
[root@ceph-amk-upgrade-v6rizv-node8 11095360-8237-4f3b-8392-3d01cea2ca25]# touch auth_test_file 
[root@ceph-amk-upgrade-v6rizv-node8 11095360-8237-4f3b-8392-3d01cea2ca25]# ls -lrt
total 204805
-rw-r--r--. 1 root root 104857600 Aug 26 09:39 dd_test_file
drwxr-xr-x. 2 root root         0 Aug 26 09:41 upgrade_pin_dir_1
drwxr-xr-x. 2 root root         0 Aug 26 09:41 upgrade_pin_dir_3
drwxr-xr-x. 2 root root         0 Aug 26 09:41 upgrade_pin_dir_2
drwxr-xr-x. 2 root root         0 Aug 26 09:41 upgrade_pin_dir_4
drwxr-xr-x. 3 root root         0 Aug 26 09:42 file_srcdir
drwxr-xr-x. 3 root root         0 Aug 26 09:42 file_dstdir
drwxr-xr-x. 2 root root        10 Aug 26 09:43 network_shared
drwxr-xr-x. 5 root root        10 Aug 26 09:53 run_ios
-rw-r--r--. 1 root root 104857600 Aug 26 10:04 dd_test_file_uz
drwxr-xr-x. 5 root root        10 Aug 26 10:05 smallfile_io_dir_v2pv
-rw-r--r--. 1 root root         0 Aug 26 11:10 auth_test_file


ON fuse mount not working 
[root@ceph-amk-upgrade-v6rizv-node8 11095360-8237-4f3b-8392-3d01cea2ca25]# mkdir /mnt/cephfs_post_upgrade_fuse
[root@ceph-amk-upgrade-v6rizv-node8 11095360-8237-4f3b-8392-3d01cea2ca25]# ceph-fuse -n client.test_auth /mnt/cephfs_post_upgrade_fuse -r / --client_fs cephfs
2024-08-26T11:12:02.100-0400 7f09c3c40480 -1 init, newargv = 0x564f6e878e00 newargc=15
ceph-fuse[25553]: starting ceph client
ceph-fuse[25553]: starting fuse

[root@ceph-amk-upgrade-v6rizv-node8 11095360-8237-4f3b-8392-3d01cea2ca25]# ls -lrt
total 204805
-rw-r--r--. 1 root root 104857600 Aug 26 09:39 dd_test_file
drwxr-xr-x. 2 root root         0 Aug 26 09:41 upgrade_pin_dir_1
drwxr-xr-x. 2 root root         0 Aug 26 09:41 upgrade_pin_dir_3
drwxr-xr-x. 2 root root         0 Aug 26 09:41 upgrade_pin_dir_2
drwxr-xr-x. 2 root root         0 Aug 26 09:41 upgrade_pin_dir_4
drwxr-xr-x. 3 root root         0 Aug 26 09:42 file_srcdir
drwxr-xr-x. 3 root root         0 Aug 26 09:42 file_dstdir
drwxr-xr-x. 2 root root        10 Aug 26 09:43 network_shared
drwxr-xr-x. 5 root root        10 Aug 26 09:53 run_ios
-rw-r--r--. 1 root root 104857600 Aug 26 10:04 dd_test_file_uz
drwxr-xr-x. 5 root root        10 Aug 26 10:05 smallfile_io_dir_v2pv
-rw-r--r--. 1 root root         0 Aug 26 11:13 auth_test_file
[root@ceph-amk-upgrade-v6rizv-node8 11095360-8237-4f3b-8392-3d01cea2ca25]# touch test
touch: setting times of 'test': Permission denied
[root@ceph-amk-upgrade-v6rizv-node8 11095360-8237-4f3b-8392-3d01cea2ca25]# ls -lrt
total 204805
-rw-r--r--. 1 root root 104857600 Aug 26 09:39 dd_test_file
drwxr-xr-x. 2 root root         0 Aug 26 09:41 upgrade_pin_dir_1
drwxr-xr-x. 2 root root         0 Aug 26 09:41 upgrade_pin_dir_3
drwxr-xr-x. 2 root root         0 Aug 26 09:41 upgrade_pin_dir_2
drwxr-xr-x. 2 root root         0 Aug 26 09:41 upgrade_pin_dir_4
drwxr-xr-x. 3 root root         0 Aug 26 09:42 file_srcdir
drwxr-xr-x. 3 root root         0 Aug 26 09:42 file_dstdir
drwxr-xr-x. 2 root root        10 Aug 26 09:43 network_shared
drwxr-xr-x. 5 root root        10 Aug 26 09:53 run_ios
-rw-r--r--. 1 root root 104857600 Aug 26 10:04 dd_test_file_uz
drwxr-xr-x. 5 root root        10 Aug 26 10:05 smallfile_io_dir_v2pv
-rw-r--r--. 1 root root         0 Aug 26 11:13 auth_test_file
-rw-r--r--. 1 root root         0 Aug 26 11:27 test


But ls still creates the file but we are seeing permission denied error


Logs : http://magna002.ceph.redhat.com/cephci-jenkins/cephci-run-V6RIZV/

Version-Release number of selected component (if applicable):
[root@ceph-amk-upgrade-v6rizv-node8 11095360-8237-4f3b-8392-3d01cea2ca25]# ceph versions
{
    "mon": {
        "ceph version 19.1.0-45.el9cp (7db979d7caa5483bb0c1e2d206ead532c940adcb) squid (rc)": 3
    },
    "mgr": {
        "ceph version 19.1.0-45.el9cp (7db979d7caa5483bb0c1e2d206ead532c940adcb) squid (rc)": 2
    },
    "osd": {
        "ceph version 19.1.0-45.el9cp (7db979d7caa5483bb0c1e2d206ead532c940adcb) squid (rc)": 16
    },
    "mds": {
        "ceph version 19.1.0-45.el9cp (7db979d7caa5483bb0c1e2d206ead532c940adcb) squid (rc)": 5
    },
    "overall": {
        "ceph version 19.1.0-45.el9cp (7db979d7caa5483bb0c1e2d206ead532c940adcb) squid (rc)": 26
    }
}


How reproducible:


Steps to Reproduce:
1.
2.
3.

Actual results:


Expected results:


Additional info:

Comment 1 Storage PM bot 2024-08-26 15:30:23 UTC
Please specify the severity of this bug. Severity is defined here:
https://bugzilla.redhat.com/page.cgi?id=fields.html#bug_severity.

Comment 13 errata-xmlrpc 2024-11-25 09:07:19 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Red Hat Ceph Storage 8.0 security, bug fix, and enhancement updates), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2024:10216


Note You need to log in before you can comment on or make changes to this bug.