Bug 1759702

Summary: [RFE] MDS Ephemeral Pinning
Product: [Red Hat Storage] Red Hat Ceph Storage Reporter: Patrick Donnelly <pdonnell>
Component: CephFSAssignee: Patrick Donnelly <pdonnell>
Status: CLOSED ERRATA QA Contact: Amarnath <amk>
Severity: low Docs Contact: Ranjini M N <rmandyam>
Priority: high    
Version: 5.0CC: ceph-eng-bugs, ceph-qe-bugs, hyelloji, rmandyam, sweil, tchandra, tserlin
Target Milestone: ---Keywords: FutureFeature, Performance
Target Release: 5.0   
Hardware: All   
OS: All   
Whiteboard:
Fixed In Version: ceph-15.2.4-2.el8cp Doc Type: Enhancement
Doc Text:
.Users can now use the ephemeral pinning policies for automated distribution of subtrees among MDS With this release, the export pins are improved by introducing efficient strategies to pin subtrees, thereby enabling automated distribution of subtrees among Metadata Servers (MDS) and eliminating user intervention for manual pinning. See the link:{cephfs-guide}#ephemeral-pinning-policies_fs[_Ephemeral pinning policies_] section in the _{storage-product} File System Guide_ for more information.
Story Points: ---
Clone Of: Environment:
Last Closed: 2021-08-30 08:22:57 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 1929729, 1959686, 2022467    

Description Patrick Donnelly 2019-10-08 21:09:55 UTC
Description of problem:

See: https://tracker.ceph.com/issues/41302

Comment 6 Amarnath 2021-04-26 11:42:59 UTC
In 2.8. EPHEMERAL PINNING POLICIES, Random pinning is failing when we give PERCENTAGE.

setfattr -n ceph.dir.pin.random -v PERCENTAGE DIRECTORY_PATH

I tried different ways 

[root@ceph-amar-adm-8-1619169765647-node7-client _nogroup]# setfattr -n ceph.dir.pin.distributed -v 1 /mnt/fuse_mount/volumes/_nogroup/
[root@ceph-amar-adm-8-1619169765647-node7-client _nogroup]# setfattr -n ceph.dir.pin.random -v 10 /mnt/fuse_mount/volumes/_nogroup/sub_vol_1
setfattr: /mnt/fuse_mount/volumes/_nogroup/sub_vol_1: Numerical argument out of domain
[root@ceph-amar-adm-8-1619169765647-node7-client _nogroup]# setfattr -n ceph.dir.pin.random -v 0.1 /mnt/fuse_mount/volumes/_nogroup/sub_vol_1
setfattr: /mnt/fuse_mount/volumes/_nogroup/sub_vol_1: Invalid argument
[root@ceph-amar-adm-8-1619169765647-node7-client _nogroup]# setfattr -n ceph.dir.pin.random -v 5 /mnt/fuse_mount/volumes/_nogroup/sub_vol_1
setfattr: /mnt/fuse_mount/volumes/_nogroup/sub_vol_1: Numerical argument out of domain
[root@ceph-amar-adm-8-1619169765647-node7-client _nogroup]# setfattr -n ceph.dir.pin.random -v 1 /mnt/fuse_mount/volumes/_nogroup/sub_vol_1
setfattr: /mnt/fuse_mount/volumes/_nogroup/sub_vol_1: Invalid argument
[root@ceph-amar-adm-8-1619169765647-node7-client _nogroup]# setfattr -n ceph.dir.pin.random -v 1% /mnt/fuse_mount/volumes/_nogroup/sub_vol_1
setfattr: /mnt/fuse_mount/volumes/_nogroup/sub_vol_1: Invalid argument


Links Referred :
Section 2.8 - https://cee-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/CCS/job/ccs-mr-preview/34832/artifact/preview/index.html#ephemeral-pinning-policies_fs

Comment 9 Amarnath 2021-04-29 08:39:28 UTC
Docs have been updated

Preview Link:

- https://cee-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/CCS/job/ccs-mr-preview/35209/artifact/preview/index.html#ephemeral-pinning-policies_fs

Tested as per Docs and looks fine

As we pin to the rank IOs are going with that rank only. tested this using ceph fs status

[root@ceph-amar-adm-8-1619671138159-node1-mgr-mon-installer-client a]# setfattr -n ceph.dir.pin.distributed -v 2 /mnt/fuse_mount/volumes/_nogroup/subvol_1/ae6dd6a1-c311-4079-a7a6-cfb9f7c89e1c
setfattr: /mnt/fuse_mount/volumes/_nogroup/subvol_1/ae6dd6a1-c311-4079-a7a6-cfb9f7c89e1c: Invalid argument
[root@ceph-amar-adm-8-1619671138159-node1-mgr-mon-installer-client a]# setfattr -n ceph.dir.pin.distributed -v 1 /mnt/fuse_mount/volumes/_nogroup/subvol_1/ae6dd6a1-c311-4079-a7a6-cfb9f7c89e1c
[root@ceph-amar-adm-8-1619671138159-node1-mgr-mon-installer-client a]# setfattr -n ceph.dir.pin.random -v 0.01 /mnt/fuse_mount/volumes/_nogroup/subvol_1/ae6dd6a1-c311-4079-a7a6-cfb9f7c89e1c
[root@ceph-amar-adm-8-1619671138159-node1-mgr-mon-installer-client a]# setfattr -n ceph.dir.pin.random -v 0.02 /mnt/fuse_mount/volumes/_nogroup/subvol_1/ae6dd6a1-c311-4079-a7a6-cfb9f7c89e1c
setfattr: /mnt/fuse_mount/volumes/_nogroup/subvol_1/ae6dd6a1-c311-4079-a7a6-cfb9f7c89e1c: Invalid argument
[root@ceph-amar-adm-8-1619671138159-node1-mgr-mon-installer-client a]# 
[root@ceph-amar-adm-8-1619671138159-node1-mgr-mon-installer-client a]# setfattr -n ceph.dir.pin -v 0 /mnt/fuse_mount/volumes/_nogroup/subvol_1/ae6dd6a1-c311-4079-a7a6-cfb9f7c89e1c/a/b/
[root@ceph-amar-adm-8-1619671138159-node1-mgr-mon-installer-client a]# setfattr -n ceph.dir.pin -v 1 /mnt/fuse_mount/volumes/_nogroup/subvol_1/ae6dd6a1-c311-4079-a7a6-cfb9f7c89e1c/

Comment 15 errata-xmlrpc 2021-08-30 08:22:57 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Red Hat Ceph Storage 5.0 bug fix and enhancement), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2021:3294