Bug 1759702 - [RFE] MDS Ephemeral Pinning
Summary: [RFE] MDS Ephemeral Pinning
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat Ceph Storage
Classification: Red Hat Storage
Component: CephFS
Version: 5.0
Hardware: All
OS: All
high
low
Target Milestone: ---
: 5.0
Assignee: Patrick Donnelly
QA Contact: Amarnath
Ranjini M N
URL:
Whiteboard:
Depends On:
Blocks: 1929729 1959686 2022467
TreeView+ depends on / blocked
 
Reported: 2019-10-08 21:09 UTC by Patrick Donnelly
Modified: 2023-01-24 14:56 UTC (History)
7 users (show)

Fixed In Version: ceph-15.2.4-2.el8cp
Doc Type: Enhancement
Doc Text:
.Users can now use the ephemeral pinning policies for automated distribution of subtrees among MDS With this release, the export pins are improved by introducing efficient strategies to pin subtrees, thereby enabling automated distribution of subtrees among Metadata Servers (MDS) and eliminating user intervention for manual pinning. See the link:{cephfs-guide}#ephemeral-pinning-policies_fs[_Ephemeral pinning policies_] section in the _{storage-product} File System Guide_ for more information.
Clone Of:
Environment:
Last Closed: 2021-08-30 08:22:57 UTC
Embargoed:

Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Ceph Project Bug Tracker 41302 0 None None None 2019-10-08 21:09:55 UTC
Red Hat Issue Tracker RHCEPH-1118 0 None None None 2021-08-30 00:11:48 UTC
Red Hat Product Errata RHBA-2021:3294 0 None None None 2021-08-30 08:23:31 UTC

Description Patrick Donnelly 2019-10-08 21:09:55 UTC 
Description of problem:

See: https://tracker.ceph.com/issues/41302
Comment 6 Amarnath 2021-04-26 11:42:59 UTC 
In 2.8. EPHEMERAL PINNING POLICIES, Random pinning is failing when we give PERCENTAGE.

setfattr -n ceph.dir.pin.random -v PERCENTAGE DIRECTORY_PATH

I tried different ways 

[root@ceph-amar-adm-8-1619169765647-node7-client _nogroup]# setfattr -n ceph.dir.pin.distributed -v 1 /mnt/fuse_mount/volumes/_nogroup/
[root@ceph-amar-adm-8-1619169765647-node7-client _nogroup]# setfattr -n ceph.dir.pin.random -v 10 /mnt/fuse_mount/volumes/_nogroup/sub_vol_1
setfattr: /mnt/fuse_mount/volumes/_nogroup/sub_vol_1: Numerical argument out of domain
[root@ceph-amar-adm-8-1619169765647-node7-client _nogroup]# setfattr -n ceph.dir.pin.random -v 0.1 /mnt/fuse_mount/volumes/_nogroup/sub_vol_1
setfattr: /mnt/fuse_mount/volumes/_nogroup/sub_vol_1: Invalid argument
[root@ceph-amar-adm-8-1619169765647-node7-client _nogroup]# setfattr -n ceph.dir.pin.random -v 5 /mnt/fuse_mount/volumes/_nogroup/sub_vol_1
setfattr: /mnt/fuse_mount/volumes/_nogroup/sub_vol_1: Numerical argument out of domain
[root@ceph-amar-adm-8-1619169765647-node7-client _nogroup]# setfattr -n ceph.dir.pin.random -v 1 /mnt/fuse_mount/volumes/_nogroup/sub_vol_1
setfattr: /mnt/fuse_mount/volumes/_nogroup/sub_vol_1: Invalid argument
[root@ceph-amar-adm-8-1619169765647-node7-client _nogroup]# setfattr -n ceph.dir.pin.random -v 1% /mnt/fuse_mount/volumes/_nogroup/sub_vol_1
setfattr: /mnt/fuse_mount/volumes/_nogroup/sub_vol_1: Invalid argument


Links Referred :
Section 2.8 - https://cee-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/CCS/job/ccs-mr-preview/34832/artifact/preview/index.html#ephemeral-pinning-policies_fs
Comment 9 Amarnath 2021-04-29 08:39:28 UTC 
Docs have been updated

Preview Link:

- https://cee-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/CCS/job/ccs-mr-preview/35209/artifact/preview/index.html#ephemeral-pinning-policies_fs

Tested as per Docs and looks fine

As we pin to the rank IOs are going with that rank only. tested this using ceph fs status

[root@ceph-amar-adm-8-1619671138159-node1-mgr-mon-installer-client a]# setfattr -n ceph.dir.pin.distributed -v 2 /mnt/fuse_mount/volumes/_nogroup/subvol_1/ae6dd6a1-c311-4079-a7a6-cfb9f7c89e1c
setfattr: /mnt/fuse_mount/volumes/_nogroup/subvol_1/ae6dd6a1-c311-4079-a7a6-cfb9f7c89e1c: Invalid argument
[root@ceph-amar-adm-8-1619671138159-node1-mgr-mon-installer-client a]# setfattr -n ceph.dir.pin.distributed -v 1 /mnt/fuse_mount/volumes/_nogroup/subvol_1/ae6dd6a1-c311-4079-a7a6-cfb9f7c89e1c
[root@ceph-amar-adm-8-1619671138159-node1-mgr-mon-installer-client a]# setfattr -n ceph.dir.pin.random -v 0.01 /mnt/fuse_mount/volumes/_nogroup/subvol_1/ae6dd6a1-c311-4079-a7a6-cfb9f7c89e1c
[root@ceph-amar-adm-8-1619671138159-node1-mgr-mon-installer-client a]# setfattr -n ceph.dir.pin.random -v 0.02 /mnt/fuse_mount/volumes/_nogroup/subvol_1/ae6dd6a1-c311-4079-a7a6-cfb9f7c89e1c
setfattr: /mnt/fuse_mount/volumes/_nogroup/subvol_1/ae6dd6a1-c311-4079-a7a6-cfb9f7c89e1c: Invalid argument
[root@ceph-amar-adm-8-1619671138159-node1-mgr-mon-installer-client a]# 
[root@ceph-amar-adm-8-1619671138159-node1-mgr-mon-installer-client a]# setfattr -n ceph.dir.pin -v 0 /mnt/fuse_mount/volumes/_nogroup/subvol_1/ae6dd6a1-c311-4079-a7a6-cfb9f7c89e1c/a/b/
[root@ceph-amar-adm-8-1619671138159-node1-mgr-mon-installer-client a]# setfattr -n ceph.dir.pin -v 1 /mnt/fuse_mount/volumes/_nogroup/subvol_1/ae6dd6a1-c311-4079-a7a6-cfb9f7c89e1c/
Comment 15 errata-xmlrpc 2021-08-30 08:22:57 UTC 
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Red Hat Ceph Storage 5.0 bug fix and enhancement), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2021:3294
Note You need to log in before you can comment on or make changes to this bug.