Red Hat Bugzilla – Bug 1302988
[Tiering]: No demotions are seen from one of the brick in hot tier
Last modified: 2018-02-06 12:42:37 EST
Description of problem:
On a 16 node setup with the vol configured as mentioned below, no demotions are seen from one of the hot tier bricks after continuous promotions and demotions running on the system for few hours.
Demotions are expected to work seamlessly from all nodes whenever files are eligible for demotion and other criteria such as max.mb, max.files etc are met.
#gluster v info krk-vol
Volume Name: krk-vol
Volume ID: 192655ce-4ef6-4ada-8e0c-6f137e2721e1
Number of Bricks: 36
Hot Tier :
Hot Tier Type : Distributed-Replicate
Number of Bricks: 6 x 2 = 12
Brick9: 10.70.35.176:/rhs/brick6/krkvol --> No demotion seen from this node
Brick10: 10.70.35.232:/rhs/brick6/krkvol --> No demotion seen from this node
Cold Tier Type : Distributed-Disperse
Number of Bricks: 2 x (8 + 4) = 24
Version-Release number of selected component (if applicable):
Yet to determine
Steps to Reproduce:
1. create 16 node setup and create 2x(8+4) volume
2. enable quota and set limit usage to root directory
3. create two folders on this volume and fill data [folder1, folder2]
4. Attach 6x2 hot tier to this volume
5. create new files on another new folder [folder 3]
6. Now, continuously promote files from folder-1 making files eligible for promotion and have files on folder-2 and folder-3 idle making them eligible for demotion
7. Promote enough files so watermark can be breached
8. check if promotion & demotion is working as expected
- Demotions from one replica pair (on files in folder-2 and folder-3) on hot tier doesn't happen
- Demotion from other hot tier bricks work as expected. All files from folder-2 and folder-3 are demoted
- Demotion should work on all bricks of hot tier
sosreport shall be attached.
Files which were promoted always are files from folder - 'dd'. Files which were eligible but never demoted from a node were from files on folder - '1million-files' and 'new_files'.
Bricks from where files dont demote are - 10.70.35.176:/rhs/brick6/krkvol and 10.70.35.232:/rhs/brick6/krkvol
sosreports are available here --> http://rhsqe-repo.lab.eng.blr.redhat.com/sosreports/1295299/
Thank you for your bug report.
We are no longer working on any improvements for Tier. This bug will be set to CLOSED WONTFIX to reflect this. Please reopen if the rfe is deemed critical.