Fedora Account System
Red Hat Associate
Red Hat Customer
Description of problem: ======================= Observed that the nodes which do not participate in the hot tier bricks do not have "demotequeryfile-master-tier-dht" under ls /var/run/gluster/<volname>-tier-dht/ . This looks expected as these bricks wont log any entries in this binary for demotion. But the tier log on these nodes constantly report below ERROR: [2015-12-06 23:32:00.906688] E [MSGID: 109051] [tier.c:1069:tier_migrate_files_using_qfile] 0-tier: Failed to open /var/run/gluster/master-tier-dht/demotequeryfile-master-tier-dht for migration [No such file or directory] [2015-12-06 23:32:00.906994] E [MSGID: 109037] [tier.c:1469:tier_start] 0-master-tier-dht: Demotion failed [2015-12-06 23:34:00.992814] E [MSGID: 109051] [tier.c:1069:tier_migrate_files_using_qfile] 0-tier: Failed to open /var/run/gluster/master-tier-dht/demotequeryfile-master-tier-dht for migration [No such file or directory] [2015-12-06 23:34:00.993072] E [MSGID: 109037] [tier.c:1469:tier_start] 0-master-tier-dht: Demotion failed [root@dhcp37-165 glusterfs]# ls /var/run/gluster/master-tier-dht/ promotequeryfile-master-tier-dht [root@dhcp37-165 glusterfs]# pwd /var/log/glusterfs [root@dhcp37-165 glusterfs]# This doesn't look to be genuine error and it should be handled gracefully. Version-Release number of selected component (if applicable): ============================================================= glusterfs-3.7.5-9.el7rhgs.x86_64 How reproducible: ================= 1/1 Steps to Reproduce: =================== 1. Create a cluster of 6 nodes 2. Create and start a tier volume in which cold tier uses bricks of all 6 nodes and hot tier uses bricks of only 4 nodes 3. Set the tier mode to test 4. Mount the volume and start creating data
https://code.engineering.redhat.com/gerrit/#/c/63393/
Verified with build: glusterfs-3.7.5-11.el7rhgs.x86_64 [root@dhcp37-165 master-tier-dht]# gluster volume rebalance master tier status Node Promoted files Demoted files Status --------- --------- --------- --------- localhost 0 0 in progress 10.70.37.133 0 0 in progress 10.70.37.160 0 0 in progress 10.70.37.158 0 372 in progress 10.70.37.110 0 0 in progress 10.70.37.155 0 391 in progress Tiering Migration Functionality: master: success [root@dhcp37-165 master-tier-dht]# ls promotequeryfile-master-tier-dht [root@dhcp37-165 master-tier-dht]# [root@dhcp37-165 glusterfs]# grep -i " E " master-tier.log [root@dhcp37-165 glusterfs]# [root@dhcp37-165 glusterfs]# grep -i " E " master-* [root@dhcp37-165 glusterfs]# grep -i "tier_migrate_files_using_qfile" master-* [root@dhcp37-165 glusterfs]# grep -i "demotequeryfile" master-* master-tier.log:[2015-12-15 21:40:36.615806] I [MSGID: 109038] [tier.c:1872:tier_init] 0-master-tier-dht: Promote file /var/run/gluster/master-tier-dht/promotequeryfile-master-tier-dht demote file /var/run/gluster/master-tier-dht/demotequeryfile-master-tier-dht [root@dhcp37-165 glusterfs]# No error reported, moving the bug to verified state.
Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory, and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://rhn.redhat.com/errata/RHBA-2016-0193.html