Bug 1272452
Summary: | Data Tiering:heat counters not getting reset and also internal ops seem to be heating the files | |||
---|---|---|---|---|
Product: | [Red Hat Storage] Red Hat Gluster Storage | Reporter: | Nag Pavan Chilakam <nchilaka> | |
Component: | tier | Assignee: | Joseph Elwin Fernandes <josferna> | |
Status: | CLOSED ERRATA | QA Contact: | Nag Pavan Chilakam <nchilaka> | |
Severity: | urgent | Docs Contact: | ||
Priority: | urgent | |||
Version: | rhgs-3.1 | CC: | asrivast, dlambrig, rhs-bugs, sankarshan, storage-qa-internal | |
Target Milestone: | --- | Keywords: | ZStream | |
Target Release: | RHGS 3.1.2 | |||
Hardware: | Unspecified | |||
OS: | Unspecified | |||
Whiteboard: | ||||
Fixed In Version: | glusterfs-3.7.5-6 | Doc Type: | Bug Fix | |
Doc Text: | Story Points: | --- | ||
Clone Of: | 1272450 | |||
: | 1275483 (view as bug list) | Environment: | ||
Last Closed: | 2016-03-01 05:42:14 UTC | Type: | Bug | |
Regression: | --- | Mount Type: | --- | |
Documentation: | --- | CRM: | ||
Verified Versions: | Category: | --- | ||
oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | ||
Cloudforms Team: | --- | Target Upstream Version: | ||
Embargoed: | ||||
Bug Depends On: | 1272450, 1276943 | |||
Bug Blocks: | 1260783, 1260923, 1275483, 1275524 |
Description
Nag Pavan Chilakam
2015-10-16 12:37:22 UTC
Patch 61017 fixed a bug in which the heat measure was not being cleared until 3 promotion cycles elapsed, which accounts for the failure at step 10. Tiering does a best effort to promote and demote files such that statistically / in aggregate, a large number of files will migrate to the hot or cold tier based on access frequency, over time. The feature does not guarantee individual files will be promoted or demoted based on single accesses. I have tried the above scenario with test mode, and don't see heating of files in db query. But there are other related issues where files are getting spilled over and we have bugs for those like 1290667 Hence closing this bug as verified root@yarrow ~]# date Fri Dec 18 23:24:42 IST 2015 [root@yarrow ~]# [root@yarrow ~]# [root@yarrow ~]# echo "===========Date=====================";date; echo "=============ColdBrick#1 =========" ; echo "select * from gf_file_tb; select * from gf_flink_tb;" | sqlite3 /rhs/brick1/pepsi/.glusterfs/pepsi.db;echo "=============ColdBrick#2 =========" ; echo "select * from gf_file_tb; select * from gf_flink_tb;" | sqlite3 /rhs/brick1/pepsi/.glusterfs/pepsi.db; echo ">>>>>>>>>>>> HOTBRICK#1 <<<<<<<<==";echo "select * from gf_file_tb; select * from gf_flink_tb;" | sqlite3 /dummy/brick108/pepsi_hot/.glusterfs/pepsi_hot.db;echo "###############################";date;ll /*/brick*/pepsi*;du -sh /var/run/gluster/pepsi-tier-dht/* ===========Date===================== Fri Dec 18 23:24:46 IST 2015 =============ColdBrick#1 ========= d84025cb-b0ec-482d-9baf-185b79504d07|0|0|0|0|0|0|0|0|1|1 d84025cb-b0ec-482d-9baf-185b79504d07|00000000-0000-0000-0000-000000000001|file3|/file3|0|0 =============ColdBrick#2 ========= d84025cb-b0ec-482d-9baf-185b79504d07|0|0|0|0|0|0|0|0|1|1 d84025cb-b0ec-482d-9baf-185b79504d07|00000000-0000-0000-0000-000000000001|file3|/file3|0|0 >>>>>>>>>>>> HOTBRICK#1 <<<<<<<<== 1111f560-71c3-45ee-a669-05de8d04338d|1450461121|38775|0|0|0|0|0|0|0|0 31c2dd29-ec1a-4ca6-b3b1-af5224109a77|1450461132|81252|0|0|0|0|0|0|0|0 ab1279eb-cc2b-4efe-8edb-fe537daa0de7|1450461143|385949|0|0|0|0|0|0|0|0 dec578c2-3e44-452b-8cea-b84bc2c523b2|1450461154|714885|0|0|0|0|0|0|0|0 1111f560-71c3-45ee-a669-05de8d04338d|00000000-0000-0000-0000-000000000001|file8|/file8|0|0 31c2dd29-ec1a-4ca6-b3b1-af5224109a77|00000000-0000-0000-0000-000000000001|file5|/file5|0|0 ab1279eb-cc2b-4efe-8edb-fe537daa0de7|00000000-0000-0000-0000-000000000001|file6|/file6|0|0 dec578c2-3e44-452b-8cea-b84bc2c523b2|00000000-0000-0000-0000-000000000001|file2|/file2|0|0 ############################### Fri Dec 18 23:24:46 IST 2015 /dummy/brick108/pepsi_hot: total 900032 ---------T. 2 root root 0 Dec 18 23:22 file1 ---------T. 2 root root 0 Dec 18 23:22 file2 -rw-r--r--. 2 root root 307200003 Dec 18 23:20 file5 -rw-r--r--. 2 root root 307200003 Dec 18 23:20 file6 -rw-r--r--. 2 root root 307200003 Dec 18 23:20 file8 /rhs/brick1/pepsi: total 4 -rw-r--r--. 2 root root 3 Dec 18 23:20 file3 /rhs/brick2/pepsi: total 300004 ---------T. 2 root root 0 Dec 18 23:22 file1 -rw-r--r--. 2 root root 307200003 Dec 18 23:20 file2 ---------T. 2 root root 0 Dec 18 23:22 file5 ---------T. 2 root root 0 Dec 18 23:22 file6 ---------T. 2 root root 0 Dec 18 23:22 file8 0 /var/run/gluster/pepsi-tier-dht/demotequeryfile-pepsi-tier-dht 0 /var/run/gluster/pepsi-tier-dht/promotequeryfile-pepsi-tier-dht [root@yarrow ~]# [root@yarrow ~]# [root@yarrow ~]# [root@yarrow ~]# [root@yarrow ~]# date Fri Dec 18 23:27:16 IST 2015 [root@yarrow ~]# echo "===========Date=====================";date; echo "=============ColdBrick#1 =========" ; echo "select * from gf_file_tb; select * from gf_flink_tb;" | sqlite3 /rhs/brick1/pepsi/.glusterfs/pepsi.db;echo "=============ColdBrick#2 =========" ; echo "select * from gf_file_tb; select * from gf_flink_tb;" | sqlite3 /rhs/brick1/pepsi/.glusterfs/pepsi.db; echo ">>>>>>>>>>>> HOTBRICK#1 <<<<<<<<==";echo "select * from gf_file_tb; select * from gf_flink_tb;" | sqlite3 /dummy/brick108/pepsi_hot/.glusterfs/pepsi_hot.db;echo "###############################";date;ll /*/brick*/pepsi*;du -sh /var/run/gluster/pepsi-tier-dht/* ===========Date===================== Fri Dec 18 23:27:17 IST 2015 =============ColdBrick#1 ========= d84025cb-b0ec-482d-9baf-185b79504d07|0|0|0|0|0|0|0|0|0|0 d84025cb-b0ec-482d-9baf-185b79504d07|00000000-0000-0000-0000-000000000001|file3|/file3|0|0 =============ColdBrick#2 ========= d84025cb-b0ec-482d-9baf-185b79504d07|0|0|0|0|0|0|0|0|0|0 d84025cb-b0ec-482d-9baf-185b79504d07|00000000-0000-0000-0000-000000000001|file3|/file3|0|0 >>>>>>>>>>>> HOTBRICK#1 <<<<<<<<== dec578c2-3e44-452b-8cea-b84bc2c523b2|1450461154|714885|0|0|0|0|0|0|0|0 dec578c2-3e44-452b-8cea-b84bc2c523b2|00000000-0000-0000-0000-000000000001|file2|/file2|0|0 ############################### Fri Dec 18 23:27:17 IST 2015 /dummy/brick108/pepsi_hot: total 4 ---------T. 2 root root 0 Dec 18 23:22 file2 /rhs/brick1/pepsi: total 4 -rw-r--r--. 2 root root 3 Dec 18 23:20 file3 /rhs/brick2/pepsi: total 1500020 -rw-r--r--. 2 root root 307200003 Dec 18 23:20 file1 -rw-r--r--. 2 root root 307200003 Dec 18 23:20 file2 -rw-r--r--. 2 root root 307200003 Dec 18 23:20 file5 -rw-r--r--. 2 root root 307200003 Dec 18 23:20 file6 -rw-r--r--. 2 root root 307200003 Dec 18 23:20 file8 4.0K /var/run/gluster/pepsi-tier-dht/demotequeryfile-pepsi-tier-dht 0 /var/run/gluster/pepsi-tier-dht/promotequeryfile-pepsi-tier-dht [root@yarrow ~]# [root@yarrow ~]# [root@yarrow ~]# echo "===========Date=====================";date; echo "=============ColdBrick#1 =========" ; echo "select * from gf_file_tb; select * from gf_flink_tb;" | sqlite3 /rhs/brick1/pepsi/.glusterfs/pepsi.db;echo "=============ColdBrick#2 =========" ; echo "select * from gf_file_tb; select * from gf_flink_tb;" | sqlite3 /rhs/brick1/pepsi/.glusterfs/pepsi.db; echo ">>>>>>>>>>>> HOTBRICK#1 <<<<<<<<==";echo "select * from gf_file_tb; select * from gf_flink_tb;" | sqlite3 /dummy/brick108/pepsi_hot/.glusterfs/pepsi_hot.db;echo "###############################";date;ll /*/brick*/pepsi*;du -sh /var/run/gluster/pepsi-tier-dht/* ===========Date===================== Fri Dec 18 23:27:57 IST 2015 =============ColdBrick#1 ========= =============ColdBrick#2 ========= >>>>>>>>>>>> HOTBRICK#1 <<<<<<<<== dec578c2-3e44-452b-8cea-b84bc2c523b2|1450461154|714885|0|0|0|0|0|0|0|0 dec578c2-3e44-452b-8cea-b84bc2c523b2|00000000-0000-0000-0000-000000000001|file2|/file2|0|0 ############################### Fri Dec 18 23:27:57 IST 2015 /dummy/brick108/pepsi_hot: total 4 ---------T. 2 root root 0 Dec 18 23:22 file2 /rhs/brick1/pepsi: total 0 /rhs/brick2/pepsi: total 1500020 -rw-r--r--. 2 root root 307200003 Dec 18 23:20 file1 -rw-r--r--. 2 root root 307200003 Dec 18 23:20 file2 -rw-r--r--. 2 root root 307200003 Dec 18 23:20 file5 -rw-r--r--. 2 root root 307200003 Dec 18 23:20 file6 -rw-r--r--. 2 root root 307200003 Dec 18 23:20 file8 4.0K /var/run/gluster/pepsi-tier-dht/demotequeryfile-pepsi-tier-dht 0 /var/run/gluster/pepsi-tier-dht/promotequeryfile-pepsi-tier-dht [root@yarrow ~]# [root@zod ~]# rpm -qa|grep gluster glusterfs-fuse-3.7.5-12.el7rhgs.x86_64 glusterfs-server-3.7.5-12.el7rhgs.x86_64 glusterfs-client-xlators-3.7.5-12.el7rhgs.x86_64 glusterfs-cli-3.7.5-12.el7rhgs.x86_64 glusterfs-libs-3.7.5-12.el7rhgs.x86_64 glusterfs-api-3.7.5-12.el7rhgs.x86_64 glusterfs-debuginfo-3.7.5-12.el7rhgs.x86_64 glusterfs-3.7.5-12.el7rhgs.x86_64 [root@zod ~]# Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory, and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://rhn.redhat.com/errata/RHBA-2016-0193.html |