Bug 1177601
Summary: | [FEAT[ Implement proactive self-heal daemon feature for disperse subvolumes | ||
---|---|---|---|
Product: | [Community] GlusterFS | Reporter: | Pranith Kumar K <pkarampu> |
Component: | disperse | Assignee: | Pranith Kumar K <pkarampu> |
Status: | CLOSED CURRENTRELEASE | QA Contact: | |
Severity: | unspecified | Docs Contact: | |
Priority: | unspecified | ||
Version: | mainline | CC: | bugs, fanghuang.data, gluster-bugs, lidi |
Target Milestone: | --- | Keywords: | FutureFeature |
Target Release: | --- | ||
Hardware: | Unspecified | ||
OS: | Unspecified | ||
Whiteboard: | |||
Fixed In Version: | glusterfs-3.7.0 | Doc Type: | Enhancement |
Doc Text: | Story Points: | --- | |
Clone Of: | Environment: | ||
Last Closed: | 2015-05-14 17:28:47 UTC | Type: | Bug |
Regression: | --- | Mount Type: | --- |
Documentation: | --- | CRM: | |
Verified Versions: | Category: | --- | |
oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |
Cloudforms Team: | --- | Target Upstream Version: | |
Embargoed: |
Description
Pranith Kumar K
2014-12-29 10:40:21 UTC
REVIEW: http://review.gluster.org/9358 (mgmt/glusterd: Add disperse volumes to self-heal-daemon) posted (#1) for review on master by Pranith Kumar Karampuri (pkarampu) REVIEW: http://review.gluster.org/9358 (mgmt/glusterd: Implement Volume heal enable/disable) posted (#2) for review on master by Pranith Kumar Karampuri (pkarampu) REVIEW: http://review.gluster.org/9358 (mgmt/glusterd: Implement Volume heal enable/disable) posted (#3) for review on master by Pranith Kumar Karampuri (pkarampu) REVIEW: http://review.gluster.org/9358 (mgmt/glusterd: Implement Volume heal enable/disable) posted (#4) for review on master by Pranith Kumar Karampuri (pkarampu) REVIEW: http://review.gluster.org/9388 (cli: Add print-defaultworkdir option) posted (#1) for review on master by Pranith Kumar Karampuri (pkarampu) REVIEW: http://review.gluster.org/9358 (mgmt/glusterd: Implement Volume heal enable/disable) posted (#5) for review on master by Pranith Kumar Karampuri (pkarampu) REVIEW: http://review.gluster.org/9358 (mgmt/glusterd: Implement Volume heal enable/disable) posted (#6) for review on master by Pranith Kumar Karampuri (pkarampu) REVIEW: http://review.gluster.org/9358 (mgmt/glusterd: Implement Volume heal enable/disable) posted (#7) for review on master by Pranith Kumar Karampuri (pkarampu) REVIEW: http://review.gluster.org/9358 (mgmt/glusterd: Implement Volume heal enable/disable) posted (#8) for review on master by Pranith Kumar Karampuri (pkarampu) REVIEW: http://review.gluster.org/9358 (mgmt/glusterd: Implement Volume heal enable/disable) posted (#9) for review on master by Pranith Kumar Karampuri (pkarampu) REVIEW: http://review.gluster.org/9358 (mgmt/glusterd: Implement Volume heal enable/disable) posted (#10) for review on master by Pranith Kumar Karampuri (pkarampu) REVIEW: http://review.gluster.org/9358 (mgmt/glusterd: Implement Volume heal enable/disable) posted (#11) for review on master by Pranith Kumar Karampuri (pkarampu) COMMIT: http://review.gluster.org/9358 committed in master by Krishnan Parthasarathi (kparthas) ------ commit 7510d8edf4e7bea50e0c1f041202f063a5d138af Author: Pranith Kumar K <pkarampu> Date: Mon Dec 29 15:32:28 2014 +0530 mgmt/glusterd: Implement Volume heal enable/disable For volumes with replicate, disperse xlators, self-heal daemon should do healing. This patch provides enable/disable functionality for the xlators to be part of self-heal-daemon. Replicate already had this functionality with 'gluster volume set cluster.self-heal-daemon on/off'. But this patch makes it uniform for both types of volumes. Internally it still does 'volume set' based on the volume type. Change-Id: Ie0f3799b74c2afef9ac658ef3d50dce3e8072b29 BUG: 1177601 Signed-off-by: Pranith Kumar K <pkarampu> Reviewed-on: http://review.gluster.org/9358 Reviewed-by: Krishnan Parthasarathi <kparthas> Tested-by: Gluster Build System <jenkins.com> Reviewed-by: Xavier Hernandez <xhernandez> Tested-by: Krishnan Parthasarathi <kparthas> REVIEW: http://review.gluster.org/9485 (syncop: Provide syncop_ftw and syncop_dir_scan utils) posted (#1) for review on master by Pranith Kumar Karampuri (pkarampu) REVIEW: http://review.gluster.org/9485 (syncop: Provide syncop_ftw and syncop_dir_scan utils) posted (#2) for review on master by Pranith Kumar Karampuri (pkarampu) REVIEW: http://review.gluster.org/9485 (syncop: Provide syncop_ftw and syncop_dir_scan utils) posted (#3) for review on master by Pranith Kumar Karampuri (pkarampu) REVIEW: http://review.gluster.org/9485 (syncop: Provide syncop_ftw and syncop_dir_scan utils) posted (#4) for review on master by Pranith Kumar Karampuri (pkarampu) REVIEW: http://review.gluster.org/9485 (syncop: Provide syncop_ftw and syncop_dir_scan utils) posted (#5) for review on master by Pranith Kumar Karampuri (pkarampu) REVIEW: http://review.gluster.org/9485 (syncop: Provide syncop_ftw and syncop_dir_scan utils) posted (#6) for review on master by Pranith Kumar Karampuri (pkarampu) REVIEW: http://review.gluster.org/9485 (syncop: Provide syncop_ftw and syncop_dir_scan utils) posted (#7) for review on master by Pranith Kumar Karampuri (pkarampu) REVIEW: http://review.gluster.org/9598 (cluster/afr: Re-introduce heal-timeout option) posted (#1) for review on master by Pranith Kumar Karampuri (pkarampu) COMMIT: http://review.gluster.org/9485 committed in master by Vijay Bellur (vbellur) ------ commit 2efb36047aa11838b2cde93a3e95741e7ba40bae Author: Pranith Kumar K <pkarampu> Date: Thu Feb 5 21:23:37 2015 +0530 syncop: Provide syncop_ftw and syncop_dir_scan utils ftw provides file tree walk. dir_scan does just a readdir not readdirp. Also changed Afr's self-heal-daemon's crawling functions to use this. These utils will be used by ec in future to do proactive/full healing. Change-Id: I05715ddb789592c1b79a71e98f1e8cc29aac5c26 BUG: 1177601 Signed-off-by: Pranith Kumar K <pkarampu> Reviewed-on: http://review.gluster.org/9485 Tested-by: Gluster Build System <jenkins.com> Reviewed-by: Ravishankar N <ravishankar> Reviewed-by: Krutika Dhananjay <kdhananj> Reviewed-by: Vijay Bellur <vbellur> COMMIT: http://review.gluster.org/9598 committed in master by Vijay Bellur (vbellur) ------ commit 5e25569ed0717aa8636ad708430a823d39f9aa60 Author: Pranith Kumar K <pkarampu> Date: Thu Feb 5 21:26:04 2015 +0530 cluster/afr: Re-introduce heal-timeout option Change-Id: I87484c810006a92ed7489284b6d74e9b0aecae80 BUG: 1177601 Signed-off-by: Pranith Kumar K <pkarampu> Reviewed-on: http://review.gluster.org/9598 Tested-by: Gluster Build System <jenkins.com> Reviewed-by: Ravishankar N <ravishankar> Reviewed-by: Krutika Dhananjay <kdhananj> Reviewed-by: Vijay Bellur <vbellur> REVIEW: http://review.gluster.org/9616 (cli: Provide CLI to create disperse volume with data, redundancy counts) posted (#1) for review on master by Pranith Kumar Karampuri (pkarampu) REVIEW: http://review.gluster.org/9717 (cluster/ec: Allow heal on name less loc) posted (#1) for review on master by Pranith Kumar Karampuri (pkarampu) REVIEW: http://review.gluster.org/9718 (cluster/ec: Implement 'gluster volume heal <volname> full') posted (#1) for review on master by Pranith Kumar Karampuri (pkarampu) REVIEW: http://review.gluster.org/9718 (cluster/ec: Implement 'gluster volume heal <volname> full') posted (#2) for review on master by Pranith Kumar Karampuri (pkarampu) REVIEW: http://review.gluster.org/9602 (features/index: Add option to track specific xattrs for xattrop64) posted (#2) for review on master by Pranith Kumar Karampuri (pkarampu) REVIEW: http://review.gluster.org/9602 (features/index: Add option to track specific xattrs for xattrop64) posted (#3) for review on master by Pranith Kumar Karampuri (pkarampu) REVIEW: http://review.gluster.org/9616 (cli: Provide CLI to create disperse volume with data, redundancy counts) posted (#2) for review on master by Pranith Kumar Karampuri (pkarampu) COMMIT: http://review.gluster.org/9616 committed in master by Krishnan Parthasarathi (kparthas) ------ commit a671b9a575b89c263af161293e78e49484859ec7 Author: Pranith Kumar K <pkarampu> Date: Mon Feb 9 14:20:28 2015 +0530 cli: Provide CLI to create disperse volume with data, redundancy counts Change-Id: Iba44be565c895e26b19b5ff85a886873f6b53e5c BUG: 1177601 Signed-off-by: Pranith Kumar K <pkarampu> Reviewed-on: http://review.gluster.org/9616 Tested-by: Gluster Build System <jenkins.com> Reviewed-by: Krishnan Parthasarathi <kparthas> Tested-by: Krishnan Parthasarathi <kparthas> REVIEW: http://review.gluster.org/9602 (features/index: Add option to track specific xattrs for xattrop64) posted (#4) for review on master by Pranith Kumar Karampuri (pkarampu) REVIEW: http://review.gluster.org/9602 (features/index: Add option to track specific xattrs for xattrop64) posted (#5) for review on master by Pranith Kumar Karampuri (pkarampu) COMMIT: http://review.gluster.org/9602 committed in master by Pranith Kumar Karampuri (pkarampu) ------ commit 5d59402af8397da1a8eb5f822e1e650ce3285833 Author: Pranith Kumar K <pkarampu> Date: Fri Feb 6 17:06:28 2015 +0530 features/index: Add option to track specific xattrs for xattrop64 This enables trusted.ec.dirty to be tracked in index Change-Id: Ief1619110859f6f9ccee3da229f0688b73e2124b BUG: 1177601 Signed-off-by: Pranith Kumar K <pkarampu> Reviewed-on: http://review.gluster.org/9602 Reviewed-by: Krutika Dhananjay <kdhananj> Tested-by: Gluster Build System <jenkins.com> REVIEW: http://review.gluster.org/9740 (libglusterfs: Moved common functions as utils in syncop/common-utils) posted (#1) for review on master by Pranith Kumar Karampuri (pkarampu) REVIEW: http://review.gluster.org/9740 (libglusterfs: Moved common functions as utils in syncop/common-utils) posted (#2) for review on master by Pranith Kumar Karampuri (pkarampu) REVIEW: http://review.gluster.org/9740 (libglusterfs: Moved common functions as utils in syncop/common-utils) posted (#3) for review on master by Pranith Kumar Karampuri (pkarampu) REVIEW: http://review.gluster.org/9740 (libglusterfs: Moved common functions as utils in syncop/common-utils) posted (#4) for review on master by Pranith Kumar Karampuri (pkarampu) REVIEW: http://review.gluster.org/9740 (libglusterfs: Moved common functions as utils in syncop/common-utils) posted (#5) for review on master by Pranith Kumar Karampuri (pkarampu) REVIEW: http://review.gluster.org/9740 (libglusterfs: Moved common functions as utils in syncop/common-utils) posted (#6) for review on master by Pranith Kumar Karampuri (pkarampu) REVIEW: http://review.gluster.org/9740 (libglusterfs: Moved common functions as utils in syncop/common-utils) posted (#7) for review on master by Pranith Kumar Karampuri (pkarampu) REVIEW: http://review.gluster.org/9717 (cluster/ec: Allow heal on name less loc) posted (#2) for review on master by Pranith Kumar Karampuri (pkarampu) COMMIT: http://review.gluster.org/9740 committed in master by Vijay Bellur (vbellur) ------ commit d5624b2d4baf509ad8d6037a0d9cabf9cd5ab1c5 Author: Pranith Kumar K <pkarampu> Date: Wed Feb 25 11:37:57 2015 +0530 libglusterfs: Moved common functions as utils in syncop/common-utils These will be used by both afr and ec. Moved syncop_dirfd, syncop_ftw, syncop_dir_scan functions also into syncop-utils.c Change-Id: I467253c74a346e1e292d36a8c1a035775c3aa670 BUG: 1177601 Signed-off-by: Pranith Kumar K <pkarampu> Reviewed-on: http://review.gluster.org/9740 Reviewed-by: Krutika Dhananjay <kdhananj> Reviewed-by: Anuradha Talur <atalur> Reviewed-by: Ravishankar N <ravishankar> Tested-by: Gluster Build System <jenkins.com> Reviewed-by: Vijay Bellur <vbellur> REVIEW: http://review.gluster.org/9717 (cluster/ec: Allow heal on name less loc) posted (#3) for review on master by Pranith Kumar Karampuri (pkarampu) REVIEW: http://review.gluster.org/9717 (cluster/ec: Allow heal on name less loc) posted (#4) for review on master by Pranith Kumar Karampuri (pkarampu) REVIEW: http://review.gluster.org/9787 (cluster/ec: Add self-heal-daemon command handlers) posted (#1) for review on master by Pranith Kumar Karampuri (pkarampu) REVIEW: http://review.gluster.org/9787 (cluster/ec: Add self-heal-daemon command handlers) posted (#2) for review on master by Pranith Kumar Karampuri (pkarampu) REVIEW: http://review.gluster.org/9787 (cluster/ec: Add self-heal-daemon command handlers) posted (#3) for review on master by Pranith Kumar Karampuri (pkarampu) REVIEW: http://review.gluster.org/9787 (cluster/ec: Add self-heal-daemon command handlers) posted (#4) for review on master by Pranith Kumar Karampuri (pkarampu) REVIEW: http://review.gluster.org/9787 (cluster/ec: Add self-heal-daemon command handlers) posted (#5) for review on master by Pranith Kumar Karampuri (pkarampu) REVIEW: http://review.gluster.org/9793 (mgmt/glusterd: Changes required for disperse volume heal commands) posted (#1) for review on master by Pranith Kumar Karampuri (pkarampu) REVIEW: http://review.gluster.org/9717 (cluster/ec: Allow heal on name less loc) posted (#5) for review on master by Pranith Kumar Karampuri (pkarampu) REVIEW: http://review.gluster.org/9787 (cluster/ec: Add self-heal-daemon command handlers) posted (#6) for review on master by Pranith Kumar Karampuri (pkarampu) REVIEW: http://review.gluster.org/9793 (mgmt/glusterd: Changes required for disperse volume heal commands) posted (#2) for review on master by Pranith Kumar Karampuri (pkarampu) COMMIT: http://review.gluster.org/9717 committed in master by Vijay Bellur (vbellur) ------ commit 8fa36bc7a11968086e31ac32b9a24de07dd50d15 Author: Pranith Kumar K <pkarampu> Date: Mon Mar 2 08:09:41 2015 +0530 cluster/ec: Allow heal on name less loc loc->parent may not always be populated. Even in those cases, self-heal should happen if it can be completed using nameless loc. Change-Id: I8871fc811bec8b881ae7fb09dcd202c6693b9877 BUG: 1177601 Signed-off-by: Pranith Kumar K <pkarampu> Reviewed-on: http://review.gluster.org/9717 Reviewed-by: Xavier Hernandez <xhernandez> Tested-by: Gluster Build System <jenkins.com> REVIEW: http://review.gluster.org/9787 (cluster/ec: Add self-heal-daemon command handlers) posted (#7) for review on master by Pranith Kumar Karampuri (pkarampu) REVIEW: http://review.gluster.org/9793 (mgmt/glusterd: Changes required for disperse volume heal commands) posted (#3) for review on master by Pranith Kumar Karampuri (pkarampu) COMMIT: http://review.gluster.org/9787 committed in master by Vijay Bellur (vbellur) ------ commit a70231c78aaea436575d427a1386a64d1471b776 Author: Pranith Kumar K <pkarampu> Date: Fri Feb 27 16:01:31 2015 +0530 cluster/ec: Add self-heal-daemon command handlers This patch introduces the changes required in ec xlator to handle index/full heal. Index healer threads: Ec xlator start an index healer thread per local brick. This thread keeps waking up every minute to check if there are any files to be healed based on the indices kept in index directory. Whenever child_up event comes, then also this index healer thread wakes up and crawls the indices and triggers heal. When self-heal-daemon is disabled on this particular volume then the healer thread keeps waiting until it is enabled again to perform heals. Full healer threads: Ec xlator starts a full healer thread for the local subvolume provided by glusterd to perform full crawl on the directory hierarchy to perform heals. Once the crawl completes the thread exits if no more full heals are issued. Changed xl-op prefix GF_AFR_OP to GF_SHD_OP to make it more generic. Change-Id: Idf9b2735d779a6253717be064173dfde6f8f824b BUG: 1177601 Signed-off-by: Pranith Kumar K <pkarampu> Reviewed-on: http://review.gluster.org/9787 Tested-by: Gluster Build System <jenkins.com> Reviewed-by: Ravishankar N <ravishankar> Reviewed-by: Vijay Bellur <vbellur> COMMIT: http://review.gluster.org/9793 committed in master by Kaushal M (kaushal) ------ commit 8cdd272dcf277aa4148c57458cc5477a49b08383 Author: Pranith Kumar K <pkarampu> Date: Fri Feb 27 16:04:29 2015 +0530 mgmt/glusterd: Changes required for disperse volume heal commands - Include xattrop64-watchlist for index xlator for disperse volumes. - Change the functions that exist to consider disperse volumes also for sending commands to disperse xls in self-heal-daemon. Change-Id: Iae75a5d3dd5642454a2ebf5840feba35780d8adb BUG: 1177601 Signed-off-by: Pranith Kumar K <pkarampu> Reviewed-on: http://review.gluster.org/9793 Tested-by: Gluster Build System <jenkins.com> Reviewed-by: Kaushal M <kaushal> This bug is getting closed because a release has been made available that should address the reported issue. In case the problem is still not fixed with glusterfs-3.7.0, please open a new bug report. glusterfs-3.7.0 has been announced on the Gluster mailinglists [1], packages for several distributions should become available in the near future. Keep an eye on the Gluster Users mailinglist [2] and the update infrastructure for your distribution. [1] http://thread.gmane.org/gmane.comp.file-systems.gluster.devel/10939 [2] http://thread.gmane.org/gmane.comp.file-systems.gluster.user This bug is getting closed because a release has been made available that should address the reported issue. In case the problem is still not fixed with glusterfs-3.7.0, please open a new bug report. glusterfs-3.7.0 has been announced on the Gluster mailinglists [1], packages for several distributions should become available in the near future. Keep an eye on the Gluster Users mailinglist [2] and the update infrastructure for your distribution. [1] http://thread.gmane.org/gmane.comp.file-systems.gluster.devel/10939 [2] http://thread.gmane.org/gmane.comp.file-systems.gluster.user This bug is getting closed because a release has been made available that should address the reported issue. In case the problem is still not fixed with glusterfs-3.7.0, please open a new bug report. glusterfs-3.7.0 has been announced on the Gluster mailinglists [1], packages for several distributions should become available in the near future. Keep an eye on the Gluster Users mailinglist [2] and the update infrastructure for your distribution. [1] http://thread.gmane.org/gmane.comp.file-systems.gluster.devel/10939 [2] http://thread.gmane.org/gmane.comp.file-systems.gluster.user This bug is getting closed because a release has been made available that should address the reported issue. In case the problem is still not fixed with glusterfs-3.7.0, please open a new bug report. glusterfs-3.7.0 has been announced on the Gluster mailinglists [1], packages for several distributions should become available in the near future. Keep an eye on the Gluster Users mailinglist [2] and the update infrastructure for your distribution. [1] http://thread.gmane.org/gmane.comp.file-systems.gluster.devel/10939 [2] http://thread.gmane.org/gmane.comp.file-systems.gluster.user |