Bug 1250803
| Summary: | Perf: Metadata operation(ls -l) performance regression. | |||
|---|---|---|---|---|
| Product: | [Community] GlusterFS | Reporter: | Pranith Kumar K <pkarampu> | |
| Component: | replicate | Assignee: | Pranith Kumar K <pkarampu> | |
| Status: | CLOSED CURRENTRELEASE | QA Contact: | ||
| Severity: | high | Docs Contact: | ||
| Priority: | high | |||
| Version: | mainline | CC: | atalur, bengland, bturner, bugs, jharriga, mpillai, prasun.gera, rcyriac, rhs-bugs, riehecky, ryan.clough, sasundar, tiemen | |
| Target Milestone: | --- | |||
| Target Release: | --- | |||
| Hardware: | x86_64 | |||
| OS: | Linux | |||
| Whiteboard: | ||||
| Fixed In Version: | glusterfs-3.8rc2 | Doc Type: | Bug Fix | |
| Doc Text: | Story Points: | --- | ||
| Clone Of: | 1250241 | |||
| : | 1287531 1315144 (view as bug list) | Environment: | ||
| Last Closed: | 2016-06-16 13:28:57 UTC | Type: | Bug | |
| Regression: | --- | Mount Type: | --- | |
| Documentation: | --- | CRM: | ||
| Verified Versions: | Category: | --- | ||
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | ||
| Cloudforms Team: | --- | Target Upstream Version: | ||
| Embargoed: | ||||
| Bug Depends On: | 1250241 | |||
| Bug Blocks: | 1287531, 1315144 | |||
|
Comment 1
Anand Avati
2015-08-06 04:09:43 UTC
REVIEW: http://review.gluster.org/11846 (cluster/afr: make consistent metadata less restrictive) posted (#2) for review on master by Pranith Kumar Karampuri (pkarampu) Changing back to assigned as the patch was abandoned. REVIEW: http://review.gluster.org/12467 (glusterd / index : Readdir performance improvement) posted (#1) for review on master by Anuradha Talur (atalur) REVIEW: http://review.gluster.org/12468 (features / index : Readdirp performance improvement) posted (#6) for review on master by Anuradha Talur (atalur) REVIEW: http://review.gluster.org/12468 (features / index : Readdirp performance improvement) posted (#7) for review on master by Anuradha Talur (atalur) REVIEW: http://review.gluster.org/12467 (glusterd/afr : Readdirp performance improvement) posted (#6) for review on master by Pranith Kumar Karampuri (pkarampu) REVIEW: http://review.gluster.org/12595 (mgmt/gluster: Handle tier brick volgen) posted (#1) for review on master by Pranith Kumar Karampuri (pkarampu) REVIEW: http://review.gluster.org/12595 (mgmt/gluster: Handle tier brick volgen) posted (#2) for review on master by Pranith Kumar Karampuri (pkarampu) REVIEW: http://review.gluster.org/12467 (glusterd/afr : Readdirp performance improvement) posted (#7) for review on master by Pranith Kumar Karampuri (pkarampu) REVIEW: http://review.gluster.org/12595 (mgmt/gluster: Handle tier brick volgen) posted (#3) for review on master by Pranith Kumar Karampuri (pkarampu) REVIEW: http://review.gluster.org/12467 (glusterd/afr : Readdirp performance improvement) posted (#8) for review on master by Pranith Kumar Karampuri (pkarampu) REVIEW: http://review.gluster.org/12595 (mgmt/gluster: Handle tier brick volgen) posted (#4) for review on master by Pranith Kumar Karampuri (pkarampu) COMMIT: http://review.gluster.org/12467 committed in master by Pranith Kumar Karampuri (pkarampu) ------ commit cb76371a56eb90a6f2ac126c876d7a2dc203e16c Author: Anuradha Talur <atalur> Date: Wed Oct 21 16:49:49 2015 +0530 glusterd/afr : Readdirp performance improvement Add xlator options to index xlator with xattrs that it needs to keep track of. Change-Id: If818673be5e626f77e65cc3a340f8cdd624179c2 BUG: 1250803 Signed-off-by: Anuradha Talur <atalur> Reviewed-on: http://review.gluster.org/12467 Tested-by: Gluster Build System <jenkins.com> Reviewed-by: Krutika Dhananjay <kdhananj> Tested-by: NetBSD Build System <jenkins.org> Reviewed-by: Ravishankar N <ravishankar> Reviewed-by: Pranith Kumar Karampuri <pkarampu> COMMIT: http://review.gluster.org/12595 committed in master by Kaushal M (kaushal) ------ commit db506cec11cdb2235aac7b6a896b4071bdcc6ae3 Author: Pranith Kumar K <pkarampu> Date: Tue Nov 17 14:00:10 2015 +0530 mgmt/gluster: Handle tier brick volgen Index xlator watches only some xattrs based on type of volume. i.e. disperse/afr. When the volume becomes tiered then index is not adding these options in the volfile leading to no maintenance of indices. Thus no proactive self-heals. With this fix, we write brick volfiles considering the type of volume they belong to. BUG: 1250803 Change-Id: Ibe8f2d4ad5cb350306ab7ca0753e0f9a40b96a26 Signed-off-by: Pranith Kumar K <pkarampu> Reviewed-on: http://review.gluster.org/12595 Tested-by: NetBSD Build System <jenkins.org> Tested-by: Gluster Build System <jenkins.com> Reviewed-by: Kaushal M <kaushal> REVIEW: http://review.gluster.org/12468 (features / index : Readdirp performance improvement) posted (#8) for review on master by Anuradha Talur (atalur) REVIEW: http://review.gluster.org/12468 (features / index : Readdirp performance improvement) posted (#9) for review on master by Anuradha Talur (atalur) REVIEW: http://review.gluster.org/12468 (features/index : Readdirp performance improvement) posted (#10) for review on master by Anuradha Talur (atalur) REVIEW: http://review.gluster.org/12468 (features/index : Readdirp performance improvement) posted (#11) for review on master by Anuradha Talur (atalur) COMMIT: http://review.gluster.org/12468 committed in master by Pranith Kumar Karampuri (pkarampu) ------ commit 5172bcb757553e05b18208d7726517f1ec4da837 Author: Anuradha Talur <atalur> Date: Thu Nov 12 19:41:33 2015 +0530 features/index : Readdirp performance improvement Things done : Index now maintains two different directories : 1) for pending xattrs (trusted.afr.volname-client-n, trusted.ec.dirty) 2) for on going xattrs (trusted.afr.dirty) Based on the xattr, index decides the directory to add/del entry in/from. Change-Id: Ie04c02ea2d862cf80426a871a9a1e80b0773d9fd BUG: 1250803 Signed-off-by: Anuradha Talur <atalur> Reviewed-on: http://review.gluster.org/12468 Tested-by: NetBSD Build System <jenkins.org> Tested-by: Gluster Build System <jenkins.com> Reviewed-by: Pranith Kumar Karampuri <pkarampu> REVIEW: http://review.gluster.org/12507 (cluster/afr : Readdirp performance enhancement) posted (#4) for review on master by Anuradha Talur (atalur) COMMIT: http://review.gluster.org/12507 committed in master by Pranith Kumar Karampuri (pkarampu) ------ commit f2c52ae206f309ec636a299a76849c843c8ab83d Author: Anuradha Talur <atalur> Date: Thu Nov 12 19:45:10 2015 +0530 cluster/afr : Readdirp performance enhancement Things done : 1) during lookup and inode_refresh as part of read_txn, request is sent to detect if heal is required or not. 2) If heal is required, be conservative in setting the readdirp entry inodes to NULL, otherwise don't be. 3) Self-heal-daemon now crawls both indices/xattrop and indices/dirty directory while healing. Change-Id: Ic4a4da63fb7e0726eab5f341a200859b29cf7eb7 BUG: 1250803 Signed-off-by: Anuradha Talur <atalur> Reviewed-on: http://review.gluster.org/12507 Tested-by: Gluster Build System <jenkins.com> Tested-by: NetBSD Build System <jenkins.org> Reviewed-by: Pranith Kumar Karampuri <pkarampu> REVIEW: http://review.gluster.org/12658 (heal : Changed heal info to process all indices directories) posted (#5) for review on master by Anuradha Talur (atalur) REVIEW: http://review.gluster.org/12658 (heal : Changed heal info to process all indices directories) posted (#6) for review on master by Anuradha Talur (atalur) REVIEW: http://review.gluster.org/12658 (heal : Changed heal info to process all indices directories) posted (#7) for review on master by Vijay Bellur (vbellur) COMMIT: http://review.gluster.org/12658 committed in master by Vijay Bellur (vbellur) ------ commit 9c378026e9561595586a817fee0b439e2c863a22 Author: Anuradha Talur <atalur> Date: Mon Nov 23 15:56:28 2015 +0530 heal : Changed heal info to process all indices directories Change-Id: Ida863844e14309b6526c1b8434273fbf05c410d2 BUG: 1250803 Signed-off-by: Anuradha Talur <atalur> Reviewed-on: http://review.gluster.org/12658 Tested-by: NetBSD Build System <jenkins.org> Tested-by: Gluster Build System <jenkins.com> Reviewed-by: Vijay Bellur <vbellur> REVIEW: http://review.gluster.org/12910 (features/index : Prevent logging due to NULL dict) posted (#1) for review on master by Anuradha Talur (atalur) REVIEW: http://review.gluster.org/12910 (features/index : Prevent logging due to NULL dict) posted (#2) for review on master by Vijay Bellur (vbellur) REVIEW: http://review.gluster.org/12910 (features/index : Prevent logging due to NULL dict) posted (#3) for review on master by Vijay Bellur (vbellur) REVIEW: http://review.gluster.org/12919 (heal : Do not print heal count on ENOTCONN) posted (#1) for review on master by Anuradha Talur (atalur) REVIEW: http://review.gluster.org/12919 (heal : Do not print heal count on ENOTCONN) posted (#2) for review on master by Anuradha Talur (atalur) COMMIT: http://review.gluster.org/12910 committed in master by Pranith Kumar Karampuri (pkarampu) ------ commit ddf5957d3e4e09ed750f68447492796af61f08e4 Author: Anuradha Talur <atalur> Date: Tue Dec 8 17:02:23 2015 +0530 features/index : Prevent logging due to NULL dict Added a check for non-NULLness of dict before performing dict_foreach_match on it. Change-Id: I77d83559934006425ed33745b8a244b2f5d90cb1 BUG: 1250803 Signed-off-by: Anuradha Talur <atalur> Reviewed-on: http://review.gluster.org/12910 Tested-by: NetBSD Build System <jenkins.org> Tested-by: Gluster Build System <jenkins.com> Reviewed-by: Pranith Kumar Karampuri <pkarampu> REVIEW: http://review.gluster.org/12971 (features/index : Prevent logging due to NULL dict) posted (#1) for review on release-3.7 by Anuradha Talur (atalur) COMMIT: http://review.gluster.org/12919 committed in master by Pranith Kumar Karampuri (pkarampu) ------ commit a99bbccbb5e3087b9b8b687ee2be8887eeac0d08 Author: Anuradha Talur <atalur> Date: Wed Dec 9 14:50:41 2015 +0530 heal : Do not print heal count on ENOTCONN When a brick is not reachable due to ENOTCONN, there are no entries gathered and this information should not be printed. It is a bug intorduced due to commit 9c378026e9561595586a817fee0b439e2c863a22, fixing it. Change-Id: I45559a9560c297854ea6b4177f86e0be30dc6b78 BUG: 1250803 Signed-off-by: Anuradha Talur <atalur> Reviewed-on: http://review.gluster.org/12919 Tested-by: NetBSD Build System <jenkins.org> Tested-by: Gluster Build System <jenkins.com> Reviewed-by: Pranith Kumar Karampuri <pkarampu> This bug was accidentally moved from POST to MODIFIED via an error in automation, please see mmccune with any questions This bug is getting closed because a release has been made available that should address the reported issue. In case the problem is still not fixed with glusterfs-3.8.0, please open a new bug report. glusterfs-3.8.0 has been announced on the Gluster mailinglists [1], packages for several distributions should become available in the near future. Keep an eye on the Gluster Users mailinglist [2] and the update infrastructure for your distribution. [1] http://blog.gluster.org/2016/06/glusterfs-3-8-released/ [2] http://thread.gmane.org/gmane.comp.file-systems.gluster.user |