Bug 1296048
Summary: | Attach tier + nfs : Creates fail with invalid argument errors | |||
---|---|---|---|---|
Product: | [Red Hat Storage] Red Hat Gluster Storage | Reporter: | Bhaskarakiran <byarlaga> | |
Component: | tier | Assignee: | Bug Updates Notification Mailing List <rhs-bugs> | |
Status: | CLOSED ERRATA | QA Contact: | Bhaskarakiran <byarlaga> | |
Severity: | unspecified | Docs Contact: | ||
Priority: | unspecified | |||
Version: | rhgs-3.1 | CC: | asrivast, dlambrig, jthottan, mzywusko, nchilaka, ndevos, rcyriac, rhs-bugs, rjoseph, rkavunga, sankarshan, skoduri, smohan, storage-qa-internal | |
Target Milestone: | --- | Keywords: | ZStream | |
Target Release: | RHGS 3.1.2 | |||
Hardware: | Unspecified | |||
OS: | Unspecified | |||
Whiteboard: | ||||
Fixed In Version: | glusterfs-3.7.5-16 | Doc Type: | Bug Fix | |
Doc Text: | Story Points: | --- | ||
Clone Of: | ||||
: | 1297311 (view as bug list) | Environment: | ||
Last Closed: | 2016-03-01 06:06:47 UTC | Type: | Bug | |
Regression: | --- | Mount Type: | --- | |
Documentation: | --- | CRM: | ||
Verified Versions: | Category: | --- | ||
oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | ||
Cloudforms Team: | --- | Target Upstream Version: | ||
Embargoed: | ||||
Bug Depends On: | ||||
Bug Blocks: | 1297311, 1306131 |
Description
Bhaskarakiran
2016-01-06 09:51:29 UTC
RCA: After add-brick, NFS server will be restarted to load new graph. ie NFS server inode table will be fresh after restarting the process. So as part of the fop, resolver will send a lookup on an entry if inode is not lookedup before. During the lookup if healing requires for the entry from DHT (when directories are not present on all of the subvol), we will initiate a healing to create the directories on all of the subvolume. As part of the healing, we are doing a series of named lookup on all the parents starting from root if the inodes are not present, so for a successful lookup we will link the inode to inode table also. This lookup will be initiated from dht, so inode ctx will be created only for the xlators which are beneath of dht. Since we already linked the inode, ie resolver will not do a lookup for next fop. So xlator which are above dht will not have inode ctx. Here in this case, svc_access was complaining about missing inode_ctx. Possible solutions: 1) Move dht healing code to interface layer, if healing is required then dht should let the interface layer about healing, and need to give a path to heal. So that each interface layer should do a healing which include fuse, nfs, gfapi. 2) Do not link the inode from any of the xlators other than master xlators, ie do not link from dht. This will cause a huge performance degradation in healing code path, and we might need to do some hack to heal without a linked inode. 3) During resolving of an entry, currently resolving will be successful if there is an inode in the inode table. Make an extra check to see if the inode_ctx is present or not, if inode_ctx is not present for a linked inode, then resolver should consider as an invalid inode and need to do a lookup with the same inode. one more patch required to fix this problem completely. upstream patches http://review.gluster.org/#/c/11892/ http://review.gluster.org/#/c/13224/ http://review.gluster.org/#/c/13225/ http://review.gluster.org/#/c/13226/ http://review.gluster.org/#/c/13227/ Verified this on 3.7.5-17 and didn't hit the issue. Marking this as verified. However there will a pause of the IOs for sometime(may be about 4-5min) while running IOs with attach tier on NFS Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory, and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://rhn.redhat.com/errata/RHBA-2016-0193.html |