Bug 1199057

Summary: dht linkfile not having link subvol for
Product: [Red Hat Storage] Red Hat Gluster Storage Reporter: Krzysztof Pawłowski <krzysztof.pawlowski>
Component: distributeAssignee: Bug Updates Notification Mailing List <rhs-bugs>
Status: CLOSED CURRENTRELEASE QA Contact: storage-qa-internal <storage-qa-internal>
Severity: high Docs Contact:
Priority: unspecified    
Version: rhgs-3.0CC: nbalacha, vagarwal
Target Milestone: ---   
Target Release: ---   
Hardware: x86_64   
OS: Linux   
Whiteboard:
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2015-03-11 09:09:31 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On: 1146906    
Bug Blocks:    

Description Krzysztof Pawłowski 2015-03-05 12:13:55 UTC 
Description of problem:

During remove brick error occure on specific file. After deleting and recreating file things come back to normal.

[2015-03-05 10:51:47.542346] I [dht-common.c:1892:dht_lookup_cbk] 0-nemo-dht: linkfile not having link subvol for /dzialhandlowy/tefal/filmy tefal/3/TE-STEAM_GENERATORS-PRO_EXPRESS_TOTAL_AUTOCONTROL-GV8960-PRODUCT_VIDEOS-COMPLEMENTARY-STEAM_CORD_STORAGE-EN-30.mp4
pending frames:
frame : type(0) op(0)
frame : type(0) op(0)
frame : type(0) op(0)
patchset: git://git.gluster.com/glusterfs.git
signal received: 11
time of crash:
2015-03-05 10:51:47
configuration details:
argp 1
backtrace 1
dlfcn 1
libpthread 1
llistxattr 1
setfsid 1
spinlock 1
epoll.h 1
xattr.h 1
st_atim.tv_nsec 1
package-string: glusterfs 3.6.0.29
/usr/lib64/libglusterfs.so.0(_gf_msg_backtrace_nomem+0xb6)[0x339381ff06]
/usr/lib64/libglusterfs.so.0(gf_print_trace+0x33f)[0x339383a59f]
/lib64/libc.so.6[0x34512326a0]
/usr/lib64/glusterfs/3.6.0.29/xlator/cluster/distribute.so(dht_lookup_everywhere_done+0x6e3)[0x7f78ea75ac03]
/usr/lib64/glusterfs/3.6.0.29/xlator/cluster/distribute.so(dht_lookup_everywhere_cbk+0x403)[0x7f78ea75f5c3]
/usr/lib64/glusterfs/3.6.0.29/xlator/cluster/replicate.so(afr_lookup_cbk+0x558)[0x7f78ea9e2b18]
/usr/lib64/glusterfs/3.6.0.29/xlator/protocol/client.so(client3_3_lookup_cbk+0x647)[0x7f78f0270267]
/usr/lib64/libgfrpc.so.0(rpc_clnt_handle_reply+0xa5)[0x3393c0e9c5]
/usr/lib64/libgfrpc.so.0(rpc_clnt_notify+0x13f)[0x3393c0fe4f]
/usr/lib64/libgfrpc.so.0(rpc_transport_notify+0x28)[0x3393c0b668]
/usr/lib64/glusterfs/3.6.0.29/rpc-transport/socket.so(+0x9275)[0x7f78f06ae275]
/usr/lib64/glusterfs/3.6.0.29/rpc-transport/socket.so(+0xac5d)[0x7f78f06afc5d]
/usr/lib64/libglusterfs.so.0[0x3393876367]
/usr/sbin/glusterfs(main+0x603)[0x407e93]
/lib64/libc.so.6(__libc_start_main+0xfd)[0x345121ed5d]
/usr/sbin/glusterfs[0x4049a9]
---------


Version-Release number of selected component (if applicable):
3.6.0.29-2.el6.x86_64

How reproducible:
gluster volume remove-brick

Additional info:

brick21.gluster.iadm:
    getfattr: Removing leading '/' from absolute path names
    # file: GLUSTERFS/nemo/dzialhandlowy/tefal/filmy tefal/3/TE-STEAM_GENERATORS-PRO_EXPRESS_TOTAL_AUTOCONTROL-GV8960-PRODUCT_VIDEOS-COMPLEMENTARY-STEAM_CORD_STORAGE-EN-30.mp4
    trusted.gfid=0sv/LGDU3JRhyH1PgJmyMvBA==
    trusted.glusterfs.dht.linkto="nemo-replicate-4"
brick19.gluster.iadm:
    getfattr: Removing leading '/' from absolute path names
    # file: GLUSTERFS/nemo/dzialhandlowy/tefal/filmy tefal/3/TE-STEAM_GENERATORS-PRO_EXPRESS_TOTAL_AUTOCONTROL-GV8960-PRODUCT_VIDEOS-COMPLEMENTARY-STEAM_CORD_STORAGE-EN-30.mp4
    trusted.gfid=0sv/LGDU3JRhyH1PgJmyMvBA==
    trusted.glusterfs.dht.linkto="nemo-replicate-4"
brick16.gluster.iadm:
    getfattr: /GLUSTERFS/nemo/dzialhandlowy/tefal/filmy tefal/3/TE-STEAM_GENERATORS-PRO_EXPRESS_TOTAL_AUTOCONTROL-GV8960-PRODUCT_VIDEOS-COMPLEMENTARY-STEAM_CORD_STORAGE-EN-30.mp4: No such file or directory
brick23.gluster.iadm:
    getfattr: Removing leading '/' from absolute path names
    # file: GLUSTERFS/nemo/dzialhandlowy/tefal/filmy tefal/3/TE-STEAM_GENERATORS-PRO_EXPRESS_TOTAL_AUTOCONTROL-GV8960-PRODUCT_VIDEOS-COMPLEMENTARY-STEAM_CORD_STORAGE-EN-30.mp4
    trusted.afr.nemo-client-15=0sAAAAAAAAAAAAAAAA
    trusted.afr.nemo-client-16=0sAAAAAAAAAAAAAAAA
    trusted.afr.nemo-client-17=0sAAAAAAAAAAAAAAAA
    trusted.gfid=0sv/LGDU3JRhyH1PgJmyMvBA==
brick17.gluster.iadm:
    getfattr: /GLUSTERFS/nemo/dzialhandlowy/tefal/filmy tefal/3/TE-STEAM_GENERATORS-PRO_EXPRESS_TOTAL_AUTOCONTROL-GV8960-PRODUCT_VIDEOS-COMPLEMENTARY-STEAM_CORD_STORAGE-EN-30.mp4: No such file or directory
brick18.gluster.iadm:
    getfattr: /GLUSTERFS/nemo/dzialhandlowy/tefal/filmy tefal/3/TE-STEAM_GENERATORS-PRO_EXPRESS_TOTAL_AUTOCONTROL-GV8960-PRODUCT_VIDEOS-COMPLEMENTARY-STEAM_CORD_STORAGE-EN-30.mp4: No such file or directory
brick13.gluster.iadm:
    getfattr: /GLUSTERFS/nemo/dzialhandlowy/tefal/filmy tefal/3/TE-STEAM_GENERATORS-PRO_EXPRESS_TOTAL_AUTOCONTROL-GV8960-PRODUCT_VIDEOS-COMPLEMENTARY-STEAM_CORD_STORAGE-EN-30.mp4: No such file or directory
brick15.gluster.iadm:
    getfattr: /GLUSTERFS/nemo/dzialhandlowy/tefal/filmy tefal/3/TE-STEAM_GENERATORS-PRO_EXPRESS_TOTAL_AUTOCONTROL-GV8960-PRODUCT_VIDEOS-COMPLEMENTARY-STEAM_CORD_STORAGE-EN-30.mp4: No such file or directory
brick20.gluster.iadm:
    getfattr: Removing leading '/' from absolute path names
    # file: GLUSTERFS/nemo/dzialhandlowy/tefal/filmy tefal/3/TE-STEAM_GENERATORS-PRO_EXPRESS_TOTAL_AUTOCONTROL-GV8960-PRODUCT_VIDEOS-COMPLEMENTARY-STEAM_CORD_STORAGE-EN-30.mp4
    trusted.gfid=0sv/LGDU3JRhyH1PgJmyMvBA==
    trusted.glusterfs.dht.linkto="nemo-replicate-4"
brick14.gluster.iadm:
    getfattr: /GLUSTERFS/nemo/dzialhandlowy/tefal/filmy tefal/3/TE-STEAM_GENERATORS-PRO_EXPRESS_TOTAL_AUTOCONTROL-GV8960-PRODUCT_VIDEOS-COMPLEMENTARY-STEAM_CORD_STORAGE-EN-30.mp4: No such file or directory
brick22.gluster.iadm:
    getfattr: Removing leading '/' from absolute path names
    # file: GLUSTERFS/nemo/dzialhandlowy/tefal/filmy tefal/3/TE-STEAM_GENERATORS-PRO_EXPRESS_TOTAL_AUTOCONTROL-GV8960-PRODUCT_VIDEOS-COMPLEMENTARY-STEAM_CORD_STORAGE-EN-30.mp4
    trusted.afr.nemo-client-15=0sAAAAAAAAAAAAAAAA
    trusted.afr.nemo-client-16=0sAAAAAAAAAAAAAAAA
    trusted.afr.nemo-client-17=0sAAAAAAAAAAAAAAAA
    trusted.gfid=0sv/LGDU3JRhyH1PgJmyMvBA==
brick24.gluster.iadm:
    getfattr: Removing leading '/' from absolute path names
    # file: GLUSTERFS/nemo/dzialhandlowy/tefal/filmy tefal/3/TE-STEAM_GENERATORS-PRO_EXPRESS_TOTAL_AUTOCONTROL-GV8960-PRODUCT_VIDEOS-COMPLEMENTARY-STEAM_CORD_STORAGE-EN-30.mp4
    trusted.afr.nemo-client-15=0sAAAAAAAAAAAAAAAA
    trusted.afr.nemo-client-16=0sAAAAAAAAAAAAAAAA
    trusted.afr.nemo-client-17=0sAAAAAAAAAAAAAAAA
    trusted.gfid=0sv/LGDU3JRhyH1PgJmyMvBA==