Bug 1028977
| Summary: | Dist-geo-rep : too many files failed to sync to slave, when the use-tarssh was on. | ||
|---|---|---|---|
| Product: | [Red Hat Storage] Red Hat Gluster Storage | Reporter: | Vijaykumar Koppad <vkoppad> |
| Component: | geo-replication | Assignee: | Bug Updates Notification Mailing List <rhs-bugs> |
| Status: | CLOSED EOL | QA Contact: | storage-qa-internal <storage-qa-internal> |
| Severity: | high | Docs Contact: | |
| Priority: | high | ||
| Version: | 2.1 | CC: | avishwan, chrisw, csaba, david.macdonald |
| Target Milestone: | --- | Keywords: | ZStream |
| Target Release: | --- | ||
| Hardware: | x86_64 | ||
| OS: | Linux | ||
| Whiteboard: | consistency | ||
| Fixed In Version: | Doc Type: | Bug Fix | |
| Doc Text: | Story Points: | --- | |
| Clone Of: | Environment: | ||
| Last Closed: | Type: | Bug | |
| Regression: | --- | Mount Type: | --- |
| Documentation: | --- | CRM: | |
| Verified Versions: | Category: | --- | |
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |
| Cloudforms Team: | --- | Target Upstream Version: | |
| Embargoed: | |||
|
Description
Vijaykumar Koppad
2013-11-11 12:04:54 UTC
This I have it again in the build glusterfs-3.4.0.43rhs-1. One of the top level directory on the master didn't get any file underneath. >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> [root@redmoon slave]# for i in {0..9}; do echo level0$i ; find /mnt/slave/level0$i | wc -l ; done level00 1010 level01 1 level02 1010 level03 510 level04 1010 level05 1010 level06 1010 level07 1010 level08 1010 level09 1010 >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> level01 doesn't have anyfiles underneath. For the files under that directory, logs on the slave geo-rep client logs says, >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> [2013-11-13 07:24:25.716620] I [fuse-bridge.c:3515:fuse_auxgfid_newentry_cbk] 0-fuse-aux-gfid-mount: failed to create the entry <gfid:a1669059-75d2-4af4-a5cf-beb2bb248548>/52832924%%G04QJWF5JJ with gfid (4c403d8e-a7d4-49a1-931c-fdf1ca 668e19): No such file or directory [2013-11-13 07:24:25.716646] W [fuse-bridge.c:1627:fuse_err_cbk] 0-glusterfs-fuse: 98475: MKNOD() <gfid:a1669059-75d2 -4af4-a5cf-beb2bb248548>/52832924%%G04QJWF5JJ => -1 (No such file or directory) [2013-11-13 07:24:25.716826] W [dht-layout.c:179:dht_layout_search] 0-slave-dht: no subvolume for hash (value) = 2125 144236 [2013-11-13 07:24:25.716859] I [fuse-bridge.c:3515:fuse_auxgfid_newentry_cbk] 0-fuse-aux-gfid-mount: failed to create the entry <gfid:a1669059-75d2-4af4-a5cf-beb2bb248548>/52832924%%8VU1FLJ2NS with gfid (c09661dc-6741-42cd-8a09-c626faca3b9d): No such file or directory [2013-11-13 07:24:25.716885] W [fuse-bridge.c:1627:fuse_err_cbk] 0-glusterfs-fuse: 98476: MKNOD() <gfid:a1669059-75d2-4af4-a5cf-beb2bb248548>/52832924%%8VU1FLJ2NS => -1 (No such file or directory) >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> and for the directory underneath that level01 directory has logs on slave like >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> [2013-11-13 07:24:25.720915] W [dht-layout.c:179:dht_layout_search] 0-slave-dht: no subvolume for hash (value) = 1564227000 [2013-11-13 07:24:25.720947] I [fuse-bridge.c:3515:fuse_auxgfid_newentry_cbk] 0-fuse-aux-gfid-mount: failed to create the entry <gfid:a1669059-75d2-4af4-a5cf-beb2bb248548>/level11 with gfid (2bff3c66-4876-4533-b489-392be875c0b9): Invalid argument [2013-11-13 07:24:25.720974] W [fuse-bridge.c:1627:fuse_err_cbk] 0-glusterfs-fuse: 98492: MKDIR() <gfid:a1669059-75d2-4af4-a5cf-beb2bb248548>/level11 => -1 (Invalid argument) >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> If you check above find command output, even level03 has some files missing for those missing files the logs on slave side are like >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> [2013-11-13 07:26:16.053560] W [dht-layout.c:179:dht_layout_search] 0-slave-dht: no subvolume for hash (value) = 4196023558 [2013-11-13 07:26:16.053584] I [fuse-bridge.c:3515:fuse_auxgfid_newentry_cbk] 0-fuse-aux-gfid-mount: failed to create the entry <gfid:c466cb9a-d353-4591-a4a1-c2036752b17a>/52832933%%QQ4YEAD116 with gfid (5e395fe6-a228-4646-9702-2b1c8d7198b9): No such file or directory [2013-11-13 07:26:16.053610] W [fuse-bridge.c:1627:fuse_err_cbk] 0-glusterfs-fuse: 176519: MKNOD() <gfid:c466cb9a-d353-4591-a4a1-c2036752b17a>/52832933%%QQ4YEAD116 => -1 (No such file or directory) : ] [2013-11-13 07:26:16.052668] I [fuse-bridge.c:3515:fuse_auxgfid_newentry_cbk] 0-fuse-aux-gfid-mount: failed to create the entry <gfid:c466cb9a-d353-4591-a4a1-c2036752b17a>/52832933%%0MKGJO2P73 with gfid (908f3ff8-7053-4d75-92b9-85f76d72064b): No such file or directory >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>> Whenever I have freshly created the volume and geo-rep session, I have never hit this. Only after few operations of files creation and deletion I have hit these kind of missing files. This could be result of some stale data.(just suspicion) Closing this bug since RHGS 2.1 release reached EOL. Required bugs are cloned to RHGS 3.1. Please re-open this issue if found again. Closing this bug since RHGS 2.1 release reached EOL. Required bugs are cloned to RHGS 3.1. Please re-open this issue if found again. |