Bug 1144108 - Spurious failure on disperse tests (bad file size on brick)
Summary: Spurious failure on disperse tests (bad file size on brick)
Keywords:
Status: CLOSED CURRENTRELEASE
Alias: None
Product: GlusterFS
Classification: Community
Component: disperse
Version: mainline
Hardware: Unspecified
OS: Unspecified
unspecified
unspecified
Target Milestone: ---
Assignee: Xavi Hernandez
QA Contact:
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2014-09-18 16:42 UTC by Xavi Hernandez
Modified: 2015-05-14 17:43 UTC (History)
1 user (show)

Fixed In Version: glusterfs-3.7.0
Doc Type: Bug Fix
Doc Text:
Clone Of:
: 1149118 (view as bug list)
Environment:
Last Closed: 2015-05-14 17:27:46 UTC
Regression: ---
Mount Type: ---
Documentation: ---
CRM:
Verified Versions:
Embargoed:


Attachments (Terms of Use)

Description Xavi Hernandez 2014-09-18 16:42:05 UTC
Description of problem:

Sometimes, specially on NetBSD, ec test scripts fail because the size of a file on one of the bricks has an incorrect size.

Version-Release number of selected component (if applicable): master


How reproducible:


Steps to Reproduce:
1.
2.
3.

Actual results:


Expected results:


Additional info:

This is caused by a side effect of the read of a file though the mount point when a brick is down. This may generate an update of the access time, leaving the not running brick in an invalid state. This is correctly healed by self-heal, but the script was not giving enough time to self-heal to complete.

Comment 1 Anand Avati 2014-09-18 16:47:42 UTC
REVIEW: http://review.gluster.org/8771 (test/ec: Let self-heal repair files before accessing bricks) posted (#1) for review on master by Xavier Hernandez (xhernandez)

Comment 2 Anand Avati 2014-09-30 16:46:39 UTC
REVIEW: http://review.gluster.org/8892 (test/ec: Fix spurious failures caused by self-heal) posted (#1) for review on master by Xavier Hernandez (xhernandez)

Comment 3 Anand Avati 2014-10-01 09:27:44 UTC
REVIEW: http://review.gluster.org/8892 (test/ec: Fix spurious failures caused by self-heal) posted (#2) for review on master by Xavier Hernandez (xhernandez)

Comment 4 Anand Avati 2014-10-03 09:01:30 UTC
COMMIT: http://review.gluster.org/8892 committed in master by Vijay Bellur (vbellur) 
------
commit a97ad9b69bb17f2351c59512fa9c6cb25d82b4da
Author: Xavier Hernandez <xhernandez>
Date:   Thu Sep 18 18:42:34 2014 +0200

    test/ec: Fix spurious failures caused by self-heal
    
    The sha1sum of a file may update the access time of that file.
    If this happens while a brick is down, as it is forced in the
    test, that brick doesn't get the update, getting out of sync.
    
    When the brick is restarted, self-heal repairs the file, but
    the test shouldn't access brick contents until self-heal finishes.
    If this is combined with a kill of another brick before self-heal
    has finished repairing the file, the volume could become inaccessible.
    
    Since the purpose of these tests is only to check ec functionality
    (there is another test that checks self-heal), the test that corrupts
    the file has been removed.
    
    Additional checks to validate the state of the volume have been added
    to avoid some timing issues.
    
    BUG: 1144108
    Change-Id: Ibd9288de519914663998a1fbc4321ec92ed6082c
    Signed-off-by: Xavier Hernandez <xhernandez>
    Reviewed-on: http://review.gluster.org/8892
    Reviewed-by: Emmanuel Dreyfus <manu>
    Tested-by: Emmanuel Dreyfus <manu>
    Tested-by: Gluster Build System <jenkins.com>
    Reviewed-by: Dan Lambright <dlambrig>
    Reviewed-by: Vijay Bellur <vbellur>

Comment 5 Niels de Vos 2015-05-14 17:27:46 UTC
This bug is getting closed because a release has been made available that should address the reported issue. In case the problem is still not fixed with glusterfs-3.7.0, please open a new bug report.

glusterfs-3.7.0 has been announced on the Gluster mailinglists [1], packages for several distributions should become available in the near future. Keep an eye on the Gluster Users mailinglist [2] and the update infrastructure for your distribution.

[1] http://thread.gmane.org/gmane.comp.file-systems.gluster.devel/10939
[2] http://thread.gmane.org/gmane.comp.file-systems.gluster.user

Comment 6 Niels de Vos 2015-05-14 17:35:36 UTC
This bug is getting closed because a release has been made available that should address the reported issue. In case the problem is still not fixed with glusterfs-3.7.0, please open a new bug report.

glusterfs-3.7.0 has been announced on the Gluster mailinglists [1], packages for several distributions should become available in the near future. Keep an eye on the Gluster Users mailinglist [2] and the update infrastructure for your distribution.

[1] http://thread.gmane.org/gmane.comp.file-systems.gluster.devel/10939
[2] http://thread.gmane.org/gmane.comp.file-systems.gluster.user

Comment 7 Niels de Vos 2015-05-14 17:37:58 UTC
This bug is getting closed because a release has been made available that should address the reported issue. In case the problem is still not fixed with glusterfs-3.7.0, please open a new bug report.

glusterfs-3.7.0 has been announced on the Gluster mailinglists [1], packages for several distributions should become available in the near future. Keep an eye on the Gluster Users mailinglist [2] and the update infrastructure for your distribution.

[1] http://thread.gmane.org/gmane.comp.file-systems.gluster.devel/10939
[2] http://thread.gmane.org/gmane.comp.file-systems.gluster.user

Comment 8 Niels de Vos 2015-05-14 17:43:54 UTC
This bug is getting closed because a release has been made available that should address the reported issue. In case the problem is still not fixed with glusterfs-3.7.0, please open a new bug report.

glusterfs-3.7.0 has been announced on the Gluster mailinglists [1], packages for several distributions should become available in the near future. Keep an eye on the Gluster Users mailinglist [2] and the update infrastructure for your distribution.

[1] http://thread.gmane.org/gmane.comp.file-systems.gluster.devel/10939
[2] http://thread.gmane.org/gmane.comp.file-systems.gluster.user


Note You need to log in before you can comment on or make changes to this bug.