Bugzilla will be upgraded to version 5.0. The upgrade date is tentatively scheduled for 2 December 2018, pending final testing and feedback.
Bug 1318055 - collection split causes orphaned files in filestore causing inconsistent scrubs and crashes on pg removal
collection split causes orphaned files in filestore causing inconsistent scru...
Status: CLOSED ERRATA
Product: Red Hat Ceph Storage
Classification: Red Hat
Component: RADOS (Show other bugs)
1.3.2
Unspecified Unspecified
unspecified Severity urgent
: rc
: 2.0
Assigned To: Samuel Just
shylesh
:
Depends On:
Blocks: 1334534
  Show dependency treegraph
 
Reported: 2016-03-15 17:52 EDT by Samuel Just
Modified: 2017-07-30 11:14 EDT (History)
8 users (show)

See Also:
Fixed In Version: ceph-10.2.0-1.el7cp
Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of:
: 1334534 (view as bug list)
Environment:
Last Closed: 2016-08-23 15:34:56 EDT
Type: Bug
Regression: ---
Mount Type: ---
Documentation: ---
CRM:
Verified Versions:
Category: ---
oVirt Team: ---
RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: ---


Attachments (Terms of Use)


External Trackers
Tracker ID Priority Status Summary Last Updated
Ceph Project Bug Tracker 14766 None None None 2016-03-15 17:52 EDT
Red Hat Product Errata RHBA-2016:1755 normal SHIPPED_LIVE Red Hat Ceph Storage 2.0 bug fix and enhancement update 2016-08-23 19:23:52 EDT

  None (edit)
Description Samuel Just 2016-03-15 17:52:16 EDT
Description of problem:

When a collection split occurs during a collection_move_rename on an ec object, it can result in the old link being orphaned in the parent directory (see the commits for details).  

Version-Release number of selected component (if applicable):


How reproducible:


Steps to Reproduce:
1. Create new cluster
2. Create ec pool with one pg.
3. Fill up pool by alternately creating a new object and overwriting an existing object.  All of the objects should have names longer than 300 characters.
4. When the pg collection splits, there should be an orphaned file in the <pgid>_head/ directory for the single pg on the osds with the pg.

Actual results:

4. is proof that the bug happened.  The following symptoms may also occur depending on the exact objects created:

Scrubbing the pg may result in the pg being reported incorrectly as inconsistent.  Removing the orphaned file and re-scrubbing should cause the pg to stop being inconsistent.

Causing the pg mapping to change may cause the ENOTEMPTY crash in the linked bug.  Again, the file remaining in the collection directory will be the orphaned file.

Expected results:

No orphaned file, crashes, or pg inconsistencies.


Additional info:
Comment 1 Samuel Just 2016-03-15 17:52:51 EDT
https://github.com/ceph/ceph/pull/8136 -- merged.  Not backported to hammer yet.
Comment 2 Samuel Just 2016-04-08 10:41:56 EDT
Still needs backport to hammer.
Comment 3 Ken Dreyer (Red Hat) 2016-04-26 16:30:12 EDT
Looks like that PR in comment 1 already made it into v10.2.0 upstream?

If that's the case, would you please re-target this bz to 1.3.3?
Comment 4 Samuel Just 2016-05-09 16:42:22 EDT
Pending backport to hammer.
Comment 5 Samuel Just 2016-05-09 16:48:12 EDT
Oops, I guess this stays in the 2.0 release tag so I should leave it as POST?
Comment 6 Samuel Just 2016-05-09 16:48:26 EDT
It's in 10.2.0
Comment 7 Samuel Just 2016-05-09 17:02:16 EDT
It's in 10.2.0, so it's MODIFIED I guess
Comment 12 errata-xmlrpc 2016-08-23 15:34:56 EDT
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://rhn.redhat.com/errata/RHBA-2016-1755.html

Note You need to log in before you can comment on or make changes to this bug.