Bug 2093031 - [RHCS 5.2] dups.size logging + COT dups trim command + online dups trimming fix
Summary: [RHCS 5.2] dups.size logging + COT dups trim command + online dups trimming fix
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat Ceph Storage
Classification: Red Hat Storage
Component: RADOS
Version: 5.0
Hardware: Unspecified
OS: Unspecified
unspecified
high
Target Milestone: ---
: 5.2
Assignee: Radoslaw Zarzynski
QA Contact: Pawan
URL:
Whiteboard:
: 2090522 (view as bug list)
Depends On:
Blocks: 2094069 2101798 2102272 2119853
TreeView+ depends on / blocked
 
Reported: 2022-06-02 18:47 UTC by Vikhyat Umrao
Modified: 2023-01-20 10:50 UTC (History)
18 users (show)

Fixed In Version: ceph-16.2.8-75.el8cp
Doc Type: Bug Fix
Doc Text:
.Corrupted dups entries of a PG Log can be removed by off-line and on-line trimming Previously, trimming of PG log dups entries could be prevented during the low-level PG split operation, which is used by the PG autoscaler with far higher frequency than by a human operator. Stalling the trimming of dups resulted in significant memory growth of PG log, leading to OSD crashes as it ran out of memory. Restarting an OSD did not solve the problem as the PG log is stored on disk and reloaded to RAM on startup. With this fix, both off-line (using the `ceph-objectstore-tool` command) and on-line (within OSD) trimming is able to remove corrupted dups entries of a PG Log that jammed the on-line trimming machinery and were responsible for the memory growth. A debug improvement is implemented that prints the number of dups entries to the OSD's log to help future investigations.
Clone Of:
: 2093106 2094069 2119853 (view as bug list)
Environment:
Last Closed: 2022-08-09 17:39:07 UTC
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Ceph Project Bug Tracker 55631 0 None None None 2022-06-02 18:47:28 UTC
Github ceph ceph pull 46252 0 None open pacific: osd/PGLog.cc: Trim duplicates by number of entries 2022-06-02 21:57:43 UTC
Red Hat Bugzilla 2093106 1 unspecified CLOSED [RHCS 6] dups.size logging + COT dups trim command + online dups trimming fix 2023-03-20 18:57:05 UTC
Red Hat Issue Tracker RHCEPH-4450 0 None None None 2022-06-02 18:56:19 UTC
Red Hat Knowledge Base (Solution) 6963402 0 None None None 2022-08-29 23:29:24 UTC
Red Hat Product Errata RHSA-2022:5997 0 None None None 2022-08-09 17:39:39 UTC

Description Vikhyat Umrao 2022-06-02 18:47:29 UTC
Description of problem:
[RHCS 5.2] dups.size logging + COT dups trim command + online dups trimming fix

Version-Release number of selected component (if applicable):
RHCS 5.1

Comment 23 errata-xmlrpc 2022-08-09 17:39:07 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Moderate: Red Hat Ceph Storage Security, Bug Fix, and Enhancement Update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHSA-2022:5997

Comment 24 Vikhyat Umrao 2022-08-29 23:29:25 UTC
*** Bug 2090522 has been marked as a duplicate of this bug. ***


Note You need to log in before you can comment on or make changes to this bug.