Bug 2093106 - [RHCS 6] dups.size logging + COT dups trim command + online dups trimming fix
Summary: [RHCS 6] dups.size logging + COT dups trim command + online dups trimming fix
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat Ceph Storage
Classification: Red Hat Storage
Component: RADOS
Version: 5.0
Hardware: Unspecified
OS: Unspecified
unspecified
high
Target Milestone: ---
: 6.0
Assignee: Radoslaw Zarzynski
QA Contact: Pawan
Eliska
URL:
Whiteboard:
Depends On:
Blocks: 2126050
TreeView+ depends on / blocked
 
Reported: 2022-06-02 22:59 UTC by Vikhyat Umrao
Modified: 2023-03-20 18:57 UTC (History)
18 users (show)

Fixed In Version: ceph-17.2.3-23.el9cp
Doc Type: Bug Fix
Doc Text:
.Corrupted dups entries of a PG Log can be removed by off-line and on-line trimming Previously, trimming of PG log dups entries could be prevented during the low-level PG split operation, which is used by the PG autoscaler with far higher frequency than by a human operator. Stalling the trimming of dups resulted in significant memory growth of PG log, leading to OSD crashes as it ran out of memory. Restarting an OSD did not solve the problem as the PG log is stored on disk and reloaded to RAM on startup. With this fix, both off-line, using the `ceph-objectstore-tool` command, and on-line, within OSD, trimming can remove corrupted dups entries of a PG log that jammed the on-line trimming machinery and were responsible for the memory growth. A debug improvement is implemented that prints the number of dups entries to the OSD's log to help future investigations.
Clone Of: 2093031
Environment:
Last Closed: 2023-03-20 18:56:39 UTC
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Ceph Project Bug Tracker 55632 0 None None None 2022-06-02 23:01:56 UTC
Github ceph ceph pull 46251 0 None Merged quincy: osd/PGLog.cc: Trim duplicates by number of entries 2022-06-02 23:01:41 UTC
Github ceph ceph pull 47688 0 None open quincy: osd, tools, kv: non-aggressive, on-line trimming of accumulated dups 2022-08-19 04:17:52 UTC
Red Hat Issue Tracker RHCEPH-4453 0 None None None 2022-06-02 23:05:17 UTC
Red Hat Product Errata RHBA-2023:1360 0 None None None 2023-03-20 18:57:05 UTC

Internal Links: 2093031

Comment 1 Vikhyat Umrao 2022-06-02 23:01:27 UTC
Quincy backport:

https://tracker.ceph.com/issues/55632
https://github.com/ceph/ceph/pull/46251

Comment 30 errata-xmlrpc 2023-03-20 18:56:39 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Red Hat Ceph Storage 6.0 Bug Fix update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2023:1360


Note You need to log in before you can comment on or make changes to this bug.