Bug 1958037

Summary: [Rados] Progress section - Global Recovery Event remaining time is increasing indefinitely after all pgs in active+clean
Product: [Red Hat Storage] Red Hat Ceph Storage Reporter: Vasishta <vashastr>
Component: RADOSAssignee: Neha Ojha <nojha>
Status: CLOSED DUPLICATE QA Contact: Manohar Murthy <mmurthy>
Severity: medium Docs Contact:
Priority: unspecified    
Version: 5.0CC: akupczyk, bhubbard, ceph-eng-bugs, dzafman, kchai, nojha, rzarzyns, sseshasa, vumrao
Target Milestone: ---   
Target Release: 5.1   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2021-05-07 19:30:23 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Vasishta 2021-05-07 05:23:38 UTC
Description of problem:
Turned on PG autoscale in an upgraded cluster (from rhcs 4.x to rhcs 5.x)
After PGs were re-scaled, Remaining time of Global Recovery Event in progress section in ceph status seems to be increasing indefinitely
(observed increasing from 4s to 9h)

Version-Release number of selected component (if applicable):
16.2.0-26.el8cp

How reproducible:
1/3 attempts

Steps to Reproduce:
1. Configure 4.x cluster
2. upgrade it to 5.x
3. turn on pg autoscale on pools that were created in rhcs 4.x observe recovery

Actual results:
=------------------------------Before(In b/w recovery)----------
    pgs:     646 active+clean
 
  io:
    client:   2.7 KiB/s rd, 68 KiB/s wr, 2 op/s rd, 135 op/s wr
 
  progress:
    Global Recovery Event (4s)
      [............................] 
 

-------------------------------After------------------------------
    pgs:     561 active+clean
 
  io:
    client:   2.7 KiB/s rd, 2 op/s rd, 0 op/s wr
 
  progress:
    Global Recovery Event (90m)
      [===.........................] (remaining: 9h)
------------------------------------------------------------

Expected results:
Progress section should be accurate

Additional info: