Description of the problem: There are 4 managed clusters, they should be always listed in each panel. But when the dashboard is refreshed automatically or manually, the cluster number is changed in Top 50 panel sometimes. Release version: 2.4.1 Operator snapshot version: OCP version: 4.8 Browser Info: Firefox and Safari on Mac Steps to reproduce: 1. Deployed MCO CR and there are several managed clusters 2. Open Grafana Dashboard - Cluster Overview 3. Manually refresh dashboard and check cluster number in Top 50 panel
This issue happened frequently at the beginning when the environment is set up, but when I ran automation on this environment and some cases make thanos-ruler restart, the cluster number is stable in Top 50 panel now. I will keep checking this issue, and raise it to a higher priority once it comes again.
@ecai @xiyin FYI.
When redeployed Observability, I encountered this issue again. I think this issue is high impact on 2.4.1, should be a stop-ship issue.
G2Bsync 978975996 comment morvencao Thu, 25 Nov 2021 08:57:04 UTC G2Bsync The root cause is at upstream thanos ruler, we filed an [issue](https://github.com/thanos-io/thanos/issues/4900) in thanos community, waiting for response...
*** Bug 2028071 has been marked as a duplicate of this bug. ***
I verified this issue has been fixed by 2.4.2 RC2, thanks.