Bug 2223461

Summary:	[ODF] "Data Services" not visible after setting up Multicluster storage health, error "Failed to update monitoring-endpoint-monitoring-work work", "he size of manifests is 58935 bytes which exceeds the 50k limit"
Product:	[Red Hat Storage] Red Hat OpenShift Data Foundation	Reporter:	csharpe
Component:	ceph-monitoring	Assignee:	gowtham <gshanmug>
Status:	ASSIGNED ---	QA Contact:	Harish NV Rao <hnallurv>
Severity:	medium	Docs Contact:
Priority:	unspecified
Version:	4.12	CC:	gshanmug, jbanerje, odf-bz-bot
Target Milestone:	---	Flags:	csharpe: needinfo? (gshanmug)
Target Release:	---
Hardware:	All
OS:	All
Whiteboard:
Fixed In Version:		Doc Type:	If docs needed, set a value
Doc Text:		Story Points:	---
Clone Of:		Environment:
Last Closed:		Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:

Description csharpe 2023-07-18 01:37:36 UTC

Description of problem (please be detailed as possible and provide log
snippests):

Cu is setting up Multicluster Storage Health on their sandbox cluster and  following the instructions in "Chapter 2. Multicluster storage health Red Hat OpenShift Data Foundation 4.12 | Red Hat Customer Portal" [1]

[1] https://access.redhat.com/documentation/en-us/red_hat_openshift_data_foundation/4.12/html/monitoring_openshift_data_foundation/multicluster_storage_health

Configmap `observability-metrics-custom-allowlist` has been added to namespace `open-cluster-management-observability`, however, upon verification, `Data Services` is not visible on the RHACM console.


Version of all relevant components (if applicable):

ODF v4.12.2


Does this issue impact your ability to continue to work with the product
(please explain in detail what is the user impact)?

Cu cannot move forward with the testing phase.


Is there any workaround available to the best of your knowledge?  No.


Rate from 1 - 5 the complexity of the scenario you performed that caused this
bug (1 - very simple, 5 - very complex)?  3


Can this issue reproducible?  No.


Can this issue reproduce from the UI?


If this is a regression, please provide more details to justify this:


Steps to Reproduce:
1.  N/A
2.
3.


Actual results:


Expected results:


Additional info:

Comment 4 Joydeep Banerjee 2023-07-24 13:36:24 UTC

Can you check if we see the metrics like:
      - odf_system_health_status
      - odf_system_map
      - odf_system_raw_capacity_total_bytes
      - odf_system_raw_capacity_used_bytes
in the ACM Grafana explorer. The Grafana is https://grafana-open-cluster-management-observability.[openshift_ingress_domain]/. Then click on the EXPLORER icon on the left hand bar. And then type in the metric name and see if you see data.
If data for all metrics can be seen, then it is not an issue with ACM.
If you do not see data, please run the ACM must-gather. - https://access.redhat.com/documentation/en-us/red_hat_advanced_cluster_management_for_kubernetes/2.8/html/troubleshooting/troubleshooting#procedure