Bug 2060550

Summary:	MCE installation hang due to no console-mce-console deployment available
Product:	Red Hat Advanced Cluster Management for Kubernetes	Reporter:	Thuy Nguyen <thnguyen>
Component:	Installer	Assignee:	Jakob <jagray>
Status:	CLOSED ERRATA	QA Contact:	txue
Severity:	urgent	Docs Contact:	Christopher Dawson <cdawson>
Priority:	unspecified
Version:	rhacm-2.5	CC:	ecai
Target Milestone:	---	Flags:	bot-tracker-sync: rhacm-2.5+
Target Release:	rhacm-2.5
Hardware:	x86_64
OS:	Unspecified
Whiteboard:
Fixed In Version:		Doc Type:	If docs needed, set a value
Doc Text:		Story Points:	---
Clone Of:		Environment:
Last Closed:	2022-06-09 02:09:07 UTC	Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:

Description Thuy Nguyen 2022-03-03 18:38:13 UTC

Description of the problem: MCE installation hang due to no console-mce-console deployment available

Release version:

Operator snapshot version:
- ACM 2.5.0-DOWNSTREAM-2022-03-03-03-15-27 (Final S3)
- MCE 2.0.0-DOWNANDBACK-2022-03-03-08-04-54

OCP version: 4.10.0-rc.3

Browser Info:

Steps to reproduce:
1. Install ACM + MCH + MCE

Actual results:
MCE installation hang

Expected results:

Additional info:

oc get mch -n ocm
NAME              STATUS       AGE
multiclusterhub   Installing   20m

oc get sub -n multicluster-engine
NAME                  PACKAGE               SOURCE         CHANNEL
multicluster-engine   multicluster-engine   brew-mce-iib   stable-2.0

oc get mce -n multicluster-engine
NAME                 STATUS        AGE
multiclusterengine   Progressing   18m

oc get mce -n multicluster-engine multiclusterengine -oyaml
apiVersion: multicluster.openshift.io/v1
kind: MultiClusterEngine
metadata:
  annotations:
    imageRepository: brew.registry.redhat.io/rh-osbs/rhacm2
  creationTimestamp: "2022-03-03T18:19:16Z"
  finalizers:
  - finalizer.multicluster.openshift.io
  generation: 14
  labels:
    installer.name: multiclusterhub
    installer.namespace: ocm
  name: multiclusterengine
  resourceVersion: "94172469"
  uid: f6b2a34b-f54c-4bed-a771-3199c1652f68
spec:
  availabilityConfig: High
  components:
  - enabled: true
    name: assisted-service
  - enabled: true
    name: cluster-lifecycle
  - enabled: true
    name: cluster-manager
  - enabled: true
    name: discovery
  - enabled: true
    name: hive
  - enabled: true
    name: server-foundation
  - enabled: true
    name: managed-service-account
  - enabled: true
    name: console-mce
  imagePullSecret: multiclusterhub-operator-pull-secret
  targetNamespace: multicluster-engine
  tolerations:
  - effect: NoSchedule
    key: node-role.kubernetes.io/infra
    operator: Exists
status:
  components:
  - kind: Deployment
    lastTransitionTime: "2022-03-03T18:37:28Z"
    message: No conditions available
    name: console-mce-console
    reason: No conditions available
    status: Unknown
    type: Unknown
  - kind: Deployment
    lastTransitionTime: "2022-03-03T18:19:37Z"
    name: discovery-operator
    reason: MinimumReplicasAvailable
    status: "True"
    type: Available
  - kind: Deployment
    lastTransitionTime: "2022-03-03T18:19:24Z"
    name: hive-operator
    reason: MinimumReplicasAvailable
    status: "True"
    type: Available
  - kind: Deployment
    lastTransitionTime: "2022-03-03T18:19:48Z"
    name: infrastructure-operator
    reason: MinimumReplicasAvailable
    status: "True"
    type: Available
  - kind: Deployment
    lastTransitionTime: "2022-03-03T18:20:08Z"
    name: cluster-curator-controller
    reason: MinimumReplicasAvailable
    status: "True"
    type: Available
  - kind: Deployment
    lastTransitionTime: "2022-03-03T18:19:49Z"
    name: clusterclaims-controller
    reason: MinimumReplicasAvailable
    status: "True"
    type: Available
  - kind: Deployment
    lastTransitionTime: "2022-03-03T18:19:25Z"
    name: provider-credential-controller
    reason: MinimumReplicasAvailable
    status: "True"
    type: Available
  - kind: Deployment
    lastTransitionTime: "2022-03-03T18:19:32Z"
    name: cluster-manager
    reason: MinimumReplicasAvailable
    status: "True"
    type: Available
  - kind: ClusterManager
    lastTransitionTime: "2022-03-03T18:37:28Z"
    message: Components of cluster manager are applied
    name: cluster-manager
    reason: ClusterManagerApplied
    status: "True"
    type: Applied
  - kind: Deployment
    lastTransitionTime: "2022-03-03T18:19:26Z"
    name: ocm-controller
    reason: MinimumReplicasAvailable
    status: "True"
    type: Available
  - kind: Deployment
    lastTransitionTime: "2022-03-03T18:19:43Z"
    name: ocm-proxyserver
    reason: MinimumReplicasAvailable
    status: "True"
    type: Available
  - kind: Deployment
    lastTransitionTime: "2022-03-03T18:19:52Z"
    name: ocm-webhook
    reason: MinimumReplicasAvailable
    status: "True"
    type: Available
  - kind: Deployment
    lastTransitionTime: "2022-03-03T18:28:10Z"
    name: managed-serviceaccount-addon-manager
    reason: MinimumReplicasAvailable
    status: "True"
    type: Available
  conditions:
  - lastTransitionTime: "2022-03-03T18:19:16Z"
    lastUpdateTime: "2022-03-03T18:19:16Z"
    reason: ComponentsUnavailable
    status: "False"
    type: Available
  - lastTransitionTime: "2022-03-03T18:19:19Z"
    lastUpdateTime: "2022-03-03T18:19:19Z"
    message: All components deployed
    reason: ComponentsDeployed
    status: "True"
    type: Progressing
  phase: Progressing

Comment 2 Jakob 2022-03-14 14:45:57 UTC

I will look into this today. I recall around the time this issue was opened there was a mistake in image mapping that caused the mce console to be missing its image reference. That is now resolved so if this is still an issue there must be something else blocked console-mce. This was opened using 4.10.0-rc.3 but I will test with the GA version of 4.10.

Comment 3 Jakob 2022-03-14 17:29:02 UTC

I have installed successfully with both 2.5.0-SNAPSHOT-2022-03-14-13-03-46 and 2.5.0-DOWNSTREAM-2022-03-14-13-03-46 using OCP 4.10.3. I believe the issue that caused MCE install to hang was https://github.com/stolostron/backlog/issues/20484 and is now resolved.

Comment 4 bot-tracker-sync 2022-03-15 17:53:32 UTC

G2Bsync 1068229225 comment 
 thuyn-581 Tue, 15 Mar 2022 17:01:26 UTC 
 G2Bsync - 
Validated on ACM 2.5.0-DOWNSTREAM-2022-03-14-13-03-46 (S4).

Comment 7 errata-xmlrpc 2022-06-09 02:09:07 UTC

Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Important: Red Hat Advanced Cluster Management 2.5 security updates, images, and bug fixes), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHSA-2022:4956