Fedora Account System
Red Hat Associate
Red Hat Customer
Description of problem (please be detailed as possible and provide log snippests): ocs-operator.v4.4.1-450.ci is not in Succeeded phase and still stuck in installing phase. Version of all relevant components (if applicable): OCP: 4.4.0-0.nightly-2020-06-18-212632 OCS: ocs-operator.v4.4.1-450.ci Does this issue impact your ability to continue to work with the product (please explain in detail what is the user impact)? yes, CSV stuck in installing phase Is there any workaround available to the best of your knowledge? No Rate from 1 - 5 the complexity of the scenario you performed that caused this bug (1 - very simple, 5 - very complex)? 1 Can this issue reproducible? 1/1 Can this issue reproduce from the UI? Not tried If this is a regression, please provide more details to justify this: Steps to Reproduce: 1. Deploy OCS 4.4 vai ocs-ci 2. CSV will stuck in installing phase Deployment is successful but during verification stage CSV will stuck in installing phase Actual results: 07:38:27 - MainThread - ocs_ci.ocs.ocp - INFO - Resource ocs-operator.v4.4.1-450.ci is in phase: Installing! 07:38:27 - MainThread - ocs_ci.utility.utils - INFO - Going to sleep for 5 seconds before next iteration 07:38:32 - MainThread - ocs_ci.utility.utils - INFO - Executing command: oc -n openshift-storage --kubeconfig /home/jenkins/current-cluster-dir/openshift-cluster-dir/auth/kubeconfig get csv ocs-operator.v4.4.1-450.ci -n openshift-storage -o yaml Expected results: ocs-operator.v4.4.1-450.ci should be in succeed stage Additional info: $ oc get csv -n openshift-storage NAME DISPLAY VERSION REPLACES PHASE lib-bucket-provisioner.v1.0.0 lib-bucket-provisioner 1.0.0 Succeeded ocs-operator.v4.4.1-450.ci OpenShift Container Storage 4.4.1-450.ci Installing $ oc describe csv ocs-operator.v4.4.1-450.ci -n openshift-storage Events: Type Reason Age From Message ---- ------ ---- ---- ------- Normal RequirementsUnknown 94m (x2 over 94m) operator-lifecycle-manager requirements not yet checked Normal RequirementsNotMet 93m (x2 over 93m) operator-lifecycle-manager one or more requirements couldn't be found Normal InstallWaiting 93m (x2 over 93m) operator-lifecycle-manager installing: waiting for deployment rook-ceph-operator to become ready: Waiting for rollout to finish: 0 of 1 updated replicas are available... Normal InstallSucceeded 92m operator-lifecycle-manager install strategy completed with no errors Warning ComponentUnhealthy 92m (x2 over 92m) operator-lifecycle-manager installing: waiting for deployment ocs-operator to become ready: Waiting for rollout to finish: 0 of 1 updated replicas are available... Normal InstallWaiting 92m (x2 over 93m) operator-lifecycle-manager installing: waiting for deployment ocs-operator to become ready: Waiting for rollout to finish: 0 of 1 updated replicas are available... Normal AllRequirementsMet 86m (x5 over 93m) operator-lifecycle-manager all requirements found, attempting install Normal InstallSucceeded 86m (x5 over 93m) operator-lifecycle-manager waiting for install components to report healthy Normal NeedsReinstall 24m (x24 over 92m) operator-lifecycle-manager installing: waiting for deployment ocs-operator to become ready: Waiting for rollout to finish: 0 of 1 updated replicas are available... Warning InstallCheckFailed 2m57s (x32 over 87m) operator-lifecycle-manager install timeout > pods $ oc get pods -n openshift-storage NAME READY STATUS RESTARTS AGE csi-cephfsplugin-f454r 3/3 Running 0 95m csi-cephfsplugin-pjfns 3/3 Running 0 95m csi-cephfsplugin-provisioner-7d7b98c76b-jjbgc 5/5 Running 0 95m csi-cephfsplugin-provisioner-7d7b98c76b-qxlwf 5/5 Running 0 95m csi-cephfsplugin-w49rs 3/3 Running 0 95m csi-rbdplugin-btvlc 3/3 Running 0 95m csi-rbdplugin-frp7w 3/3 Running 0 95m csi-rbdplugin-provisioner-598f7c44f9-7k95r 5/5 Running 0 95m csi-rbdplugin-provisioner-598f7c44f9-d66lr 5/5 Running 0 95m csi-rbdplugin-vk2k6 3/3 Running 0 95m lib-bucket-provisioner-5b9cb4f848-clpjf 1/1 Running 0 96m noobaa-core-0 1/1 Running 0 90m noobaa-db-0 1/1 Running 0 90m noobaa-endpoint-76cd984c7-vzxw6 1/1 Running 0 89m noobaa-operator-7876c57cf9-t7fmb 1/1 Running 0 96m ocs-operator-5dcbfbc99b-h6ldb 0/1 Running 0 96m rook-ceph-crashcollector-compute-0-585bd7d5fb-gsdds 1/1 Running 0 91m rook-ceph-crashcollector-compute-1-5bd674798c-4bpt8 1/1 Running 0 90m rook-ceph-crashcollector-compute-2-65b85c5bf4-xmwnd 1/1 Running 0 90m rook-ceph-drain-canary-compute-0-b9b4db599-kp8mb 1/1 Running 0 91m rook-ceph-drain-canary-compute-1-569f864ccb-gnw6h 1/1 Running 0 90m rook-ceph-drain-canary-compute-2-7b9f9869f4-tzd9r 1/1 Running 0 90m rook-ceph-mds-ocs-storagecluster-cephfilesystem-a-54c5dd894mpvc 1/1 Running 0 90m rook-ceph-mds-ocs-storagecluster-cephfilesystem-b-7c4fd6fcc4cpb 1/1 Running 0 90m rook-ceph-mgr-a-57f9db6b49-ck8bj 1/1 Running 0 92m rook-ceph-mon-a-855b55d5fc-d52c5 1/1 Running 0 93m rook-ceph-mon-b-7fbbd5fb7d-pk4vx 1/1 Running 0 93m rook-ceph-mon-c-589797549f-85cqh 1/1 Running 0 92m rook-ceph-operator-76b7d4fcd8-5gzcs 1/1 Running 0 96m rook-ceph-osd-0-84d46f5d8c-q6b22 1/1 Running 0 91m rook-ceph-osd-1-8df956444-48l26 1/1 Running 0 91m rook-ceph-osd-2-f74dc5466-lq2m9 1/1 Running 0 90m rook-ceph-osd-prepare-ocs-deviceset-0-0-ffbmq-4kzz4 0/1 Completed 0 91m rook-ceph-osd-prepare-ocs-deviceset-1-0-r978w-dr5cd 0/1 Completed 0 91m rook-ceph-osd-prepare-ocs-deviceset-2-0-g9r4r-kszht 0/1 Completed 0 91m rook-ceph-tools-58fbf87bf-bf9pb 1/1 Running 0 90m
jenkins Job: https://ocs4-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/qe-deploy-ocs-cluster/8932/console Must gather logs: http://magna002.ceph.redhat.com/ocsci-jenkins/openshift-clusters/jnk-pr2337-b2073/jnk-pr2337-b2073_20200619T055817/logs/failed_testcase_ocs_logs_1592546781/test_deployment_ocs_logs/ status condition from operator $ oc get csv ocs-operator.v4.4.1-450.ci -n openshift-storage -o yaml status: conditions: - lastTransitionTime: "2020-06-19T08:10:52Z" lastUpdateTime: "2020-06-19T08:10:52Z" message: install timeout phase: Failed reason: InstallCheckFailed - lastTransitionTime: "2020-06-19T08:10:56Z" lastUpdateTime: "2020-06-19T08:10:56Z" message: | installing: waiting for deployment ocs-operator to become ready: Waiting for rollout to finish: 0 of 1 updated replicas are available... phase: Pending reason: NeedsReinstall - lastTransitionTime: "2020-06-19T08:11:01Z" lastUpdateTime: "2020-06-19T08:11:01Z" message: all requirements found, attempting install phase: InstallReady reason: AllRequirementsMet - lastTransitionTime: "2020-06-19T08:11:13Z" lastUpdateTime: "2020-06-19T08:11:13Z" message: waiting for install components to report healthy phase: Installing reason: InstallSucceeded - lastTransitionTime: "2020-06-19T08:11:13Z" lastUpdateTime: "2020-06-19T08:11:13Z" message: | installing: waiting for deployment ocs-operator to become ready: Waiting for rollout to finish: 0 of 1 updated replicas are available... phase: Installing reason: InstallWaiting - lastTransitionTime: "2020-06-19T08:16:13Z" lastUpdateTime: "2020-06-19T08:16:13Z" message: install timeout phase: Failed reason: InstallCheckFailed - lastTransitionTime: "2020-06-19T08:16:17Z" lastUpdateTime: "2020-06-19T08:16:17Z" message: | installing: waiting for deployment ocs-operator to become ready: Waiting for rollout to finish: 0 of 1 updated replicas are available... phase: Pending reason: NeedsReinstall
Fixed in the latest build 459
(In reply to Raz Tamir from comment #7) > Fixed in the latest build 459 I don't know what fixed this bug actually. There was no change to the ocs-operator release-4.4 branch after this BZ was raised. Can someone provide a PR? Umanga? @Raz, Furthermore, if it is a regression that was introduced by the ocs 4.4.1 build (450), then we do not need a doc-text, agree? (already putting requires_doc_text-)
Hi @Michael, Agree with you
https://bugzilla.redhat.com/show_bug.cgi?id=1851311#c5 -> Look at comments: 5, 6 and 7
Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory, and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHBA-2020:2830
The needinfo request[s] on this closed bug have been removed as they have been unresolved for 1000 days