Description of problem: Migration controller creation using OLM does not work with velero 1.1 Version-Release number of selected component (if applicable): https://quay.io/repository/ocpmigrate/mig-operator/manifest/sha256:2c48e910cc265cff61772266cea9159b29ff2787c9780194a45c6572c1a742db https://quay.io/repository/ocpmigrate/velero/manifest/sha256:21297a4ab5f82b91bebd5f13d29acb6d43fb87c65ebb1e00fab11ebfeb0a2be2 How reproducible: always Steps to Reproduce: On OCP 4 cluster do the following 1. oc create -f mig-operator-source.yaml 2. Create a mig namespace 3. Go to the cluster's Web console - In the left menu select Operator Hub and find Migration Operator in the list 4. Click Install and install it in the mig namespace 5. Once installation is complete select Installed Operators on the left menu 6. Create a MigrationController CR. The default vales should be acceptable. Actual results: Velero pod fails # oc logs velero-66b6f9d5cf-k4whc time="2019-08-15T18:14:53Z" level=info msg="setting log-level to INFO" logSource="pkg/cmd/server/server.go:168" time="2019-08-15T18:14:53Z" level=info msg="Starting Velero server (-)" logSource="pkg/cmd/server/server.go:170" time="2019-08-15T18:14:53Z" level=info msg="registering plugin" command=/velero kind=BackupItemAction logSource="pkg/plugin/clientmgmt/registry.go:100" name=velero.io/pod time="2019-08-15T18:14:53Z" level=info msg="registering plugin" command=/velero kind=BackupItemAction logSource="pkg/plugin/clientmgmt/registry.go:100" name=velero.io/pv time="2019-08-15T18:14:53Z" level=info msg="registering plugin" command=/velero kind=BackupItemAction logSource="pkg/plugin/clientmgmt/registry.go:100" name=velero.io/service-account time="2019-08-15T18:14:53Z" level=info msg="registering plugin" command=/velero kind=VolumeSnapshotter logSource="pkg/plugin/clientmgmt/registry.go:100" name=velero.io/aws time="2019-08-15T18:14:53Z" level=info msg="registering plugin" command=/velero kind=VolumeSnapshotter logSource="pkg/plugin/clientmgmt/registry.go:100" name=velero.io/azure time="2019-08-15T18:14:53Z" level=info msg="registering plugin" command=/velero kind=VolumeSnapshotter logSource="pkg/plugin/clientmgmt/registry.go:100" name=velero.io/gcp time="2019-08-15T18:14:53Z" level=info msg="registering plugin" command=/velero kind=ObjectStore logSource="pkg/plugin/clientmgmt/registry.go:100" name=velero.io/aws time="2019-08-15T18:14:53Z" level=info msg="registering plugin" command=/velero kind=ObjectStore logSource="pkg/plugin/clientmgmt/registry.go:100" name=velero.io/azure time="2019-08-15T18:14:53Z" level=info msg="registering plugin" command=/velero kind=ObjectStore logSource="pkg/plugin/clientmgmt/registry.go:100" name=velero.io/gcp time="2019-08-15T18:14:53Z" level=info msg="registering plugin" command=/velero kind=RestoreItemAction logSource="pkg/plugin/clientmgmt/registry.go:100" name=velero.io/add-pv-from-pvc time="2019-08-15T18:14:53Z" level=info msg="registering plugin" command=/velero kind=RestoreItemAction logSource="pkg/plugin/clientmgmt/registry.go:100" name=velero.io/add-pvc-from-pod time="2019-08-15T18:14:53Z" level=info msg="registering plugin" command=/velero kind=RestoreItemAction logSource="pkg/plugin/clientmgmt/registry.go:100" name=velero.io/change-storage-class time="2019-08-15T18:14:53Z" level=info msg="registering plugin" command=/velero kind=RestoreItemAction logSource="pkg/plugin/clientmgmt/registry.go:100" name=velero.io/job time="2019-08-15T18:14:53Z" level=info msg="registering plugin" command=/velero kind=RestoreItemAction logSource="pkg/plugin/clientmgmt/registry.go:100" name=velero.io/pod time="2019-08-15T18:14:53Z" level=info msg="registering plugin" command=/velero kind=RestoreItemAction logSource="pkg/plugin/clientmgmt/registry.go:100" name=velero.io/restic time="2019-08-15T18:14:53Z" level=info msg="registering plugin" command=/velero kind=RestoreItemAction logSource="pkg/plugin/clientmgmt/registry.go:100" name=velero.io/service time="2019-08-15T18:14:53Z" level=info msg="registering plugin" command=/velero kind=RestoreItemAction logSource="pkg/plugin/clientmgmt/registry.go:100" name=velero.io/service-account time="2019-08-15T18:14:53Z" level=info msg="registering plugin" command=/plugins/velero-plugins kind=BackupItemAction logSource="pkg/plugin/clientmgmt/registry.go:100" name=openshift.io/01-common-backup-plugin time="2019-08-15T18:14:53Z" level=info msg="registering plugin" command=/plugins/velero-plugins kind=BackupItemAction logSource="pkg/plugin/clientmgmt/registry.go:100" name=openshift.io/02-pv-backup-plugin time="2019-08-15T18:14:53Z" level=info msg="registering plugin" command=/plugins/velero-plugins kind=BackupItemAction logSource="pkg/plugin/clientmgmt/registry.go:100" name=openshift.io/03-is-backup-plugin time="2019-08-15T18:14:53Z" level=info msg="registering plugin" command=/plugins/velero-plugins kind=BackupItemAction logSource="pkg/plugin/clientmgmt/registry.go:100" name=openshift.io/08-deploymentconfig-backup-plugin time="2019-08-15T18:14:53Z" level=info msg="registering plugin" command=/plugins/velero-plugins kind=BackupItemAction logSource="pkg/plugin/clientmgmt/registry.go:100" name=openshift.io/13-deployment-backup-plugin time="2019-08-15T18:14:53Z" level=info msg="registering plugin" command=/plugins/velero-plugins kind=RestoreItemAction logSource="pkg/plugin/clientmgmt/registry.go:100" name=openshift.io/01-common-restore-plugin time="2019-08-15T18:14:53Z" level=info msg="registering plugin" command=/plugins/velero-plugins kind=RestoreItemAction logSource="pkg/plugin/clientmgmt/registry.go:100" name=openshift.io/01-namespace-restore-plugin time="2019-08-15T18:14:53Z" level=info msg="registering plugin" command=/plugins/velero-plugins kind=RestoreItemAction logSource="pkg/plugin/clientmgmt/registry.go:100" name=openshift.io/02-serviceaccount-restore-plugin time="2019-08-15T18:14:53Z" level=info msg="registering plugin" command=/plugins/velero-plugins kind=RestoreItemAction logSource="pkg/plugin/clientmgmt/registry.go:100" name=openshift.io/03-is-restore-plugin time="2019-08-15T18:14:53Z" level=info msg="registering plugin" command=/plugins/velero-plugins kind=RestoreItemAction logSource="pkg/plugin/clientmgmt/registry.go:100" name=openshift.io/03-pv-restore-plugin time="2019-08-15T18:14:53Z" level=info msg="registering plugin" command=/plugins/velero-plugins kind=RestoreItemAction logSource="pkg/plugin/clientmgmt/registry.go:100" name=openshift.io/03-pvc-restore-plugin time="2019-08-15T18:14:53Z" level=info msg="registering plugin" command=/plugins/velero-plugins kind=RestoreItemAction logSource="pkg/plugin/clientmgmt/registry.go:100" name=openshift.io/04-imagestreamtag-restore-plugin time="2019-08-15T18:14:53Z" level=info msg="registering plugin" command=/plugins/velero-plugins kind=RestoreItemAction logSource="pkg/plugin/clientmgmt/registry.go:100" name=openshift.io/05-route-restore-plugin time="2019-08-15T18:14:53Z" level=info msg="registering plugin" command=/plugins/velero-plugins kind=RestoreItemAction logSource="pkg/plugin/clientmgmt/registry.go:100" name=openshift.io/06-build-restore-plugin time="2019-08-15T18:14:53Z" level=info msg="registering plugin" command=/plugins/velero-plugins kind=RestoreItemAction logSource="pkg/plugin/clientmgmt/registry.go:100" name=openshift.io/07-pod-restore-plugin time="2019-08-15T18:14:53Z" level=info msg="registering plugin" command=/plugins/velero-plugins kind=RestoreItemAction logSource="pkg/plugin/clientmgmt/registry.go:100" name=openshift.io/08-deploymentconfig-restore-plugin time="2019-08-15T18:14:53Z" level=info msg="registering plugin" command=/plugins/velero-plugins kind=RestoreItemAction logSource="pkg/plugin/clientmgmt/registry.go:100" name=openshift.io/09-replicationcontroller-restore-plugin time="2019-08-15T18:14:53Z" level=info msg="registering plugin" command=/plugins/velero-plugins kind=RestoreItemAction logSource="pkg/plugin/clientmgmt/registry.go:100" name=openshift.io/10-job-restore-plugin time="2019-08-15T18:14:53Z" level=info msg="registering plugin" command=/plugins/velero-plugins kind=RestoreItemAction logSource="pkg/plugin/clientmgmt/registry.go:100" name=openshift.io/11-daemonset-restore-plugin time="2019-08-15T18:14:53Z" level=info msg="registering plugin" command=/plugins/velero-plugins kind=RestoreItemAction logSource="pkg/plugin/clientmgmt/registry.go:100" name=openshift.io/12-replicaset-restore-plugin time="2019-08-15T18:14:53Z" level=info msg="registering plugin" command=/plugins/velero-plugins kind=RestoreItemAction logSource="pkg/plugin/clientmgmt/registry.go:100" name=openshift.io/13-deployment-restore-plugin time="2019-08-15T18:14:53Z" level=info msg="registering plugin" command=/plugins/velero-plugins kind=RestoreItemAction logSource="pkg/plugin/clientmgmt/registry.go:100" name=openshift.io/14-statefulset-restore-plugin time="2019-08-15T18:14:53Z" level=info msg="registering plugin" command=/plugins/velero-plugins kind=RestoreItemAction logSource="pkg/plugin/clientmgmt/registry.go:100" name=openshift.io/15-service-restore-plugin time="2019-08-15T18:14:53Z" level=info msg="Checking existence of namespace" logSource="pkg/cmd/server/server.go:336" namespace=velero An error occurred: namespaces "velero" not found root@ip-172-31-61-189: ~ # oc get pods NAME READY STATUS RESTARTS AGE controller-manager-55cf47c6f-7hk5w 1/1 Running 0 4m24s migration-operator-fd9458fd-k5wf9 2/2 Running 0 5m2s migration-ui-856c868685-272lr 1/1 Running 0 4m16s restic-6z6lf 1/1 Running 0 4m26s restic-kwgmv 1/1 Running 0 4m26s velero-66b6f9d5cf-k4whc 0/1 CrashLoopBackOff 5 4m26s Expected results: Controller creation should be successful Additional info:
Roshni, thanks for your bug hunting. I'm removing 'testblocker' since we have workaround (other methods to install controller+UI).
Hey @Scott, Are you able to provide any insight into what changed with Velero 1.1 that is causing this, and any workaround effort that might be in-progress? Think I recall you mentioning this issue. Also, Roshni, this is probably something that changed since this bug was reported but we are now deploying everything into the `openshift-migration` namespace instead of `mig`.
Roshni and Zihan, This issue should have been resolved by https://github.com/fusor/mig-operator/pull/41. Please clean your cluster following directions from https://github.com/fusor/mig-operator#cleanup, delete and re-create https://github.com/fusor/mig-operator/blob/master/mig-operator-source.yaml, and then deploy mig-operator into the "openshift-migration" namespace with OperatorHub + OLM. Deploying with the defaults present in the Web UI should lead to a successful deploy. apiVersion: migration.openshift.io/v1alpha1 kind: MigrationController metadata: creationTimestamp: 2019-08-27T19:43:25Z generation: 1 name: migration-controller namespace: openshift-migration resourceVersion: "4939208" selfLink: /apis/migration.openshift.io/v1alpha1/namespaces/openshift-migration/migrationcontrollers/migration-controller uid: ef6779ab-c902-11e9-8c91-0a0c514fad3a spec: cluster_name: host migration_controller: true migration_ui: true migration_velero: true olm_managed: true $ oc get pods NAME READY STATUS RESTARTS AGE controller-manager-7c9565c55d-n4kch 1/1 Running 0 16m migration-operator-699945c4b5-72fsh 2/2 Running 0 17m migration-ui-6bbf5fc8cd-rnw9k 1/1 Running 0 15m restic-dv8cc 1/1 Running 0 16m restic-sf5zr 1/1 Running 0 16m velero-57fc85c447-gbpsp 1/1 Running 0 16m
Verified on OCP 4.2 cluster and it works now. $oc get clusterversion NAME VERSION AVAILABLE PROGRESSING SINCE STATUS version 4.2.0-0.nightly-2019-08-27-222856 True False 82m Cluster version is 4.2.0-0.nightly-2019-08-27-222856 $oc get pod -n openshift-migration ✔ 2579 13:06:41 NAME READY STATUS RESTARTS AGE controller-manager-7485dfd885-985m9 1/1 Running 0 2m21s migration-operator-987b669d4-sdzgw 2/2 Running 0 2m51s migration-ui-99578967c-6bv9k 1/1 Running 0 2m12s restic-f8dbw 1/1 Running 0 2m22s restic-zjb98 1/1 Running 0 2m22s velero-77f99b46b4-26zr6 1/1 Running 0 2m22s
Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory, and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHBA-2019:2922