Created attachment 1806335 [details] openshift_install.log Created attachment 1806335 [details] openshift_install.log Version: 4.9.0-0.nightly-2021-07-26-220837 $ openshift-install version openshift-install 4.9.0-0.nightly-2021-07-26-220837 built from commit 3ddd241312c90a83f8200c34bef0399e2b31d8cf release image registry.ci.openshift.org/ocp/release@sha256:174648ea613381880c5f75c63e5dac78e330473ad93a530e434866c49e690a56 Platform: GCP Please specify: IPI (automated install with `openshift-install`. If you don't know, then it's IPI) What happened? time="2021-07-27T11:02:15Z" level=error msg="Error: No value for required variable" time="2021-07-27T11:02:15Z" level=error time="2021-07-27T11:02:15Z" level=error msg=" on ../../tmp/openshift-install-post-bootstrap-167363168/variables.tf line 33:" time="2021-07-27T11:02:15Z" level=error msg=" 33: variable \"cluster_public_ip\" {" time="2021-07-27T11:02:15Z" level=error time="2021-07-27T11:02:15Z" level=error msg="The root module input variable \"cluster_public_ip\" is not set, and has no" time="2021-07-27T11:02:15Z" level=error msg="default value. Use a -var or -var-file command line argument to provide a" time="2021-07-27T11:02:15Z" level=error msg="value for this variable." time="2021-07-27T11:02:15Z" level=error time="2021-07-27T11:02:15Z" level=error msg="Failed to read tfstate: open /tmp/openshift-install-post-bootstrap-167363168/terraform.post-bootstrap.tfstate: no such file or directory" time="2021-07-27T11:02:15Z" level=fatal msg="failed to fetch Cluster: failed to generate asset \"Cluster\": failed to create cluster: failed to apply Terraform: failed to complete the change" What did you expect to happen? The IPI installation a private cluster on GCP should succeed. How to reproduce it (as minimally and precisely as possible)? Always. In install-config, set publish: Internal
Created attachment 1806371 [details] [OCP 4.8.0] openshift_install.log > FYI I tried the same installation scenario, i.e. installing a private cluster on GCP, with OCP 4.8.0, which succeeded finally. > [cloud-user@jiwei-rhel8-mirror ~]$ openshift-install version openshift-install 4.8.0 built from commit a5ddd2dd6c72d8a5ea0a5f17acd8b964b6a3d1be release image registry.ci.openshift.org/ocp/release@sha256:56dc7d529400ff7ee2eb1c50f14352fb0773ed9f3a2d24383507188ceb98900a > [cloud-user@jiwei-rhel8-mirror ~]$ openshift-install create cluster --dir=work --log-level=info INFO Credentials loaded from gcloud CLI defaults INFO Consuming Install Config from target directory INFO Creating infrastructure resources... INFO Waiting up to 20m0s for the Kubernetes API at https://api.jiwei-cluster08.jiwei.qe.gcp.devcluster.openshift.com:6443... INFO API v1.21.1+f36aa36 up INFO Waiting up to 30m0s for bootstrapping to complete... INFO Destroying the bootstrap resources... INFO Waiting up to 40m0s for the cluster at https://api.jiwei-cluster08.jiwei.qe.gcp.devcluster.openshift.com:6443 to initialize... INFO Waiting up to 10m0s for the openshift-console route to be created... INFO Install complete! INFO To access the cluster as the system:admin user when using 'oc', run 'export KUBECONFIG=/home/cloud-user/work/auth/kubeconfig' INFO Access the OpenShift web-console here: https://console-openshift-console.apps.jiwei-cluster08.jiwei.qe.gcp.devcluster.openshift.com INFO Login to the console with user: "kubeadmin", and password: "ETaMJ-ZEg3a-3dPku-uYczV" INFO Time elapsed: 30m58s > [cloud-user@jiwei-rhel8-mirror ~]$ export KUBECONFIG=/home/cloud-user/work/auth/kubeconfig > [cloud-user@jiwei-rhel8-mirror ~]$ oc get clusterversion NAME VERSION AVAILABLE PROGRESSING SINCE STATUS version 4.8.0 True False 7m35s Cluster version is 4.8.0 > [cloud-user@jiwei-rhel8-mirror ~]$ oc get nodes -o wide NAME STATUS ROLES AGE VERSION INTERNAL-IP EXTERNAL-IP OS-IMAGE KERNEL-VERSION CONTAINER-RUNTIME jiwei-cluster08-dhrlr-master-0.c.openshift-qe.internal Ready master 27m v1.21.1+f36aa36 10.138.1.5 <none> Red Hat Enterprise Linux CoreOS 48.84.202107040900-0 (Ootpa) 4.18.0-305.7.1.el8_4.x86_64 cri-o://1.21.1-12.rhaos4.8.git30ca719.el8 jiwei-cluster08-dhrlr-master-1.c.openshift-qe.internal Ready master 27m v1.21.1+f36aa36 10.138.1.6 <none> Red Hat Enterprise Linux CoreOS 48.84.202107040900-0 (Ootpa) 4.18.0-305.7.1.el8_4.x86_64 cri-o://1.21.1-12.rhaos4.8.git30ca719.el8 jiwei-cluster08-dhrlr-master-2.c.openshift-qe.internal Ready master 27m v1.21.1+f36aa36 10.138.1.7 <none> Red Hat Enterprise Linux CoreOS 48.84.202107040900-0 (Ootpa) 4.18.0-305.7.1.el8_4.x86_64 cri-o://1.21.1-12.rhaos4.8.git30ca719.el8 jiwei-cluster08-dhrlr-worker-a-sgz52.c.openshift-qe.internal Ready worker 20m v1.21.1+f36aa36 10.138.2.2 <none> Red Hat Enterprise Linux CoreOS 48.84.202107040900-0 (Ootpa) 4.18.0-305.7.1.el8_4.x86_64 cri-o://1.21.1-12.rhaos4.8.git30ca719.el8 jiwei-cluster08-dhrlr-worker-b-bmvkd.c.openshift-qe.internal Ready worker 20m v1.21.1+f36aa36 10.138.2.3 <none> Red Hat Enterprise Linux CoreOS 48.84.202107040900-0 (Ootpa) 4.18.0-305.7.1.el8_4.x86_64 cri-o://1.21.1-12.rhaos4.8.git30ca719.el8 jiwei-cluster08-dhrlr-worker-c-drnjg.c.openshift-qe.internal Ready worker 20m v1.21.1+f36aa36 10.138.2.4 <none> Red Hat Enterprise Linux CoreOS 48.84.202107040900-0 (Ootpa) 4.18.0-305.7.1.el8_4.x86_64 cri-o://1.21.1-12.rhaos4.8.git30ca719.el8 > [cloud-user@jiwei-rhel8-mirror ~]$ gcloud dns managed-zones list | grep jiwei jiwei jiwei.qe.gcp.devcluster.openshift.com. Jianli Wei test zone public jiwei-cluster08-dhrlr-private-zone jiwei-cluster08.jiwei.qe.gcp.devcluster.openshift.com. Created By OpenShift Installer private jiwei-cluster08-zc9cb-private-zone jiwei-cluster08.jiwei.qe.gcp.devcluster.openshift.com. Created By OpenShift Installer private [cloud-user@jiwei-rhel8-mirror ~]$
Created attachment 1806372 [details] please ignore it
The content of attachment 1806372 [details] has been deleted for the following reason: Requested in TASK1012616
> Tested the installation scenario (i.e. private cluster on GCP) at 4.9.0-0.nightly-2021-07-28-071556, the installation succeeded. So mark as verified. > [root@jiwei-072803-2vvwf-master-0 core]# oc get nodes -o wide NAME STATUS ROLES AGE VERSION INTERNAL-IP EXTERNAL-IP OS-IMAGE KERNEL-VERSION CONTAINER-RUNTIME jiwei-072803-2vvwf-master-0.c.openshift-qe.internal Ready master 86m v1.21.1+8268f88 10.0.0.5 <none> Red Hat Enterprise Linux CoreOS 49.84.202107220219-0 (Ootpa) 4.18.0-305.10.2.el8_4.x86_64 cri-o://1.22.0-10.rhaos4.9.gite06cce2.el8 jiwei-072803-2vvwf-master-1.c.openshift-qe.internal Ready master 86m v1.21.1+8268f88 10.0.0.6 <none> Red Hat Enterprise Linux CoreOS 49.84.202107220219-0 (Ootpa) 4.18.0-305.10.2.el8_4.x86_64 cri-o://1.22.0-10.rhaos4.9.gite06cce2.el8 jiwei-072803-2vvwf-master-2.c.openshift-qe.internal Ready master 87m v1.21.1+8268f88 10.0.0.4 <none> Red Hat Enterprise Linux CoreOS 49.84.202107220219-0 (Ootpa) 4.18.0-305.10.2.el8_4.x86_64 cri-o://1.22.0-10.rhaos4.9.gite06cce2.el8 jiwei-072803-2vvwf-worker-a-r4b77.c.openshift-qe.internal Ready worker 80m v1.21.1+8268f88 10.0.128.2 <none> Red Hat Enterprise Linux CoreOS 49.84.202107220219-0 (Ootpa) 4.18.0-305.10.2.el8_4.x86_64 cri-o://1.22.0-10.rhaos4.9.gite06cce2.el8 jiwei-072803-2vvwf-worker-b-lptdv.c.openshift-qe.internal Ready worker 80m v1.21.1+8268f88 10.0.128.3 <none> Red Hat Enterprise Linux CoreOS 49.84.202107220219-0 (Ootpa) 4.18.0-305.10.2.el8_4.x86_64 cri-o://1.22.0-10.rhaos4.9.gite06cce2.el8 jiwei-072803-2vvwf-worker-c-9w7p4.c.openshift-qe.internal Ready worker 80m v1.21.1+8268f88 10.0.128.4 <none> Red Hat Enterprise Linux CoreOS 49.84.202107220219-0 (Ootpa) 4.18.0-305.10.2.el8_4.x86_64 cri-o://1.22.0-10.rhaos4.9.gite06cce2.el8 [root@jiwei-072803-2vvwf-master-0 core]# > [fedora@preserve-jiwei ~]$ gcloud dns managed-zones list | grep jiwei-072803 jiwei-072803-2vvwf-private-zone jiwei-072803.qe.gcp.devcluster.openshift.com. Created By OpenShift Installer private [fedora@preserve-jiwei ~]$
Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory (Moderate: OpenShift Container Platform 4.9.0 bug fix and security update), and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHSA-2021:3759