Running a cluster destroy command selects some default, unrelated route to be deleted for all clusters in a project. The request to delete this route is malformed and cannot finish. Associated networks and subnetworks hang on deletion. level=debug msg="Listing subnetworks" level=debug msg="Found subnetwork: ci-op-zxnf9-worker-subnet" level=debug msg="Deleting subnetwork ci-op-zxnf9-worker-subnet" level=debug msg="Subnetworks: failed to delete subnetwork ci-op-zxnf9-worker-subnet: googleapi: Error 400: The subnetwork resource 'projects/openshift-gce-devel-ci/regions/us-east1/subnetworks/ci-op-zxnf9-worker-subnet' is already being used by 'projects/openshift-gce-devel-ci/zones/us-east1-b/instances/e2e-mhc-1579900339-6tbm6', resourceInUseByAnotherResource" level=debug msg="Listing networks" level=debug msg="Found network: ci-op-zxnf9-network" level=debug msg="Listing routes" level=debug msg="Found route: default-route-135cb3565f520eea" level=debug msg="Deleting route default-route-135cb3565f520eea" level=debug msg="Failed to delete route {default-route-135cb3565f520eea default-route-135cb3565f520eea route }: failed to delete route default-route-135cb3565f520eea: googleapi: Error 400: The local route cannot be deleted., badRequest" level=debug msg="Deleting network ci-op-zxnf9-network" level=debug msg="Networks: failed to delete network ci-op-zxnf9-network with error: RESOURCE_IN_USE_BY_ANOTHER_RESOURCE: The network resource 'projects/openshift-gce-devel-ci/global/networks/ci-op-zxnf9-network' is already being used by 'projects/openshift-gce-devel-ci/zones/us-east1-b/instances/e2e-mhc-1579900339-6tbm6'"
See logs at: https://prow.svc.ci.openshift.org/view/gcs/origin-ci-test/logs/periodic-ipi-deprovision/38559#1:build-log.txt%3A108
Default routes cannot be manually deleted: they are deleted once the associated network is deleted, so these error messages are expected. These error messages are especially confusing because the dependent bug https://bugzilla.redhat.com/show_bug.cgi?id=1742227 is making the error message show up repeatedly. To satisfy this particular bug we should make the error message cleaner. In order to verify, QA should run a normal GCP cluster destroy and check that the error message has been changed as mentioned in the commit message.
Verified with 4.4.0-0.nightly-2020-02-05-093448 Steps of verification as below: 1. Install an IPI cluster on GCP 2. Manually create a VM using the network created in step #1 3. Destroy the cluster # openshift-install destroy cluster --dir=bz --log-level=debug DEBUG Listing subnetworks DEBUG Found subnetwork: yybz-p6mgt-worker-subnet DEBUG Deleting subnetwork yybz-p6mgt-worker-subnet DEBUG Subnetworks: failed to delete subnetwork yybz-p6mgt-worker-subnet: googleapi: Error 400: The subnetwork resource 'projects/openshift-qe/regions/us-central1/subnetworks/yybz-p6mgt-worker-subnet' is already being used by 'projects/openshift-qe/zones/us-central1-a/instances/yytest1', resourceInUseByAnotherResource DEBUG Listing networks DEBUG Found network: yybz-p6mgt-network DEBUG Listing routes DEBUG Found route: default-route-e6f0afc2eae0ab6b DEBUG Deleting route default-route-e6f0afc2eae0ab6b DEBUG Failed to delete route default-route-e6f0afc2eae0ab6b: this looks like a default route, which cannot be deleted manually but will be deleted with the corresponding network The error messages are as expected hence moving it to verified state.
Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory, and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHBA-2020:0581