Bug 1814054 - Ensure that OpenStack cloud provider is initialized before making a call
Summary: Ensure that OpenStack cloud provider is initialized before making a call
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: OpenShift Container Platform
Classification: Red Hat
Component: Cloud Compute
Version: 4.5
Hardware: Unspecified
OS: Unspecified
urgent
urgent
Target Milestone: ---
: 4.5.0
Assignee: Mike Fedosin
QA Contact: sunzhaohua
URL:
Whiteboard:
: 1814074 1821017 (view as bug list)
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2020-03-16 21:41 UTC by Maru Newby
Modified: 2020-08-27 22:35 UTC (History)
6 users (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2020-08-27 22:35:17 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Github openshift origin pull 24834 0 None closed Bug 1814054: UPSTREAM: 89885: allow to read openstack cloud provider config from a secret 2020-09-29 12:23:17 UTC

Description Maru Newby 2020-03-16 21:41:56 UTC
openshift/kubernetes in 4.4 carried the following commit to ensure that the openstack cloud provider was initialized properly:

https://github.com/openshift/kubernetes/commit/e3cb8efcc402524f75214c93820f238fb7f8e0d1

This commit was not carried over for 4.5 with the expectation that a fix be proposed that does not involve a perpetual downstream carry.

Comment 1 Ryan Phillips 2020-03-26 15:37:40 UTC
Cloud compute owns openstack cloud provider.

Comment 2 Stefan Schimanski 2020-04-06 08:45:55 UTC
*** Bug 1821017 has been marked as a duplicate of this bug. ***

Comment 3 Mike Fedosin 2020-04-06 15:49:06 UTC
*** Bug 1814074 has been marked as a duplicate of this bug. ***

Comment 6 sunzhaohua 2020-04-10 12:06:49 UTC
Verified
clusterversion: 4.5.0-0.nightly-2020-04-10-030549
no met such errors: F0405 04:39:15.935713       1 controllermanager.go:238] error building controller context: cloud provider could not be initialized: could not init cloud provider "openstack": failed to get kubernetes client: invalid configuration: no configuration has been provided, try setting 

$ oc logs -f kube-controller-manager-zhsun410osp-q9b9n-master-0 -n openshift-kube-controller-manager
I0410 07:39:17.359920       1 flags.go:33] FLAG: --min-resync-period="12h0m0s"
I0410 07:39:17.359923       1 flags.go:33] FLAG: --node-monitor-period="5s"
I0410 07:39:17.359925       1 flags.go:33] FLAG: --node-sync-period="0s"
I0410 07:39:17.359928       1 flags.go:33] FLAG: --route-reconciliation-period="10s"
I0410 07:39:17.359930       1 flags.go:33] FLAG: --use-service-account-credentials="true"
I0410 07:39:17.367110       1 dynamic_serving_content.go:111] Loaded a new cert/key pair for "serving-cert::/etc/kubernetes/static-pod-resources/secrets/serving-cert/tls.crt::/etc/kubernetes/static-pod-resources/secrets/serving-cert/tls.key"
I0410 07:39:17.558833       1 dynamic_cafile_content.go:129] Loaded a new CA Bundle and Verifier for "client-ca-bundle::/etc/kubernetes/static-pod-certs/configmaps/client-ca/ca-bundle.crt"
I0410 07:39:17.558942       1 dynamic_cafile_content.go:129] Loaded a new CA Bundle and Verifier for "request-header::/etc/kubernetes/static-pod-certs/configmaps/aggregator-client-ca/ca-bundle.crt"
I0410 07:39:17.564505       1 controllermanager.go:169] Version: v1.18.0-rc.1
I0410 07:39:17.565214       1 dynamic_cafile_content.go:167] Starting request-header::/etc/kubernetes/static-pod-certs/configmaps/aggregator-client-ca/ca-bundle.crt
I0410 07:39:17.565229       1 dynamic_cafile_content.go:167] Starting client-ca-bundle::/etc/kubernetes/static-pod-certs/configmaps/client-ca/ca-bundle.crt
I0410 07:39:17.565485       1 dynamic_serving_content.go:130] Starting serving-cert::/etc/kubernetes/static-pod-resources/secrets/serving-cert/tls.crt::/etc/kubernetes/static-pod-resources/secrets/serving-cert/tls.key
I0410 07:39:17.565752       1 tlsconfig.go:178] loaded client CA [0/"client-ca-bundle::/etc/kubernetes/static-pod-certs/configmaps/client-ca/ca-bundle.crt,request-header::/etc/kubernetes/static-pod-certs/configmaps/aggregator-client-ca/ca-bundle.crt"]: "admin-kubeconfig-signer" [] issuer="<self>" (2020-04-10 05:38:38 +0000 UTC to 2030-04-08 05:38:38 +0000 UTC (now=2020-04-10 07:39:17.565711514 +0000 UTC))
I0410 07:39:17.565777       1 tlsconfig.go:178] loaded client CA [1/"client-ca-bundle::/etc/kubernetes/static-pod-certs/configmaps/client-ca/ca-bundle.crt,request-header::/etc/kubernetes/static-pod-certs/configmaps/aggregator-client-ca/ca-bundle.crt"]: "kube-csr-signer_@1586499222" [] issuer="kubelet-signer" (2020-04-10 06:13:42 +0000 UTC to 2020-04-11 05:38:47 +0000 UTC (now=2020-04-10 07:39:17.565770804 +0000 UTC))
I0410 07:39:17.565790       1 tlsconfig.go:178] loaded client CA [2/"client-ca-bundle::/etc/kubernetes/static-pod-certs/configmaps/client-ca/ca-bundle.crt,request-header::/etc/kubernetes/static-pod-certs/configmaps/aggregator-client-ca/ca-bundle.crt"]: "kubelet-signer" [] issuer="<self>" (2020-04-10 05:38:47 +0000 UTC to 2020-04-11 05:38:47 +0000 UTC (now=2020-04-10 07:39:17.565784758 +0000 UTC))
I0410 07:39:17.565809       1 tlsconfig.go:178] loaded client CA [3/"client-ca-bundle::/etc/kubernetes/static-pod-certs/configmaps/client-ca/ca-bundle.crt,request-header::/etc/kubernetes/static-pod-certs/configmaps/aggregator-client-ca/ca-bundle.crt"]: "kube-apiserver-to-kubelet-signer" [] issuer="<self>" (2020-04-10 05:38:48 +0000 UTC to 2021-04-10 05:38:48 +0000 UTC (now=2020-04-10 07:39:17.565804249 +0000 UTC))
I0410 07:39:17.565821       1 tlsconfig.go:178] loaded client CA [4/"client-ca-bundle::/etc/kubernetes/static-pod-certs/configmaps/client-ca/ca-bundle.crt,request-header::/etc/kubernetes/static-pod-certs/configmaps/aggregator-client-ca/ca-bundle.crt"]: "kube-control-plane-signer" [] issuer="<self>" (2020-04-10 05:38:48 +0000 UTC to 2021-04-10 05:38:48 +0000 UTC (now=2020-04-10 07:39:17.565815716 +0000 UTC))
I0410 07:39:17.565832       1 tlsconfig.go:178] loaded client CA [5/"client-ca-bundle::/etc/kubernetes/static-pod-certs/configmaps/client-ca/ca-bundle.crt,request-header::/etc/kubernetes/static-pod-certs/configmaps/aggregator-client-ca/ca-bundle.crt"]: "kubelet-bootstrap-kubeconfig-signer" [] issuer="<self>" (2020-04-10 05:38:41 +0000 UTC to 2030-04-08 05:38:41 +0000 UTC (now=2020-04-10 07:39:17.565827041 +0000 UTC))
I0410 07:39:17.565842       1 tlsconfig.go:178] loaded client CA [6/"client-ca-bundle::/etc/kubernetes/static-pod-certs/configmaps/client-ca/ca-bundle.crt,request-header::/etc/kubernetes/static-pod-certs/configmaps/aggregator-client-ca/ca-bundle.crt"]: "aggregator-signer" [] issuer="<self>" (2020-04-10 05:38:42 +0000 UTC to 2020-04-11 05:38:42 +0000 UTC (now=2020-04-10 07:39:17.565837729 +0000 UTC))
I0410 07:39:17.566014       1 tlsconfig.go:200] loaded serving cert ["serving-cert::/etc/kubernetes/static-pod-resources/secrets/serving-cert/tls.crt::/etc/kubernetes/static-pod-resources/secrets/serving-cert/tls.key"]: "kube-controller-manager.openshift-kube-controller-manager.svc" [serving] validServingFor=[kube-controller-manager.openshift-kube-controller-manager.svc,kube-controller-manager.openshift-kube-controller-manager.svc.cluster.local] issuer="openshift-service-serving-signer@1586499224" (2020-04-10 06:14:01 +0000 UTC to 2022-04-10 06:14:02 +0000 UTC (now=2020-04-10 07:39:17.566005043 +0000 UTC))
I0410 07:39:17.566164       1 named_certificates.go:53] loaded SNI cert [0/"self-signed loopback"]: "apiserver-loopback-client@1586504357" [serving] validServingFor=[apiserver-loopback-client] issuer="apiserver-loopback-client-ca@1586504357" (2020-04-10 06:39:17 +0000 UTC to 2021-04-10 06:39:17 +0000 UTC (now=2020-04-10 07:39:17.56615704 +0000 UTC))
I0410 07:39:17.566194       1 secure_serving.go:178] Serving securely on [::]:10257
I0410 07:39:17.566217       1 tlsconfig.go:240] Starting DynamicServingCertificateController
I0410 07:39:17.566232       1 leaderelection.go:242] attempting to acquire leader lease  kube-system/kube-controller-manager...
E0410 09:01:51.053152       1 leaderelection.go:320] error retrieving resource lock kube-system/kube-controller-manager: etcdserver: request timed out
E0410 09:35:50.302348       1 leaderelection.go:320] error retrieving resource lock kube-system/kube-controller-manager: Get https://localhost:6443/api/v1/namespaces/kube-system/configmaps/kube-controller-manager?timeout=10s: net/http: request canceled (Client.Timeout exceeded while awaiting headers)
E0410 09:36:00.461393       1 leaderelection.go:320] error retrieving resource lock kube-system/kube-controller-manager: etcdserver: leader changed
I0410 09:36:21.030486       1 leaderelection.go:252] successfully acquired lease kube-system/kube-controller-manager
I0410 09:36:21.030814       1 event.go:278] Event(v1.ObjectReference{Kind:"ConfigMap", Namespace:"kube-system", Name:"kube-controller-manager", UID:"f8eda91d-ad78-497a-8bef-73147430e6ac", APIVersion:"v1", ResourceVersion:"75639", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' zhsun410osp-q9b9n-master-1_4b904b44-9f4f-4e8a-bf85-4b4516c01d3a became leader
I0410 09:36:21.031803       1 controllermanager.go:218] using dynamic client builder
W0410 09:36:21.058860       1 plugins.go:115] WARNING: openstack built-in cloud provider is now deprecated. Please use 'external' cloud provider for openstack: https://github.com/kubernetes/cloud-provider-openstack
E0410 09:36:21.081236       1 openstack.go:284] Cannot get secret openstack-credentials in namespace kube-system. error: "secret \"openstack-credentials\" not found"
I0410 09:36:21.081266       1 controllermanager.go:538] Starting "route"
I0410 09:36:21.081277       1 core.go:239] Will not configure cloud provider routes for allocate-node-cidrs: false, configure-cloud-routes: true.
W0410 09:36:21.081282       1 controllermanager.go:545] Skipping "route"
I0410 09:36:21.081285       1 controllermanager.go:538] Starting "replicationcontroller"
I0410 09:36:21.081557       1 reflector.go:175] Starting reflector *v1.Secret (10m0s) from k8s.io/client-go/informers/factory.go:135
I0410 09:36:21.081758       1 shared_informer.go:223] Waiting for caches to sync for tokens
I0410 09:36:21.081866       1 reflector.go:175] Starting reflector *v1.ServiceAccount (10m0s) from k8s.io/client-go/informers/factory.go:135
I0410 09:36:21.089570       1 controllermanager.go:553] Started "replicationcontroller"
I0410 09:36:21.089589       1 controllermanager.go:538] Starting "replicaset"
I0410 09:36:21.090402       1 replica_set.go:181] Starting replicationcontroller controller
I0410 09:36:21.090410       1 shared_informer.go:223] Waiting for caches to sync for ReplicationController
I0410 09:36:21.094623       1 controllermanager.go:553] Started "replicaset"
W0410 09:36:21.094650       1 controllermanager.go:532] "ttl" is disabled
I0410 09:36:21.094655       1 controllermanager.go:538] Starting "nodeipam"
W0410 09:36:21.094660       1 controllermanager.go:545] Skipping "nodeipam"
I0410 09:36:21.094664       1 controllermanager.go:538] Starting "pvc-protection"
I0410 09:36:21.094698       1 replica_set.go:181] Starting replicaset controller
I0410 09:36:21.094704       1 shared_informer.go:223] Waiting for caches to sync for ReplicaSet
I0410 09:36:21.098105       1 controllermanager.go:553] Started "pvc-protection"
I0410 09:36:21.098122       1 controllermanager.go:538] Starting "ttl-after-finished"
W0410 09:36:21.098128       1 controllermanager.go:545] Skipping "ttl-after-finished"
I0410 09:36:21.098132       1 controllermanager.go:538] Starting "root-ca-cert-publisher"
W0410 09:36:21.098140       1 controllermanager.go:545] Skipping "root-ca-cert-publisher"
I0410 09:36:21.098145       1 controllermanager.go:538] Starting "resourcequota"
I0410 09:36:21.098193       1 pvc_protection_controller.go:101] Starting PVC protection controller
I0410 09:36:21.098200       1 shared_informer.go:223] Waiting for caches to sync for PVC protection
I0410 09:36:21.154132       1 resource_quota_monitor.go:228] QuotaMonitor created object count evaluator for templates.template.openshift.io

Comment 7 Luke Meyer 2020-08-27 22:35:17 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2020:2409'


Note You need to log in before you can comment on or make changes to this bug.