Bug 1710293

Summary:	Wrong storage prefix for kubernetes resources in etcd
Product:	OpenShift Container Platform	Reporter:	Maciej Szulik <maszulik>
Component:	Master	Assignee:	Michal Fojtik <mfojtik>
Status:	CLOSED ERRATA	QA Contact:	Xingxing Xia <xxia>
Severity:	urgent	Docs Contact:
Priority:	urgent
Version:	4.1.0	CC:	aos-bugs, gblomqui, jokerman, mmccomas, sponnaga, vlaad
Target Milestone:	---	Keywords:	BetaBlocker
Target Release:	4.1.0
Hardware:	Unspecified
OS:	Unspecified
Whiteboard:
Fixed In Version:		Doc Type:	If docs needed, set a value
Doc Text:		Story Points:	---
Clone Of:		Environment:
Last Closed:	2019-06-04 10:48:48 UTC	Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:

Description Maciej Szulik 2019-05-15 09:34:01 UTC

Description of problem:
Kubernetes resources are stored with wrong prefix, openshift.io instead of the default kubernetes.io The problem is here: https://github.com/openshift/cluster-kube-apiserver-operator/blob/7ccbe08cca0490f722f635345df7da9072db53ba/bindata/v4.1.0/kube-apiserver/defaultconfig.yaml#L111 this should never be set since we have defaulting in place for k8s in https://github.com/openshift/origin/blob/7599337aeefb8314f9b5bb832b42639d4e28ce26/pkg/cmd/openshift-kube-apiserver/configdefault/kubecontrolplane_default.go#L58 and origin in https://github.com/openshift/origin/blob/7599337aeefb8314f9b5bb832b42639d4e28ce26/pkg/cmd/openshift-kube-apiserver/configdefault/openshiftcontrolplane_default.go#L9

Comment 1 Maciej Szulik 2019-05-15 09:41:09 UTC

Fixes in:

master: https://github.com/openshift/cluster-kube-apiserver-operator/pull/475
4.1: https://github.com/openshift/cluster-kube-apiserver-operator/pull/476

Comment 3 Xingxing Xia 2019-05-16 06:47:37 UTC

First check the issue in old payload env 4.1.0-0.nightly-2019-05-14-202907:
Check /etc/kubernetes/static-pod-resources/configmaps/config/config.yaml, there is "storagePrefix":"openshift.io".
Then check etcd resources:
$ oc rsh -n openshift-etcd etcd-member-ip-10-0-140-235.ap-south-1.compute.internal
sh-4.2# export ETCDCTL_API=3 ETCDCTL_CACERT=/etc/ssl/etcd/ca.crt ETCDCTL_CERT=`ls /etc/ssl/etcd/*etcd-peer*crt` ETCDCTL_KEY=`ls /etc/ssl/etcd/*etcd-peer*key`
sh-4.2# etcdctl get / --endpoints 127.0.0.1:2379 --prefix --keys-only | grep "^/kubernetes.io/" # get nothing

Then check the issue in latest payload 4.1.0-0.nightly-2019-05-16-001402, /etc/kubernetes/static-pod-resources/configmaps/config/config.yaml doesn't have "storagePrefix":"openshift.io", `etcdctl get / --endpoints 127.0.0.1:2379 --prefix --keys-only` shows both /kubernetes.io/ resources and /openshift.io/ resources correctly.

Comment 5 errata-xmlrpc 2019-06-04 10:48:48 UTC

Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2019:0758