Description of problem: There is an Alert in the OpenShift console that reads "KubeVersionMismatch: There are 2 different versions of Kubernetes components running.". This was just after installation and without any customisation from my side. Version-Release number of selected component (if applicable): How reproducible: 100% Steps to Reproduce: ``` $ openshift-install version openshift-install v0.12.0 $ openshift-install --dir=taakrsi4-demo3/ create cluster ``` Prometheus (query "kubernetes_build_info{job!="kube-dns"}") reports: ``` kubernetes_build_info{buildDate="2019-01-29T23:36:59Z",compiler="gc",endpoint="https",gitCommit="f39ab668d3",gitTreeState="clean",gitVersion="v1.12.4+f39ab668d3",goVersion="go1.10.3",instance="10.0.27.179:10251",job="scheduler",major="1",minor="12+",namespace="openshift-kube-scheduler",platform="linux/amd64",pod="openshift-kube-scheduler-ip-10-0-27-179.eu-central-1.compute.internal",service="scheduler"} 1 kubernetes_build_info{buildDate="2019-01-29T23:36:59Z",compiler="gc",endpoint="https",gitCommit="f39ab668d3",gitTreeState="clean",gitVersion="v1.12.4+f39ab668d3",goVersion="go1.10.3",instance="10.0.27.179:10252",job="kube-controller-manager",major="1",minor="12+",namespace="openshift-kube-controller-manager",platform="linux/amd64",pod="openshift-kube-controller-manager-ip-10-0-27-179.eu-central-1.compute.internal",service="kube-controller-manager"} 1 kubernetes_build_info{buildDate="2019-01-29T23:36:59Z",compiler="gc",endpoint="https",gitCommit="f39ab668d3",gitTreeState="clean",gitVersion="v1.12.4+f39ab668d3",goVersion="go1.10.3",instance="10.0.47.122:10251",job="scheduler",major="1",minor="12+",namespace="openshift-kube-scheduler",platform="linux/amd64",pod="openshift-kube-scheduler-ip-10-0-47-122.eu-central-1.compute.internal",service="scheduler"} 1 kubernetes_build_info{buildDate="2019-01-29T23:36:59Z",compiler="gc",endpoint="https",gitCommit="f39ab668d3",gitTreeState="clean",gitVersion="v1.12.4+f39ab668d3",goVersion="go1.10.3",instance="10.0.47.122:10252",job="kube-controller-manager",major="1",minor="12+",namespace="openshift-kube-controller-manager",platform="linux/amd64",pod="openshift-kube-controller-manager-ip-10-0-47-122.eu-central-1.compute.internal",service="kube-controller-manager"} 1 kubernetes_build_info{buildDate="2019-01-29T23:36:59Z",compiler="gc",endpoint="https",gitCommit="f39ab668d3",gitTreeState="clean",gitVersion="v1.12.4+f39ab668d3",goVersion="go1.10.3",instance="10.0.9.56:10251",job="scheduler",major="1",minor="12+",namespace="openshift-kube-scheduler",platform="linux/amd64",pod="openshift-kube-scheduler-ip-10-0-9-56.eu-central-1.compute.internal",service="scheduler"} 1 kubernetes_build_info{buildDate="2019-01-29T23:36:59Z",compiler="gc",endpoint="https",gitCommit="f39ab668d3",gitTreeState="clean",gitVersion="v1.12.4+f39ab668d3",goVersion="go1.10.3",instance="10.0.9.56:10252",job="kube-controller-manager",major="1",minor="12+",namespace="openshift-kube-controller-manager",platform="linux/amd64",pod="openshift-kube-controller-manager-ip-10-0-9-56.eu-central-1.compute.internal",service="kube-controller-manager"} 1 kubernetes_build_info{buildDate="2019-02-01T23:06:11Z",compiler="gc",endpoint="https-metrics",gitCommit="91d94b671b",gitTreeState="clean",gitVersion="v1.12.4+91d94b671b",goVersion="go1.10.3",instance="10.0.135.74:10250",job="kubelet",major="1",minor="12+",namespace="kube-system",node="ip-10-0-135-74.eu-central-1.compute.internal",platform="linux/amd64",service="kubelet"} 1 kubernetes_build_info{buildDate="2019-02-01T23:06:11Z",compiler="gc",endpoint="https-metrics",gitCommit="91d94b671b",gitTreeState="clean",gitVersion="v1.12.4+91d94b671b",goVersion="go1.10.3",instance="10.0.145.112:10250",job="kubelet",major="1",minor="12+",namespace="kube-system",node="ip-10-0-145-112.eu-central-1.compute.internal",platform="linux/amd64",service="kubelet"} 1 kubernetes_build_info{buildDate="2019-02-01T23:06:11Z",compiler="gc",endpoint="https-metrics",gitCommit="91d94b671b",gitTreeState="clean",gitVersion="v1.12.4+91d94b671b",goVersion="go1.10.3",instance="10.0.161.79:10250",job="kubelet",major="1",minor="12+",namespace="kube-system",node="ip-10-0-161-79.eu-central-1.compute.internal",platform="linux/amd64",service="kubelet"} 1 kubernetes_build_info{buildDate="2019-02-01T23:06:11Z",compiler="gc",endpoint="https-metrics",gitCommit="91d94b671b",gitTreeState="clean",gitVersion="v1.12.4+91d94b671b",goVersion="go1.10.3",instance="10.0.27.179:10250",job="kubelet",major="1",minor="12+",namespace="kube-system",node="ip-10-0-27-179.eu-central-1.compute.internal",platform="linux/amd64",service="kubelet"} 1 kubernetes_build_info{buildDate="2019-02-01T23:06:11Z",compiler="gc",endpoint="https-metrics",gitCommit="91d94b671b",gitTreeState="clean",gitVersion="v1.12.4+91d94b671b",goVersion="go1.10.3",instance="10.0.47.122:10250",job="kubelet",major="1",minor="12+",namespace="kube-system",node="ip-10-0-47-122.eu-central-1.compute.internal",platform="linux/amd64",service="kubelet"} 1 kubernetes_build_info{buildDate="2019-02-01T23:06:11Z",compiler="gc",endpoint="https-metrics",gitCommit="91d94b671b",gitTreeState="clean",gitVersion="v1.12.4+91d94b671b",goVersion="go1.10.3",instance="10.0.9.56:10250",job="kubelet",major="1",minor="12+",namespace="kube-system",node="ip-10-0-9-56.eu-central-1.compute.internal",platform="linux/amd64",service="kubelet"} ``` Actual results: There are lot of waring of kubeversion mismatch due to different git Versions Expected results: A newly installed cluster does not show any open alerts out-of-the-box
Yes, it had this issue before, but should not be a monitoring issue, we just throw out the alerts, anyway, there is not such issue with 4.0.0-0.nightly-2019-02-28-054829 The payload you use maybe too old check via # oc get clusterversion
We should be resolved as of February 7th thanks to https://github.com/openshift/cluster-monitoring-operator/pull/235. If we are still seeing this issue today, then it is a bug in the alerting rule. Junqi, can you please verify if the alert is still showing today? -Lucas
Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory, and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHBA-2019:0758