Bug 2077599

Summary: OCP should alert users if they are on vsphere version <7.0.2
Product: OpenShift Container Platform Reporter: Hemant Kumar <hekumar>
Component: StorageAssignee: Jan Safranek <jsafrane>
Storage sub component: Operators QA Contact: Wei Duan <wduan>
Status: CLOSED ERRATA Docs Contact:
Severity: medium    
Priority: medium CC: aos-bugs, jsafrane, julim, pewang, racedoro
Version: 4.11   
Target Milestone: ---   
Target Release: 4.11.0   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2022-08-10 11:08:03 UTC Type: ---
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Hemant Kumar 2022-04-21 17:31:38 UTC
OCP should alert users if they are on vsphere version <7.0.2

Comment 1 Jan Safranek 2022-04-22 14:09:37 UTC
IMO we already have a metric in vsphere-problem-detector that reports vCenter version and ESXI versions, we just need an alert for that.

Comment 4 Wei Duan 2022-05-24 07:17:32 UTC
There is some issue on our 6.7 vSphere env, no successful installation now.

Comment 5 Wei Duan 2022-05-31 00:49:55 UTC
Blocked by https://bugzilla.redhat.com/show_bug.cgi?id=2089153, hit twice in 6.7 vSphere env.

Comment 6 Wei Duan 2022-06-08 11:47:18 UTC
Verified failed on vSphere 6.7.2, there is no alert raised.

vsphere_esxi_version_total metric shows 6.7.2.
$ oc -n openshift-monitoring exec -c prometheus prometheus-k8s-0 -- curl -k -H "Authorization: Bearer $token" 'https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/query?query=vsphere_esxi_version_total' | jq
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100   484    0   484    0     0  32266      0 --:--:-- --:--:-- --:--:-- 32266
{
  "status": "success",
  "data": {
    "resultType": "vector",
    "result": [
      {
        "metric": {
          "__name__": "vsphere_esxi_version_total",
          "api_version": "6.7.2",
          "container": "vsphere-problem-detector-operator",
          "endpoint": "vsphere-metrics",
          "instance": "10.128.0.20:8444",
          "job": "vsphere-problem-detector-metrics",
          "namespace": "openshift-cluster-storage-operator",
          "pod": "vsphere-problem-detector-operator-bd996dcc4-jh49m",
          "service": "vsphere-problem-detector-metrics",
          "version": "6.7.0"
        },
        "value": [
          1654688161.732,
          "1"
        ]
      }
    ]
  }
}



There is no alert(VSphereOlderVCenterPresent) raised 
$ oc -n openshift-monitoring exec -c prometheus prometheus-k8s-0 -- curl -k -H "Authorization: Bearer $token" 'https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/alerts' | jq -r '.data.alerts[] | {alertname: .labels.alertname, state: .state}'
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100  5130    0  5130    0     0   333k      0 --:--:-- --:--:-- --:--:--  357k
{
  "alertname": "ClusterNotUpgradeable",
  "state": "firing"
}
{
  "alertname": "AlertmanagerReceiversNotConfigured",
  "state": "firing"
}
{
  "alertname": "Watchdog",
  "state": "firing"
}
{
  "alertname": "CannotRetrieveUpdates",
  "state": "firing"
}
{
  "alertname": "SimpleContentAccessNotAvailable",
  "state": "firing"
}
{
  "alertname": "etcdGRPCRequestsSlow",
  "state": "pending"
}
{
  "alertname": "etcdGRPCRequestsSlow",
  "state": "pending"
}

Comment 9 Wei Duan 2022-06-23 06:15:32 UTC
Verified pass on 4.11.0-0.nightly-2022-06-22-190830.

{
  "labels": {
    "alertname": "VSphereOlderVCenterPresent",
    "api_version": "6.7.3",
    "container": "vsphere-problem-detector-operator",
    "endpoint": "vsphere-metrics",
    "instance": "10.130.0.5:8444",
    "job": "vsphere-problem-detector-metrics",
    "namespace": "openshift-cluster-storage-operator",
    "pod": "vsphere-problem-detector-operator-bd996dcc4-l95jv",
    "service": "vsphere-problem-detector-metrics",
    "severity": "info",
    "uuid": "ca4c444d-ecb1-4cad-aaca-4e068e88e6f8",
    "version": "6.7.0"
  },
  "annotations": {
    "description": "The cluster is using vCenter version less than 7.0.2, which is being deprecated by Openshift. A future version of\nOpenshift will remove support for vCenter versions lest than 7.0.2 and it is recommended to update your vCenter to the latest version.\n",
    "summary": "Detected vSphere vCenter version less than 7.0.2 in Openshift cluster."
  },
  "state": "firing",
  "activeAt": "2022-06-23T05:42:12.607652782Z",
  "value": "1e+00"
}

Comment 11 errata-xmlrpc 2022-08-10 11:08:03 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Important: OpenShift Container Platform 4.11.0 bug fix and security update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHSA-2022:5069