Bug 2077599 - OCP should alert users if they are on vsphere version <7.0.2
Summary: OCP should alert users if they are on vsphere version <7.0.2
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: OpenShift Container Platform
Classification: Red Hat
Component: Storage
Version: 4.11
Hardware: Unspecified
OS: Unspecified
medium
medium
Target Milestone: ---
: 4.11.0
Assignee: Jan Safranek
QA Contact: Wei Duan
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2022-04-21 17:31 UTC by Hemant Kumar
Modified: 2022-08-10 11:08 UTC (History)
5 users (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2022-08-10 11:08:03 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Github openshift cluster-storage-operator pull 279 0 None open Bug 2077599: Alert on vCenter < 7.0.2 2022-05-09 15:48:59 UTC
Github openshift cluster-storage-operator pull 290 0 None open Bug 2077599: Fix vCenter / ESXi version alerts 2022-06-20 11:44:02 UTC
Red Hat Product Errata RHSA-2022:5069 0 None None None 2022-08-10 11:08:24 UTC

Description Hemant Kumar 2022-04-21 17:31:38 UTC
OCP should alert users if they are on vsphere version <7.0.2

Comment 1 Jan Safranek 2022-04-22 14:09:37 UTC
IMO we already have a metric in vsphere-problem-detector that reports vCenter version and ESXI versions, we just need an alert for that.

Comment 4 Wei Duan 2022-05-24 07:17:32 UTC
There is some issue on our 6.7 vSphere env, no successful installation now.

Comment 5 Wei Duan 2022-05-31 00:49:55 UTC
Blocked by https://bugzilla.redhat.com/show_bug.cgi?id=2089153, hit twice in 6.7 vSphere env.

Comment 6 Wei Duan 2022-06-08 11:47:18 UTC
Verified failed on vSphere 6.7.2, there is no alert raised.

vsphere_esxi_version_total metric shows 6.7.2.
$ oc -n openshift-monitoring exec -c prometheus prometheus-k8s-0 -- curl -k -H "Authorization: Bearer $token" 'https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/query?query=vsphere_esxi_version_total' | jq
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100   484    0   484    0     0  32266      0 --:--:-- --:--:-- --:--:-- 32266
{
  "status": "success",
  "data": {
    "resultType": "vector",
    "result": [
      {
        "metric": {
          "__name__": "vsphere_esxi_version_total",
          "api_version": "6.7.2",
          "container": "vsphere-problem-detector-operator",
          "endpoint": "vsphere-metrics",
          "instance": "10.128.0.20:8444",
          "job": "vsphere-problem-detector-metrics",
          "namespace": "openshift-cluster-storage-operator",
          "pod": "vsphere-problem-detector-operator-bd996dcc4-jh49m",
          "service": "vsphere-problem-detector-metrics",
          "version": "6.7.0"
        },
        "value": [
          1654688161.732,
          "1"
        ]
      }
    ]
  }
}



There is no alert(VSphereOlderVCenterPresent) raised 
$ oc -n openshift-monitoring exec -c prometheus prometheus-k8s-0 -- curl -k -H "Authorization: Bearer $token" 'https://prometheus-k8s.openshift-monitoring.svc:9091/api/v1/alerts' | jq -r '.data.alerts[] | {alertname: .labels.alertname, state: .state}'
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100  5130    0  5130    0     0   333k      0 --:--:-- --:--:-- --:--:--  357k
{
  "alertname": "ClusterNotUpgradeable",
  "state": "firing"
}
{
  "alertname": "AlertmanagerReceiversNotConfigured",
  "state": "firing"
}
{
  "alertname": "Watchdog",
  "state": "firing"
}
{
  "alertname": "CannotRetrieveUpdates",
  "state": "firing"
}
{
  "alertname": "SimpleContentAccessNotAvailable",
  "state": "firing"
}
{
  "alertname": "etcdGRPCRequestsSlow",
  "state": "pending"
}
{
  "alertname": "etcdGRPCRequestsSlow",
  "state": "pending"
}

Comment 9 Wei Duan 2022-06-23 06:15:32 UTC
Verified pass on 4.11.0-0.nightly-2022-06-22-190830.

{
  "labels": {
    "alertname": "VSphereOlderVCenterPresent",
    "api_version": "6.7.3",
    "container": "vsphere-problem-detector-operator",
    "endpoint": "vsphere-metrics",
    "instance": "10.130.0.5:8444",
    "job": "vsphere-problem-detector-metrics",
    "namespace": "openshift-cluster-storage-operator",
    "pod": "vsphere-problem-detector-operator-bd996dcc4-l95jv",
    "service": "vsphere-problem-detector-metrics",
    "severity": "info",
    "uuid": "ca4c444d-ecb1-4cad-aaca-4e068e88e6f8",
    "version": "6.7.0"
  },
  "annotations": {
    "description": "The cluster is using vCenter version less than 7.0.2, which is being deprecated by Openshift. A future version of\nOpenshift will remove support for vCenter versions lest than 7.0.2 and it is recommended to update your vCenter to the latest version.\n",
    "summary": "Detected vSphere vCenter version less than 7.0.2 in Openshift cluster."
  },
  "state": "firing",
  "activeAt": "2022-06-23T05:42:12.607652782Z",
  "value": "1e+00"
}

Comment 11 errata-xmlrpc 2022-08-10 11:08:03 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Important: OpenShift Container Platform 4.11.0 bug fix and security update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHSA-2022:5069


Note You need to log in before you can comment on or make changes to this bug.