Bug 1909058

Summary: [cinder-csi-driver operator] always report fake event continuously in openstack-cinder-csi-driver-operator log
Product: OpenShift Container Platform Reporter: Wei Duan <wduan>
Component: StorageAssignee: egarcia
Storage sub component: OpenStack CSI Drivers QA Contact: Wei Duan <wduan>
Status: CLOSED ERRATA Docs Contact:
Severity: low    
Priority: low CC: aos-bugs, egarcia, jsafrane, m.andre, mbooth, mfedosin, pprinett
Version: 4.7Keywords: Triaged
Target Milestone: ---   
Target Release: 4.9.0   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: No Doc Update
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2021-10-18 17:28:58 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 2049088    
Attachments:
Description Flags
20201218-operator-log none

Description Wei Duan 2020-12-18 09:11:49 UTC
Description of problem:
In openstack-cinder-csi-driver-operator pod log, it always report "StorageClassUpdated" event continuously, after changing the log level to "debug", the reason indicates as StorageClass "standard-csi" changes: {"reclaimPolicy":null}, it looks like a fake event as there is no modification for StorageClass "standard-csi".

I1218 08:26:26.356640       1 storage.go:51] StorageClass "standard-csi" changes: {"reclaimPolicy":null}
I1218 08:26:26.378952       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-cluster-csi-drivers", Name:"openstack-cinder-csi-driver-operator", UID:"6403f12e-bd60-4cd1-bb35-f8d269671bec", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'StorageClassUpdated' Updated StorageClass.storage.k8s.io/standard-csi because it changed
I1218 08:26:26.600651       1 request.go:581] Throttling request took 162.807219ms, request: GET:https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings/openstack-cinder-csi-snapshotter-binding
I1218 08:26:33.069228       1 storage.go:51] StorageClass "standard-csi" changes: {"reclaimPolicy":null}
I1218 08:26:33.076487       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-cluster-csi-drivers", Name:"openstack-cinder-csi-driver-operator", UID:"6403f12e-bd60-4cd1-bb35-f8d269671bec", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'StorageClassUpdated' Updated StorageClass.storage.k8s.io/standard-csi because it changed
I1218 08:26:33.291158       1 request.go:581] Throttling request took 171.949222ms, request: GET:https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings/openstack-cinder-csi-snapshotter-binding
I1218 08:26:36.481035       1 storage.go:51] StorageClass "standard-csi" changes: {"reclaimPolicy":null}
I1218 08:26:36.489334       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-cluster-csi-drivers", Name:"openstack-cinder-csi-driver-operator", UID:"6403f12e-bd60-4cd1-bb35-f8d269671bec", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'StorageClassUpdated' Updated StorageClass.storage.k8s.io/standard-csi because it changed
I1218 08:26:36.707643       1 request.go:581] Throttling request took 164.502899ms, request: GET:https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings/openstack-cinder-csi-snapshotter-binding
I1218 08:26:38.418850       1 storage.go:51] StorageClass "standard-csi" changes: {"reclaimPolicy":null}
I1218 08:26:38.423696       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-cluster-csi-drivers", Name:"openstack-cinder-csi-driver-operator", UID:"6403f12e-bd60-4cd1-bb35-f8d269671bec", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'StorageClassUpdated' Updated StorageClass.storage.k8s.io/standard-csi because it changed
I1218 08:26:38.707593       1 request.go:581] Throttling request took 196.271191ms, request: GET:https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1/clusterroles/openstack-cinder-external-snapshotter-role
I1218 08:26:38.907553       1 request.go:581] Throttling request took 195.519058ms, request: GET:https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings/openstack-cinder-csi-snapshotter-binding
I1218 08:26:43.084987       1 storage.go:51] StorageClass "standard-csi" changes: {"reclaimPolicy":null}
I1218 08:26:43.093439       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-cluster-csi-drivers", Name:"openstack-cinder-csi-driver-operator", UID:"6403f12e-bd60-4cd1-bb35-f8d269671bec", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'StorageClassUpdated' Updated StorageClass.storage.k8s.io/standard-csi because it changed
I1218 08:26:43.304375       1 request.go:581] Throttling request took 176.109488ms, request: GET:https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings/openstack-cinder-csi-snapshotter-binding
I1218 08:26:45.776924       1 reflector.go:515] k8s.io/client-go.0/tools/cache/reflector.go:156: Watch close - *v1.ServiceAccount total 0 items received
I1218 08:26:46.497914       1 storage.go:51] StorageClass "standard-csi" changes: {"reclaimPolicy":null}
I1218 08:26:46.513213       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-cluster-csi-drivers", Name:"openstack-cinder-csi-driver-operator", UID:"6403f12e-bd60-4cd1-bb35-f8d269671bec", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'StorageClassUpdated' Updated StorageClass.storage.k8s.io/standard-csi because it changed
I1218 08:26:46.724410       1 request.go:581] Throttling request took 162.483992ms, request: GET:https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings/openstack-cinder-csi-snapshotter-binding
I1218 08:26:53.098210       1 storage.go:51] StorageClass "standard-csi" changes: {"reclaimPolicy":null}
I1218 08:26:53.103937       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-cluster-csi-drivers", Name:"openstack-cinder-csi-driver-operator", UID:"6403f12e-bd60-4cd1-bb35-f8d269671bec", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'StorageClassUpdated' Updated StorageClass.storage.k8s.io/standard-csi because it changed
I1218 08:26:53.313868       1 request.go:581] Throttling request took 171.849873ms, request: GET:https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings/openstack-cinder-csi-snapshotter-binding
I1218 08:26:56.516223       1 storage.go:51] StorageClass "standard-csi" changes: {"reclaimPolicy":null}
I1218 08:26:56.529558       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-cluster-csi-drivers", Name:"openstack-cinder-csi-driver-operator", UID:"6403f12e-bd60-4cd1-bb35-f8d269671bec", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'StorageClassUpdated' Updated StorageClass.storage.k8s.io/standard-csi because it changed
I1218 08:26:56.740105       1 request.go:581] Throttling request took 169.336681ms, request: GET:https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings/openstack-cinder-csi-snapshotter-binding
I1218 08:27:03.111975       1 storage.go:51] StorageClass "standard-csi" changes: {"reclaimPolicy":null}
I1218 08:27:03.118382       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-cluster-csi-drivers", Name:"openstack-cinder-csi-driver-operator", UID:"6403f12e-bd60-4cd1-bb35-f8d269671bec", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'StorageClassUpdated' Updated StorageClass.storage.k8s.io/standard-csi because it changed
I1218 08:27:03.330228       1 request.go:581] Throttling request took 164.807852ms, request: GET:https://172.30.0.1:443/apis/rbac.authorization.k8s.io/v1/clusterrolebindings/openstack-cinder-csi-snapshotter-binding
I1218 08:27:06.560660       1 storage.go:51] StorageClass "standard-csi" changes: {"reclaimPolicy":null}
I1218 08:27:06.597154       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-cluster-csi-drivers", Name:"openstack-cinder-csi-driver-operator", UID:"6403f12e-bd60-4cd1-bb35-f8d269671bec", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'StorageClassUpdated' Updated StorageClass.storage.k8s.io/standard-csi because it changed

$ oc get sc standard-csi -o yaml
apiVersion: storage.k8s.io/v1
kind: StorageClass
metadata:
  creationTimestamp: "2020-12-17T00:30:40Z"
  managedFields:
  - apiVersion: storage.k8s.io/v1
    fieldsType: FieldsV1
    fieldsV1:
      f:provisioner: {}
      f:reclaimPolicy: {}
      f:volumeBindingMode: {}
    manager: openstack-cinder-csi-driver-operator
    operation: Update
    time: "2020-12-17T00:30:40Z"
  name: standard-csi
  resourceVersion: "5399"
  selfLink: /apis/storage.k8s.io/v1/storageclasses/standard-csi
  uid: 7f1565c8-bde7-4bc5-851a-9213ed2dd405
provisioner: cinder.csi.openstack.org
reclaimPolicy: Delete
volumeBindingMode: WaitForFirstConsumer


Version-Release number of selected component (if applicable):
4.7.0-0.nightly-2020-12-14-080124

How reproducible:
Always

Steps to Reproduce:
0. Install OSP cluster and cinder csi driver is installed.
1. Check openstack-cinder-csi-driver-operator log, lots of "StorageClassUpdated" event reported
2. change loglevel to "debug" to see the detail log

Actual results:
I1218 08:27:06.560660       1 storage.go:51] StorageClass "standard-csi" changes: {"reclaimPolicy":null}
I1218 08:27:06.597154       1 event.go:282] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"openshift-cluster-csi-drivers", Name:"openstack-cinder-csi-driver-operator", UID:"6403f12e-bd60-4cd1-bb35-f8d269671bec", APIVersion:"apps/v1", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'StorageClassUpdated' Updated StorageClass.storage.k8s.io/standard-csi because it changed

Expected results:
Should not report such event.

Comment 1 Wei Duan 2020-12-18 09:16:51 UTC
Created attachment 1740187 [details]
20201218-operator-log

Comment 3 Pierre Prinetti 2021-01-28 16:11:27 UTC
Retargeting to 4.8 due to low-sev and not mentioning functionality issues.

Comment 7 Wei Duan 2021-07-14 03:03:56 UTC
Verified pass with 4.9.0-0.nightly-2021-07-12-143404

Comment 10 errata-xmlrpc 2021-10-18 17:28:58 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Moderate: OpenShift Container Platform 4.9.0 bug fix and security update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHSA-2021:3759