Bug 2022528

Summary: Extensive number of requests from storage version operator in cluster
Product: OpenShift Container Platform Reporter: Luis Sanchez <sanchezl>
Component: kube-storage-version-migratorAssignee: Luis Sanchez <sanchezl>
Status: CLOSED ERRATA QA Contact: Rahul Gangwar <rgangwar>
Severity: medium Docs Contact:
Priority: unspecified    
Version: 4.8CC: aos-bugs, mfojtik, rgangwar, sanchezl
Target Milestone: ---   
Target Release: 4.9.z   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: No Doc Update
Doc Text:
Story Points: ---
Clone Of: 2021067
: 2022844 (view as bug list) Environment:
Last Closed: 2021-11-22 21:47:05 UTC Type: ---
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On: 2021067    
Bug Blocks: 2022844    

Comment 3 Rahul Gangwar 2021-11-18 07:18:12 UTC 
Count is low

oc get clusterversion
NAME      VERSION                             AVAILABLE   PROGRESSING   SINCE   STATUS
version   4.9.0-0.nightly-2021-11-18-000209   True        False         87m     Cluster version is 4.9.0-0.nightly-2021-11-18-000209

oc adm node-logs --role=master --path="kube-apiserver"|grep -v -E "(.terminating|.lock|termination.log)"|sed "s|^| kube-apiserver |"|xargs  bash -c 'oc adm node-logs $2 --path=$1/$3' bash|grep 'namespaces/openshift-kube-storage-version-migrator' |jq -r '.user.username+" "+.useragent+" "+.verb+" "+.requestURI' | sort | uniq -c | sort -n |tail -n 10
   2 system:serviceaccount:kube-system:generic-garbage-collector  get /api/v1/namespaces/openshift-kube-storage-version-migrator-operator/configmaps/config
   2 system:serviceaccount:kube-system:generic-garbage-collector  get /apis/apps/v1/namespaces/openshift-kube-storage-version-migrator-operator/deployments/kube-storage-version-migrator-operator
   2 system:serviceaccount:kube-system:generic-garbage-collector  get /apis/apps/v1/namespaces/openshift-kube-storage-version-migrator/deployments/migrator
   2 system:serviceaccount:openshift-kube-storage-version-migrator-operator:kube-storage-version-migrator-operator  watch /api/v1/namespaces/openshift-kube-storage-version-migrator/secrets?allowWatchBookmarks=true&resourceVersion=11828&timeout=5m53s&timeoutSeconds=353&watch=true
   2 system:serviceaccount:openshift-kube-storage-version-migrator-operator:kube-storage-version-migrator-operator  watch /apis/apps/v1/namespaces/openshift-kube-storage-version-migrator/deployments?allowWatchBookmarks=true&resourceVersion=11832&timeout=5m26s&timeoutSeconds=326&watch=true
  12 system:serviceaccount:openshift-kube-storage-version-migrator-operator:kube-storage-version-migrator-operator  get /api/v1/namespaces/openshift-kube-storage-version-migrator
  12 system:serviceaccount:openshift-kube-storage-version-migrator-operator:kube-storage-version-migrator-operator  get /api/v1/namespaces/openshift-kube-storage-version-migrator/serviceaccounts/kube-storage-version-migrator-sa
  22 system:serviceaccount:openshift-kube-storage-version-migrator-operator:kube-storage-version-migrator-operator  get /api/v1/namespaces/openshift-kube-storage-version-migrator-operator/configmaps/openshift-kube-storage-version-migrator-operator-lock?timeout=1m47s
  22 system:serviceaccount:openshift-kube-storage-version-migrator-operator:kube-storage-version-migrator-operator  update /api/v1/namespaces/openshift-kube-storage-version-migrator-operator/configmaps/openshift-kube-storage-version-migrator-operator-lock?timeout=1m47s
  35 system:serviceaccount:openshift-kube-storage-version-migrator-operator:kube-storage-version-migrator-operator  get /apis/apps/v1/namespaces/openshift-kube-storage-version-migrator/deployments/migrator

oc adm node-logs --role=master --path="kube-apiserver"|grep -v -E "(.terminating|.lock|termination.log)"|sed "s|^| kube-apiserver |"|xargs  bash -c 'oc adm node-logs $2 --path=$1/$3' bash|jq -r '.user.username+" "+.useragent+" "+.verb+" "+.requestURI' | sort | uniq -c | sort -n |tail -n 10
 563 system:anonymous  get /livez
 569 system:serviceaccount:kube-system:generic-garbage-collector  get /apis/config.openshift.io/v1/clusterversions/version
 572 system:apiserver  get /api/v1/namespaces/default
 572 system:apiserver  get /api/v1/namespaces/default/services/kubernetes
 572 system:apiserver  get /apis/discovery.k8s.io/v1/namespaces/default/endpointslices/kubernetes
 573 system:apiserver  get /api/v1/namespaces/default/endpoints/kubernetes
 872 system:serviceaccount:openshift-kube-controller-manager:localhost-recovery-client  get /api/v1/namespaces/openshift-kube-controller-manager/secrets/csr-signer
 873 system:serviceaccount:openshift-kube-controller-manager:localhost-recovery-client  get /api/v1/namespaces/openshift-kube-controller-manager-operator/configmaps/csr-signer-ca
1034 system:serviceaccount:openshift-apiserver:openshift-apiserver-sa  get /api/v1/namespaces/default/services/docker-registry
1842 system:serviceaccount:openshift-apiserver:openshift-apiserver-sa  create /apis/authorization.k8s.io/v1/subjectaccessreviews?timeout=10s
Comment 6 errata-xmlrpc 2021-11-22 21:47:05 UTC 
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (OpenShift Container Platform 4.9.8 bug fix update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2021:4712