Bug 1938405

Summary: catalog operator causing CPU spikes and bad etcd performance
Product: OpenShift Container Platform Reporter: OpenShift BugZilla Robot <openshift-bugzilla-robot>
Component: OLMAssignee: Ben Luddy <bluddy>
OLM sub component: OLM QA Contact: xzha
Status: CLOSED ERRATA Docs Contact:
Severity: high    
Priority: high CC: bluddy, oarribas
Version: 4.6Keywords: Triaged
Target Milestone: ---   
Target Release: 4.7.z   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2021-03-30 04:46:37 UTC Type: ---
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On: 1932182    
Bug Blocks: 1940453    

Comment 2 xzha 2021-03-18 09:18:35 UTC 
verify

zhaoxia@wangshanshandeMacBook-Pro test % oc get clusterversion
NAME      VERSION                             AVAILABLE   PROGRESSING   SINCE   STATUS
version   4.7.0-0.nightly-2021-03-18-015345   True        False         158m    Cluster version is 4.7.0-0.nightly-2021-03-18-015345

zhaoxia@wangshanshandeMacBook-Pro test % oc get all
NAME                                                                  READY   STATUS             RESTARTS   AGE
pod/03a576bf8e62913785f8817df821a649bd2219ec8f1386cd0c0908e75agrmrk   0/1     Completed          0          51m
pod/certified-operators-vbxqx                                         1/1     Running            0          157m
pod/community-operators-6pnq8                                         1/1     Running            0          151m
pod/etcd-tesit-8-dv8w9                                                1/1     Running            0          62m
pod/etcd-test-1-7lgp9                                                 1/1     Running            0          57m
pod/etcd-test-10-xnbzd                                                1/1     Running            0          54m
pod/etcd-test-2-jtt9l                                                 1/1     Running            0          57m
pod/etcd-test-3-sgjqf                                                 1/1     Running            0          56m
pod/etcd-test-4-smg5d                                                 1/1     Running            0          56m
pod/etcd-test-5-r5kq7                                                 1/1     Running            0          56m
pod/etcd-test-6-ljfmv                                                 1/1     Running            0          56m
pod/etcd-test-7-c5d2q                                                 1/1     Running            0          55m
pod/etcd-test-8-wt8q4                                                 1/1     Running            0          55m
pod/etcd-test-9-snmq8                                                 1/1     Running            0          54m
pod/etcd-test-qqfvh                                                   1/1     Running            0          57m
pod/marketplace-operator-64bdc6b76-nmkt8                              1/1     Running            0          154m
pod/qe-app-registry-j85mm                                             0/1     ImagePullBackOff   0          157m
pod/qe-app-registry-jxsr6                                             0/1     ImagePullBackOff   0          142m
pod/redhat-marketplace-zgt46                                          1/1     Running            0          157m
pod/redhat-operators-nknkc                                            1/1     Running            0          157m

NAME                                   TYPE        CLUSTER-IP       EXTERNAL-IP   PORT(S)             AGE
service/certified-operators            ClusterIP   172.30.237.65    <none>        50051/TCP           3h3m
service/community-operators            ClusterIP   172.30.20.247    <none>        50051/TCP           3h3m
service/etcd-tesit-8                   ClusterIP   172.30.150.132   <none>        50051/TCP           62m
service/etcd-test                      ClusterIP   172.30.43.65     <none>        50051/TCP           57m
service/etcd-test-1                    ClusterIP   172.30.25.229    <none>        50051/TCP           57m
service/etcd-test-10                   ClusterIP   172.30.7.3       <none>        50051/TCP           54m
service/etcd-test-2                    ClusterIP   172.30.225.172   <none>        50051/TCP           57m
service/etcd-test-3                    ClusterIP   172.30.161.227   <none>        50051/TCP           57m
service/etcd-test-4                    ClusterIP   172.30.23.66     <none>        50051/TCP           56m
service/etcd-test-5                    ClusterIP   172.30.205.97    <none>        50051/TCP           56m
service/etcd-test-6                    ClusterIP   172.30.197.35    <none>        50051/TCP           56m
service/etcd-test-7                    ClusterIP   172.30.211.191   <none>        50051/TCP           55m
service/etcd-test-8                    ClusterIP   172.30.181.44    <none>        50051/TCP           55m
service/etcd-test-9                    ClusterIP   172.30.208.168   <none>        50051/TCP           54m
service/marketplace-operator-metrics   ClusterIP   172.30.175.51    <none>        8383/TCP,8081/TCP   3h12m
service/qe-app-registry                ClusterIP   172.30.76.136    <none>        50051/TCP           158m
service/redhat-marketplace             ClusterIP   172.30.231.25    <none>        50051/TCP           3h3m
service/redhat-operators               ClusterIP   172.30.121.12    <none>        50051/TCP           3h3m

NAME                                   READY   UP-TO-DATE   AVAILABLE   AGE
deployment.apps/marketplace-operator   1/1     1            1           3h12m

NAME                                             DESIRED   CURRENT   READY   AGE
replicaset.apps/marketplace-operator-64bdc6b76   1         1         1       3h12m

NAME                                                                        COMPLETIONS   DURATION   AGE
job.batch/03a576bf8e62913785f8817df821a649bd2219ec8f1386cd0c0908e75abdfed   1/1           20s        51m


monitor CPU usage

https://user-images.githubusercontent.com/77608951/111601823-b5253900-880d-11eb-9fdb-09db740dd024.png

There is no significant cpu consumption.

verified.
Comment 5 errata-xmlrpc 2021-03-30 04:46:37 UTC 
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Moderate: OpenShift Container Platform 4.7.4 security update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHSA-2021:0957