Bug 2053148 - Static pod installer should throttle creating new revisions
Summary: Static pod installer should throttle creating new revisions
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: OpenShift Container Platform
Classification: Red Hat
Component: Etcd
Version: 4.11
Hardware: Unspecified
OS: Unspecified
unspecified
high
Target Milestone: ---
: 4.10.z
Assignee: Dean West
QA Contact: ge liu
URL:
Whiteboard:
Depends On: 2052056
Blocks:
TreeView+ depends on / blocked
 
Reported: 2022-02-10 15:50 UTC by David Eads
Modified: 2023-09-15 01:19 UTC (History)
7 users (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of: 2052056
Environment:
Last Closed: 2022-03-16 11:12:06 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Github openshift cluster-etcd-operator pull 738 0 None Merged bug 2053148: [release-4.10] update library-go to get rapid installer pod fixes 2022-02-16 13:44:18 UTC
Github openshift cluster-kube-apiserver-operator pull 1301 0 None Merged bug 2053148: [release-4.10] update library-go to get rapid installer pod fixes 2022-02-16 13:44:17 UTC
Github openshift cluster-kube-controller-manager-operator pull 598 0 None Merged bug 2053148: [release-4.10] update library-go to get rapid installer pod fixes 2022-02-16 13:44:14 UTC
Github openshift cluster-kube-scheduler-operator pull 408 0 None Merged bug 2053148: [release-4.10] update library-go to get rapid installer pod fixes 2022-02-16 13:44:13 UTC
Red Hat Product Errata RHBA-2022:0811 0 None None None 2022-03-16 11:12:24 UTC

Comment 4 ge liu 2022-02-16 10:47:33 UTC
Tried with 4.10.0-0.nightly-2022-02-15-041303
the static pods still revision 6 in 20 minutes

I0216 06:58:41.647165       1 installer_controller.go:524] node ip-10-0-63-43.us-east-2.compute.internal with revision 5 is the oldest and needs new revision 6

labels:
    app: etcd
    etcd: "true"
    k8s-app: etcd
    revision: "6"

Comment 5 Abu Kashem 2022-02-21 14:45:55 UTC
geliu

from 
> In some cases, 5 or 6 revisions are being installed on a single master node within 40 seconds (during installation). 

to 
> the static pods still revision 6 in 20 minutes


looks like an improvements to me, do you have any sort of SLO on this on which you are failing it? I would like to know how much improvements you are seeing on an average from the previous version (gather data from multiple tests).

I am thinking whether we can leave further improvements to a later version.

Comment 7 ge liu 2022-03-09 09:07:38 UTC
Tried in several rounds of test, and revision times are 6-8 in 20+ minutes, and I also tried with single master node cluster which mentioned in bug description, it done 3 revisions in 6 minutes, so this result is acceptable according to comments 5

labels:
    app: etcd
    etcd: "true"
    k8s-app: etcd
    revision: "3"
  name: etcd-geliusno-0

Comment 9 W. Trevor King 2022-03-11 18:46:15 UTC
Comment 7's late return to VERIFIED kept this from getting attached to the 4.10.0 GA errata.  Moving the target to 4.10.z, since we'll probably attach the bug to 4.10.4 (even though the code is in 4.10.3 too).

Comment 11 errata-xmlrpc 2022-03-16 11:12:06 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (OpenShift Container Platform 4.10.4 bug fix update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2022:0811

Comment 12 Red Hat Bugzilla 2023-09-15 01:19:29 UTC
The needinfo request[s] on this closed bug have been removed as they have been unresolved for 500 days


Note You need to log in before you can comment on or make changes to this bug.