Bug 1882033
| Summary: | Traffic spikes every 10 minutes to master API | ||
|---|---|---|---|
| Product: | OpenShift Container Platform | Reporter: | Mike Dame <mdame> |
| Component: | kube-controller-manager | Assignee: | Mike Dame <mdame> |
| Status: | CLOSED ERRATA | QA Contact: | RamaKasturi <knarra> |
| Severity: | high | Docs Contact: | |
| Priority: | urgent | ||
| Version: | 3.11.0 | CC: | antgarci, aos-bugs, asoni, bbennett, dmellado, dporter, jolee, knarra, maszulik, mdame, mfojtik, nelluri, openshift-bugs-escalate, rcarrier, rkant, rvanderp, scuppett, suchaudh, svaughn, tsmetana, vlaad, yinzhou |
| Target Milestone: | --- | ||
| Target Release: | 4.4.z | ||
| Hardware: | Unspecified | ||
| OS: | Unspecified | ||
| Whiteboard: | |||
| Fixed In Version: | Doc Type: | If docs needed, set a value | |
| Doc Text: | Story Points: | --- | |
| Clone Of: | 1882030 | Environment: | |
| Last Closed: | 2020-11-11 04:56:51 UTC | Type: | --- |
| Regression: | --- | Mount Type: | --- |
| Documentation: | --- | CRM: | |
| Verified Versions: | Category: | --- | |
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |
| Cloudforms Team: | --- | Target Upstream Version: | |
| Embargoed: | |||
| Bug Depends On: | 1882030 | ||
| Bug Blocks: | |||
|
Comment 1
Mike Dame
2020-10-02 21:24:45 UTC
verified with the payload below and i see that updates are less after the fix.
[knarra@knarra openshift-client-linux-4.4.0-0.nightly-2020-10-17-051433]$ ./oc version
Client Version: 4.4.0-0.nightly-2020-10-17-051433
Server Version: 4.4.0-0.nightly-2020-10-17-051433
Kubernetes Version: v1.17.1+5aced5f
set kubecontrollermanager loglevel to trace to be able to get the below results.
spec:
logLevel: Trace
Before fix:
================
[knarra@knarra openshift-client-linux-4.4.27]$ ./oc get services --all-namespaces | wc -l
68
[knarra@knarra openshift-client-linux-4.4.27]$ ./oc logs kube-controller-manager-ip-10-0-197-171.us-east-2.compute.internal -n openshift-kube-controller-manager | grep endpoints_controller | grep -c "About to update endpoints"
806
[knarra@knarra openshift-client-linux-4.4.27]$ ./oc logs kube-controller-manager-ip-10-0-197-171.us-east-2.compute.internal -n openshift-kube-controller-manager | grep endpoints_controller | grep -c "Update endpoints for"
247
After fix:
=================
[knarra@knarra openshift-client-linux-4.4.0-0.nightly-2020-10-17-051433]$ ./oc get services --all-namespaces | wc -l
64
[knarra@knarra openshift-client-linux-4.4.0-0.nightly-2020-10-17-051433]$ ./oc logs kube-controller-manager-ip-10-0-146-14.us-east-2.compute.internal -n openshift-kube-controller-manager | grep endpoints_controller | grep -c "About to update endpoints"
696
[knarra@knarra openshift-client-linux-4.4.0-0.nightly-2020-10-17-051433]$ ./oc logs kube-controller-manager-ip-10-0-146-14.us-east-2.compute.internal -n openshift-kube-controller-manager | grep endpoints_controller | grep -c "Update endpoints for"
0
Based on the above moving bug to verified state.
Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA. For information on the advisory (OpenShift Container Platform 4.4.30 bug fix update), and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHBA-2020:4321 |