Bug 1939226

Summary: kube-apiserver readiness probe appears to be hitting /healthz, not /readyz
Product: OpenShift Container Platform Reporter: Elana Hashman <ehashman>
Component: kube-apiserverAssignee: David Eads <deads>
Status: CLOSED ERRATA QA Contact: Ke Wang <kewang>
Severity: medium Docs Contact:
Priority: unspecified    
Version: 4.8CC: aos-bugs, deads, mfojtik, wking, xxia
Target Milestone: ---   
Target Release: 4.8.0   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2021-07-27 22:53:18 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 1945925, 1945926, 1945927    

Description Elana Hashman 2021-03-15 18:49:49 UTC 
Description of problem:

When looking at logs of an unhealthy API server, I noticed it appears to be hitting /healthz instead of /readyz for readiness probes.

Mar 15 03:01:36.711435 ip-10-0-146-200 hyperkube[1442]: I0315 03:01:36.711411    1442 prober.go:117] Readiness probe for "kube-apiserver-ip-10-0-146-200.us-west-1.compute.internal_openshift-kube-apiserver(22bd459e-677c-40ce-a715-9a263b663b2b):kube-apiserver" failed (failure): Get "https://10.0.146.200:6443/healthz": net/http: request canceled (Client.Timeout exceeded while awaiting headers)

See also must-gather here: https://gcsweb-ci.apps.ci.l2s4.p1.openshiftapps.com/gcs/origin-ci-test/logs/release-openshift-ocp-installer-e2e-aws-4.8/1371290082278903808/artifacts/e2e-aws/

Version-Release number of selected component (if applicable): 4.8?


How reproducible:


Steps to Reproduce:
1.
2.
3.

Actual results:


Expected results:


Additional info:
Comment 2 David Eads 2021-03-16 19:27:34 UTC 
readyz isn't used to maintain the kube-apiserver service endpoints (it directly writes), but it does impact the metrics gathering
Comment 4 Xingxing Xia 2021-04-07 10:27:59 UTC 
Verified in 4.8.0-0.nightly-2021-04-06-162113 per result in https://bugzilla.redhat.com/show_bug.cgi?id=1939227#c5 .
Comment 7 errata-xmlrpc 2021-07-27 22:53:18 UTC 
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Moderate: OpenShift Container Platform 4.8.2 bug fix and security update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHSA-2021:2438