Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 1743619

Summary: Router reload fails following os update
Product: OpenShift Container Platform Reporter: Robert Sandu <rsandu>
Component: NetworkingAssignee: Dan Mace <dmace>
Networking sub component: router QA Contact: Hongan Li <hongli>
Status: CLOSED NOTABUG Docs Contact:
Severity: urgent    
Priority: urgent CC: aos-bugs, bbennett, cshereme, dmace, nils.ketelsen, rhowe, syangsao
Version: 3.11.0   
Target Milestone: ---   
Target Release: 3.11.z   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2019-09-05 13:54:13 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Robert Sandu 2019-08-20 10:40:58 UTC 
Description of problem: router reload ends up in a CrashLoopBackOff state following operating system update. Router pod logs:

E0813 09:53:42.314920       1 limiter.go:137] error reloading router: exit status 1
E0813 09:53:52.288779       1 limiter.go:137] error reloading router: exit status 1
E0813 09:53:57.294253       1 limiter.go:137] error reloading router: exit status 1
E0813 09:54:02.494266       1 limiter.go:137] error reloading router: exit status 1
E0813 09:54:07.267470       1 limiter.go:137] error reloading router: exit status 1
E0813 09:54:17.001753       1 limiter.go:137] error reloading router: exit status 1

Version-Release number of selected component (if applicable): v3.11.117

Actual results: reload-haproxy fails with `exit status 1` in the updated infra node.

Expected results: route pod to start and pass liveness/readiness probes on the updated infra node.

Additional info:

- Manually running /usr/bin/openshift-router in a `oc debug dc/router` pod leads to the same `exit status 1` error:

grep -i -e reload -e health debug-router.log
I0819 13:19:43.857677      45 router.go:481] Router reloaded:
 - Health check ok : 0 retry attempt(s).
I0819 13:19:45.635525      45 router.go:481] Router reloaded:
 - Health check ok : 0 retry attempt(s).
E0819 13:20:32.360256      45 limiter.go:137] error reloading router: exit status 1
 - Exceeded max wait time (30) in health check - 29 retry attempt(s).
Comment 8 Robert Sandu 2019-09-05 17:31:15 UTC 
KCS and related bugzilla:

https://access.redhat.com/solutions/4392331
https://bugzilla.redhat.com/show_bug.cgi?id=1749411