Bug 1953071

Summary: [4.7] ImagePullBackOff: Source image rejected: Too many open files
Product: OpenShift Container Platform Reporter: Peter Hunt <pehunt>
Component: NodeAssignee: Peter Hunt <pehunt>
Node sub component: CRI-O QA Contact: Sunil Choudhary <schoudha>
Status: CLOSED ERRATA Docs Contact:
Severity: urgent    
Priority: urgent CC: andbartl, aos-bugs, bjarolim, dwalsh, fiezzi, jhou, jokerman, openshift-bugs-escalate, schoudha, tsweeney
Version: 4.7   
Target Milestone: ---   
Target Release: 4.7.z   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: 1948441
: 1953073 (view as bug list) Environment:
Last Closed: 2021-05-19 15:16:26 UTC Type: ---
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On: 1953073    
Bug Blocks: 1948441    

Comment 1 Peter Hunt 2021-04-23 19:56:25 UTC
All of these `protocol: TCP` lines are likely from leaked connections made with port-forwarding.

The attached PR fixed this for 4.7

Comment 2 Peter Hunt 2021-04-23 20:28:26 UTC
here's another PR that *may* help once integrated (and is a leak regardless, so worth picking up)

Comment 3 Peter Hunt 2021-04-28 13:45:46 UTC
both attached PRs merged and will be in the next z stream

Comment 6 Sunil Choudhary 2021-05-06 04:22:44 UTC
Tried to trigger the issue locally by setting ulimit on an node just above what was currently being used and pulled an image.
Could not reproduce the issue. Also from bug description I see the issue happened randomly. I will mark it verified based on comment 1 & 2.

Comment 7 Siddharth Sharma 2021-05-10 17:59:28 UTC
This bug will be shipped as part of next z-stream release 4.7.11 on May 19th, as 4.7.10 was dropped due to a blocker https://bugzilla.redhat.com/show_bug.cgi?id=1958518.

Comment 11 errata-xmlrpc 2021-05-19 15:16:26 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (OpenShift Container Platform 4.7.11 bug fix update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2021:1550