Bug 2014360 - [scale] [4.7z] failed to get pod annotation: timed out waiting for annotations
Summary: [scale] [4.7z] failed to get pod annotation: timed out waiting for annotations
Alias: None
Product: OpenShift Container Platform
Classification: Red Hat
Component: Networking
Version: 4.7
Hardware: All
OS: All
Target Milestone: ---
: 4.7.z
Assignee: Tim Rozet
QA Contact: Mike Fiedler
Whiteboard: perfscale-ovn
Depends On: 2014332
TreeView+ depends on / blocked
Reported: 2021-10-15 02:36 UTC by Tim Rozet
Modified: 2021-11-17 21:28 UTC (History)
15 users (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of: 2014332
Last Closed: 2021-11-17 21:27:56 UTC
Target Upstream Version:

Attachments (Terms of Use)

System ID Private Priority Status Summary Last Updated
Github openshift ovn-kubernetes pull 799 0 None open Bug 2014360: Scale fixes for pod and external gateways 2021-10-15 14:15:00 UTC
Red Hat Product Errata RHBA-2021:4572 0 None None None 2021-11-17 21:28:18 UTC

Comment 1 Mike Fiedler 2021-10-19 22:51:24 UTC
Failed verification on a cluster-bot cluster built from this PR (similar to the 4.9 bug 1997072 - see that bz for must-gather).

Cluster was a 120 node OVN cluster on AWS and the workload was node-density light.   Many FailedCreatePodSandBox events with reason "timed out waiting for annotations" are seen and pods take a long time for all to go Running.

On 4.10 latest nightly, the issue can not be reproduced - no annotation timeout events for node-density light in the same cluster configuration

Comment 5 Mike Fiedler 2021-11-05 14:48:07 UTC
Verified this on cluster-bot AWS cluster using openshift ovn-kubernetes pull 799.   Verified using workload in comment 4.   No annotation timeout events, all pods came to Running state.

Comment 9 Mike Fiedler 2021-11-10 12:46:17 UTC
Verified on 4.7.0-0.nightly-2021-11-08-025909  - see comment 5

Comment 11 errata-xmlrpc 2021-11-17 21:27:56 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (OpenShift Container Platform 4.7.37 bug fix update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.


Note You need to log in before you can comment on or make changes to this bug.