Bug 1902067 - [release-3.11] extended_conformance_install permanently fails on missing network plugin
Summary: [release-3.11] extended_conformance_install permanently fails on missing netw...
Keywords:
Status: CLOSED CURRENTRELEASE
Alias: None
Product: OpenShift Container Platform
Classification: Red Hat
Component: Installer
Version: 3.11.0
Hardware: Unspecified
OS: Unspecified
medium
high
Target Milestone: ---
: 3.11.z
Assignee: Russell Teague
QA Contact: Gaoyun Pei
URL:
Whiteboard:
: 1899717 (view as bug list)
Depends On:
Blocks: 1852692 1870050
TreeView+ depends on / blocked
 
Reported: 2020-11-26 17:32 UTC by Lukasz Szaszkiewicz
Modified: 2021-01-04 18:16 UTC (History)
2 users (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2021-01-04 18:16:56 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Github openshift openshift-ansible pull 12280 0 None closed Bug 1902067: playbooks/openshift-node: Remove restart from join.yml 2021-01-04 00:20:59 UTC

Description Lukasz Szaszkiewicz 2020-11-26 17:32:08 UTC
Hi, the mentioned CI job fails constantly stopping PRs from merging.[1]
It seems that only one test is affected [2] and it always fails on " message:docker: network plugin is not ready: cni config uninitialized"

Not sure if this is the right team so feel free to reassign the issue. Thanks.


[1] https://prow.ci.openshift.org/job-history/gs/origin-ci-test/pr-logs/directory/test_pull_request_origin_extended_conformance_install-release-3.11
[2] PLAY RECAP *********************************************************************
localhost                  : ok=422  changed=176  unreachable=0    failed=1    skipped=611  rescued=0    ignored=0


# CI job output:

Nov 26 16:14:47 ip-172-18-4-88.ec2.internal origin-node[15538]: W1126 16:14:47.519666   15538 cni.go:172] Unable to update cni config: No networks found in /etc/cni/net.d
Nov 26 16:14:47 ip-172-18-4-88.ec2.internal origin-node[15538]: I1126 16:14:47.519872   15538 kubelet.go:2098] Container runtime status: Runtime Conditions: RuntimeReady=true reason: message:, NetworkReady=false reason:NetworkPluginNotReady message:docker: network plugin is not ready: cni config uninitialized

Comment 1 Dan Winship 2020-11-30 20:07:45 UTC
*** Bug 1899717 has been marked as a duplicate of this bug. ***

Comment 2 Dan Winship 2020-11-30 21:29:23 UTC
The last successful run was https://prow.ci.openshift.org/view/gs/origin-ci-test/pr-logs/pull/25623/test_pull_request_origin_extended_conformance_install-release-3.11/2359 on Nov 11 and the first failed run was https://prow.ci.openshift.org/view/gs/origin-ci-test/pr-logs/pull/25623/test_pull_request_origin_extended_conformance_install-release-3.11/2360 on Nov 12.

2359 was against origin@2765a935ed and 2360 was against origin@9cb9d167aa, meaning that only
https://github.com/openshift/origin/pull/25623 merged between them, which seems clearly irrelevant.

2359 was against openshift-ansible@1113fc13e and 2360 was against openshift-ansible@70ce91889, meaning that:

https://github.com/openshift/openshift-ansible/pull/12260
https://github.com/openshift/openshift-ansible/pull/12261
https://github.com/openshift/openshift-ansible/pull/12265
https://github.com/openshift/openshift-ansible/pull/12268
https://github.com/openshift/openshift-ansible/pull/12269

all merged between them. And 12261 "openshift_node: Drain nodes and restart during join.yml" looks very suspicious because that's basically exactly where CI is now failing.

Comment 3 Russell Teague 2020-12-04 19:51:16 UTC
We will continue to investigate this in the upcoming sprint.


Note You need to log in before you can comment on or make changes to this bug.