Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 1879591

Summary:	error adding container to network "openshift-sdn": failed to send CNI request: Post "http://dummy/": EOF
Product:	OpenShift Container Platform	Reporter:	Tomáš Nožička <tnozicka>
Component:	Networking	Assignee:	Ben Bennett <bbennett>
Networking sub component:	openshift-sdn	QA Contact:	zhaozhanqi <zzhao>
Status:	CLOSED DUPLICATE	Docs Contact:
Severity:	high
Priority:	unspecified	CC:	anbhat
Version:	4.6
Target Milestone:	---
Target Release:	---
Hardware:	Unspecified
OS:	Unspecified
Whiteboard:
Fixed In Version:		Doc Type:	If docs needed, set a value
Doc Text:		Story Points:	---
Clone Of:		Environment:
Last Closed:	2020-09-17 13:26:47 UTC	Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:

Description Tomáš Nožička 2020-09-16 15:06:13 UTC

I am seeing bad SDN deployment fail bootstrap because it doesn't start and blocks KAS installer pods (and others). 

This seems to be blocking rebase PR for kube 1.19 to openshift/origin wchich is required to unblock merges to openshift/kubernetes. Fail twice in a row on https://github.com/openshift/origin/pull/25495
last run: https://prow.ci.openshift.org/view/gs/origin-ci-test/pr-logs/pull/25495/pull-ci-openshift-origin-master-e2e-gcp/1306219874485276672 https://storage.googleapis.com/origin-ci-test/pr-logs/pull/25495/pull-ci-openshift-origin-master-e2e-gcp/1306219874485276672/artifacts/e2e-gcp/ipi-install-install/log-bundle-20200916135840.tar

```
[openshift-kube-apiserver/installer-3-ci-op-8lrd19i0-2a78c-gv2vf-master-2:openshift-sdn]: error adding container to network "openshift-sdn": failed to send CNI request: Post "http://dummy/": EOF
```

```
InstallerPodContainerWaitingDegraded: Pod \\\"installer-3-ci-op-8lrd19i0-2a78c-gv2vf-master-2\\\" on node \\\"ci-op-8lrd19i0-2a78c-gv2vf-master-2\\\" container \\\"installer\\\" is waiting for 5m3.955111676s because \\\"\\\"
```

looking at sdn logs:

```
I0916 13:54:31.696553   36431 cmd.go:121] Reading proxy configuration from /config/kube-proxy-config.yaml
I0916 13:54:31.698097   36431 feature_gate.go:243] feature gates: &{map[]}
I0916 13:54:31.698163   36431 cmd.go:216] Watching config file /config/kube-proxy-config.yaml for changes
I0916 13:54:31.698208   36431 cmd.go:216] Watching config file /config/..2020_09_16_13_31_50.585996887/kube-proxy-config.yaml for changes
I0916 13:54:31.761926   36431 node.go:150] Initializing SDN node "ci-op-8lrd19i0-2a78c-gv2vf-master-2" (10.0.0.2) of type "redhat/openshift-ovs-networkpolicy"
I0916 13:54:31.767481   36431 cmd.go:159] Starting node networking (v0.0.0-alpha.0-203-g2e41615)
I0916 13:54:31.767502   36431 node.go:338] Starting openshift-sdn network plugin
I0916 13:54:31.960599   36431 ovs.go:180] Error executing ovs-ofctl: ovs-ofctl: /var/run/openvswitch/br0.mgmt: failed to open socket (Connection refused)
I0916 13:54:32.466220   36431 ovs.go:180] Error executing ovs-ofctl: ovs-ofctl: /var/run/openvswitch/br0.mgmt: failed to open socket (Connection refused)
I0916 13:54:33.098931   36431 ovs.go:180] Error executing ovs-ofctl: ovs-ofctl: /var/run/openvswitch/br0.mgmt: failed to open socket (Connection refused)
I0916 13:54:33.885487   36431 ovs.go:180] Error executing ovs-ofctl: ovs-ofctl: /var/run/openvswitch/br0.mgmt: failed to open socket (Connection refused)
I0916 13:54:34.869281   36431 ovs.go:180] Error executing ovs-ofctl: ovs-ofctl: /var/run/openvswitch/br0.mgmt: failed to open socket (Connection refused)
I0916 13:54:36.096847   36431 ovs.go:180] Error executing ovs-ofctl: ovs-ofctl: /var/run/openvswitch/br0.mgmt: failed to open socket (Connection refused)
I0916 13:54:37.628146   36431 ovs.go:180] Error executing ovs-ofctl: ovs-ofctl: /var/run/openvswitch/br0.mgmt: failed to open socket (Connection refused)
I0916 13:54:39.541122   36431 ovs.go:180] Error executing ovs-ofctl: ovs-ofctl: /var/run/openvswitch/br0.mgmt: failed to open socket (Connection refused)
I0916 13:54:41.932124   36431 ovs.go:180] Error executing ovs-ofctl: ovs-ofctl: /var/run/openvswitch/br0.mgmt: failed to open socket (Connection refused)
I0916 13:54:44.918805   36431 ovs.go:180] Error executing ovs-ofctl: ovs-ofctl: /var/run/openvswitch/br0.mgmt: failed to open socket (Connection refused)
I0916 13:54:44.918854   36431 sdn_controller.go:139] [SDN setup] full SDN setup required (plugin is not setup)
I0916 13:55:14.955166   36431 ovs.go:180] Error executing ovs-vsctl: 2020-09-16T13:55:14Z|00002|fatal_signal|WARN|terminating with signal 14 (Alarm clock)
I0916 13:55:45.499852   36431 ovs.go:180] Error executing ovs-vsctl: 2020-09-16T13:55:45Z|00002|fatal_signal|WARN|terminating with signal 14 (Alarm clock)
I0916 13:55:46.013153   36431 ovs.go:180] Error executing ovs-ofctl: ovs-ofctl: /var/run/openvswitch/br0.mgmt: failed to open socket (Connection refused)
I0916 13:55:46.519015   36431 ovs.go:180] Error executing ovs-ofctl: ovs-ofctl: /var/run/openvswitch/br0.mgmt: failed to open socket (Connection refused)
I0916 13:55:47.151138   36431 ovs.go:180] Error executing ovs-ofctl: ovs-ofctl: /var/run/openvswitch/br0.mgmt: failed to open socket (Connection refused)
I0916 13:55:47.939398   36431 ovs.go:180] Error executing ovs-ofctl: ovs-ofctl: /var/run/openvswitch/br0.mgmt: failed to open socket (Connection refused)
I0916 13:55:48.921414   36431 ovs.go:180] Error executing ovs-ofctl: ovs-ofctl: /var/run/openvswitch/br0.mgmt: failed to open socket (Connection refused)
I0916 13:55:50.148192   36431 ovs.go:180] Error executing ovs-ofctl: ovs-ofctl: /var/run/openvswitch/br0.mgmt: failed to open socket (Connection refused)
I0916 13:55:51.679792   36431 ovs.go:180] Error executing ovs-ofctl: ovs-ofctl: /var/run/openvswitch/br0.mgmt: failed to open socket (Connection refused)
I0916 13:55:53.592832   36431 ovs.go:180] Error executing ovs-ofctl: ovs-ofctl: /var/run/openvswitch/br0.mgmt: failed to open socket (Connection refused)
I0916 13:55:55.982782   36431 ovs.go:180] Error executing ovs-ofctl: ovs-ofctl: /var/run/openvswitch/br0.mgmt: failed to open socket (Connection refused)
I0916 13:55:58.970235   36431 ovs.go:180] Error executing ovs-ofctl: ovs-ofctl: /var/run/openvswitch/br0.mgmt: failed to open socket (Connection refused)
F0916 13:55:58.970279   36431 cmd.go:111] Failed to start sdn: node SDN setup failed: timed out waiting for the condition
```

ovs is not doing great either
```
Failed to connect to bus: No data available
openvswitch is running in container
/etc/openvswitch/conf.db does not exist ... (warning).
Creating empty database /etc/openvswitch/conf.db.
ovsdb-server: /var/run/openvswitch/ovsdb-server.pid: pidfile check failed (No such process), aborting
Starting ovsdb-server ... failed!
```