I am seeing bad SDN deployment fail bootstrap because it doesn't start and blocks KAS installer pods (and others). This seems to be blocking rebase PR for kube 1.19 to openshift/origin wchich is required to unblock merges to openshift/kubernetes. Fail twice in a row on https://github.com/openshift/origin/pull/25495 last run: https://prow.ci.openshift.org/view/gs/origin-ci-test/pr-logs/pull/25495/pull-ci-openshift-origin-master-e2e-gcp/1306219874485276672 https://storage.googleapis.com/origin-ci-test/pr-logs/pull/25495/pull-ci-openshift-origin-master-e2e-gcp/1306219874485276672/artifacts/e2e-gcp/ipi-install-install/log-bundle-20200916135840.tar ``` [openshift-kube-apiserver/installer-3-ci-op-8lrd19i0-2a78c-gv2vf-master-2:openshift-sdn]: error adding container to network "openshift-sdn": failed to send CNI request: Post "http://dummy/": EOF ``` ``` InstallerPodContainerWaitingDegraded: Pod \\\"installer-3-ci-op-8lrd19i0-2a78c-gv2vf-master-2\\\" on node \\\"ci-op-8lrd19i0-2a78c-gv2vf-master-2\\\" container \\\"installer\\\" is waiting for 5m3.955111676s because \\\"\\\" ``` looking at sdn logs: ``` I0916 13:54:31.696553 36431 cmd.go:121] Reading proxy configuration from /config/kube-proxy-config.yaml I0916 13:54:31.698097 36431 feature_gate.go:243] feature gates: &{map[]} I0916 13:54:31.698163 36431 cmd.go:216] Watching config file /config/kube-proxy-config.yaml for changes I0916 13:54:31.698208 36431 cmd.go:216] Watching config file /config/..2020_09_16_13_31_50.585996887/kube-proxy-config.yaml for changes I0916 13:54:31.761926 36431 node.go:150] Initializing SDN node "ci-op-8lrd19i0-2a78c-gv2vf-master-2" (10.0.0.2) of type "redhat/openshift-ovs-networkpolicy" I0916 13:54:31.767481 36431 cmd.go:159] Starting node networking (v0.0.0-alpha.0-203-g2e41615) I0916 13:54:31.767502 36431 node.go:338] Starting openshift-sdn network plugin I0916 13:54:31.960599 36431 ovs.go:180] Error executing ovs-ofctl: ovs-ofctl: /var/run/openvswitch/br0.mgmt: failed to open socket (Connection refused) I0916 13:54:32.466220 36431 ovs.go:180] Error executing ovs-ofctl: ovs-ofctl: /var/run/openvswitch/br0.mgmt: failed to open socket (Connection refused) I0916 13:54:33.098931 36431 ovs.go:180] Error executing ovs-ofctl: ovs-ofctl: /var/run/openvswitch/br0.mgmt: failed to open socket (Connection refused) I0916 13:54:33.885487 36431 ovs.go:180] Error executing ovs-ofctl: ovs-ofctl: /var/run/openvswitch/br0.mgmt: failed to open socket (Connection refused) I0916 13:54:34.869281 36431 ovs.go:180] Error executing ovs-ofctl: ovs-ofctl: /var/run/openvswitch/br0.mgmt: failed to open socket (Connection refused) I0916 13:54:36.096847 36431 ovs.go:180] Error executing ovs-ofctl: ovs-ofctl: /var/run/openvswitch/br0.mgmt: failed to open socket (Connection refused) I0916 13:54:37.628146 36431 ovs.go:180] Error executing ovs-ofctl: ovs-ofctl: /var/run/openvswitch/br0.mgmt: failed to open socket (Connection refused) I0916 13:54:39.541122 36431 ovs.go:180] Error executing ovs-ofctl: ovs-ofctl: /var/run/openvswitch/br0.mgmt: failed to open socket (Connection refused) I0916 13:54:41.932124 36431 ovs.go:180] Error executing ovs-ofctl: ovs-ofctl: /var/run/openvswitch/br0.mgmt: failed to open socket (Connection refused) I0916 13:54:44.918805 36431 ovs.go:180] Error executing ovs-ofctl: ovs-ofctl: /var/run/openvswitch/br0.mgmt: failed to open socket (Connection refused) I0916 13:54:44.918854 36431 sdn_controller.go:139] [SDN setup] full SDN setup required (plugin is not setup) I0916 13:55:14.955166 36431 ovs.go:180] Error executing ovs-vsctl: 2020-09-16T13:55:14Z|00002|fatal_signal|WARN|terminating with signal 14 (Alarm clock) I0916 13:55:45.499852 36431 ovs.go:180] Error executing ovs-vsctl: 2020-09-16T13:55:45Z|00002|fatal_signal|WARN|terminating with signal 14 (Alarm clock) I0916 13:55:46.013153 36431 ovs.go:180] Error executing ovs-ofctl: ovs-ofctl: /var/run/openvswitch/br0.mgmt: failed to open socket (Connection refused) I0916 13:55:46.519015 36431 ovs.go:180] Error executing ovs-ofctl: ovs-ofctl: /var/run/openvswitch/br0.mgmt: failed to open socket (Connection refused) I0916 13:55:47.151138 36431 ovs.go:180] Error executing ovs-ofctl: ovs-ofctl: /var/run/openvswitch/br0.mgmt: failed to open socket (Connection refused) I0916 13:55:47.939398 36431 ovs.go:180] Error executing ovs-ofctl: ovs-ofctl: /var/run/openvswitch/br0.mgmt: failed to open socket (Connection refused) I0916 13:55:48.921414 36431 ovs.go:180] Error executing ovs-ofctl: ovs-ofctl: /var/run/openvswitch/br0.mgmt: failed to open socket (Connection refused) I0916 13:55:50.148192 36431 ovs.go:180] Error executing ovs-ofctl: ovs-ofctl: /var/run/openvswitch/br0.mgmt: failed to open socket (Connection refused) I0916 13:55:51.679792 36431 ovs.go:180] Error executing ovs-ofctl: ovs-ofctl: /var/run/openvswitch/br0.mgmt: failed to open socket (Connection refused) I0916 13:55:53.592832 36431 ovs.go:180] Error executing ovs-ofctl: ovs-ofctl: /var/run/openvswitch/br0.mgmt: failed to open socket (Connection refused) I0916 13:55:55.982782 36431 ovs.go:180] Error executing ovs-ofctl: ovs-ofctl: /var/run/openvswitch/br0.mgmt: failed to open socket (Connection refused) I0916 13:55:58.970235 36431 ovs.go:180] Error executing ovs-ofctl: ovs-ofctl: /var/run/openvswitch/br0.mgmt: failed to open socket (Connection refused) F0916 13:55:58.970279 36431 cmd.go:111] Failed to start sdn: node SDN setup failed: timed out waiting for the condition ``` ovs is not doing great either ``` Failed to connect to bus: No data available openvswitch is running in container /etc/openvswitch/conf.db does not exist ... (warning). Creating empty database /etc/openvswitch/conf.db. ovsdb-server: /var/run/openvswitch/ovsdb-server.pid: pidfile check failed (No such process), aborting Starting ovsdb-server ... failed! ```