Bugzilla (bugzilla.redhat.com) will be under maintenance for infrastructure upgrades and will not be available on July 31st between 12:30 AM - 05:30 AM UTC. We appreciate your understanding and patience. You can follow status.redhat.com for details.
Bug 1879591 - error adding container to network "openshift-sdn": failed to send CNI request: Post "http://dummy/": EOF
Summary: error adding container to network "openshift-sdn": failed to send CNI request...
Keywords:
Status: CLOSED DUPLICATE of bug 1874696
Alias: None
Product: OpenShift Container Platform
Classification: Red Hat
Component: Networking
Version: 4.6
Hardware: Unspecified
OS: Unspecified
unspecified
high
Target Milestone: ---
: ---
Assignee: Ben Bennett
QA Contact: zhaozhanqi
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2020-09-16 15:06 UTC by Tomáš Nožička
Modified: 2020-09-17 13:26 UTC (History)
1 user (show)

Fixed In Version:
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2020-09-17 13:26:47 UTC
Target Upstream Version:


Attachments (Terms of Use)

Description Tomáš Nožička 2020-09-16 15:06:13 UTC
I am seeing bad SDN deployment fail bootstrap because it doesn't start and blocks KAS installer pods (and others). 

This seems to be blocking rebase PR for kube 1.19 to openshift/origin wchich is required to unblock merges to openshift/kubernetes. Fail twice in a row on https://github.com/openshift/origin/pull/25495
last run: https://prow.ci.openshift.org/view/gs/origin-ci-test/pr-logs/pull/25495/pull-ci-openshift-origin-master-e2e-gcp/1306219874485276672 https://storage.googleapis.com/origin-ci-test/pr-logs/pull/25495/pull-ci-openshift-origin-master-e2e-gcp/1306219874485276672/artifacts/e2e-gcp/ipi-install-install/log-bundle-20200916135840.tar

```
[openshift-kube-apiserver/installer-3-ci-op-8lrd19i0-2a78c-gv2vf-master-2:openshift-sdn]: error adding container to network "openshift-sdn": failed to send CNI request: Post "http://dummy/": EOF
```

```
InstallerPodContainerWaitingDegraded: Pod \\\"installer-3-ci-op-8lrd19i0-2a78c-gv2vf-master-2\\\" on node \\\"ci-op-8lrd19i0-2a78c-gv2vf-master-2\\\" container \\\"installer\\\" is waiting for 5m3.955111676s because \\\"\\\"
```

looking at sdn logs:

```
I0916 13:54:31.696553   36431 cmd.go:121] Reading proxy configuration from /config/kube-proxy-config.yaml
I0916 13:54:31.698097   36431 feature_gate.go:243] feature gates: &{map[]}
I0916 13:54:31.698163   36431 cmd.go:216] Watching config file /config/kube-proxy-config.yaml for changes
I0916 13:54:31.698208   36431 cmd.go:216] Watching config file /config/..2020_09_16_13_31_50.585996887/kube-proxy-config.yaml for changes
I0916 13:54:31.761926   36431 node.go:150] Initializing SDN node "ci-op-8lrd19i0-2a78c-gv2vf-master-2" (10.0.0.2) of type "redhat/openshift-ovs-networkpolicy"
I0916 13:54:31.767481   36431 cmd.go:159] Starting node networking (v0.0.0-alpha.0-203-g2e41615)
I0916 13:54:31.767502   36431 node.go:338] Starting openshift-sdn network plugin
I0916 13:54:31.960599   36431 ovs.go:180] Error executing ovs-ofctl: ovs-ofctl: /var/run/openvswitch/br0.mgmt: failed to open socket (Connection refused)
I0916 13:54:32.466220   36431 ovs.go:180] Error executing ovs-ofctl: ovs-ofctl: /var/run/openvswitch/br0.mgmt: failed to open socket (Connection refused)
I0916 13:54:33.098931   36431 ovs.go:180] Error executing ovs-ofctl: ovs-ofctl: /var/run/openvswitch/br0.mgmt: failed to open socket (Connection refused)
I0916 13:54:33.885487   36431 ovs.go:180] Error executing ovs-ofctl: ovs-ofctl: /var/run/openvswitch/br0.mgmt: failed to open socket (Connection refused)
I0916 13:54:34.869281   36431 ovs.go:180] Error executing ovs-ofctl: ovs-ofctl: /var/run/openvswitch/br0.mgmt: failed to open socket (Connection refused)
I0916 13:54:36.096847   36431 ovs.go:180] Error executing ovs-ofctl: ovs-ofctl: /var/run/openvswitch/br0.mgmt: failed to open socket (Connection refused)
I0916 13:54:37.628146   36431 ovs.go:180] Error executing ovs-ofctl: ovs-ofctl: /var/run/openvswitch/br0.mgmt: failed to open socket (Connection refused)
I0916 13:54:39.541122   36431 ovs.go:180] Error executing ovs-ofctl: ovs-ofctl: /var/run/openvswitch/br0.mgmt: failed to open socket (Connection refused)
I0916 13:54:41.932124   36431 ovs.go:180] Error executing ovs-ofctl: ovs-ofctl: /var/run/openvswitch/br0.mgmt: failed to open socket (Connection refused)
I0916 13:54:44.918805   36431 ovs.go:180] Error executing ovs-ofctl: ovs-ofctl: /var/run/openvswitch/br0.mgmt: failed to open socket (Connection refused)
I0916 13:54:44.918854   36431 sdn_controller.go:139] [SDN setup] full SDN setup required (plugin is not setup)
I0916 13:55:14.955166   36431 ovs.go:180] Error executing ovs-vsctl: 2020-09-16T13:55:14Z|00002|fatal_signal|WARN|terminating with signal 14 (Alarm clock)
I0916 13:55:45.499852   36431 ovs.go:180] Error executing ovs-vsctl: 2020-09-16T13:55:45Z|00002|fatal_signal|WARN|terminating with signal 14 (Alarm clock)
I0916 13:55:46.013153   36431 ovs.go:180] Error executing ovs-ofctl: ovs-ofctl: /var/run/openvswitch/br0.mgmt: failed to open socket (Connection refused)
I0916 13:55:46.519015   36431 ovs.go:180] Error executing ovs-ofctl: ovs-ofctl: /var/run/openvswitch/br0.mgmt: failed to open socket (Connection refused)
I0916 13:55:47.151138   36431 ovs.go:180] Error executing ovs-ofctl: ovs-ofctl: /var/run/openvswitch/br0.mgmt: failed to open socket (Connection refused)
I0916 13:55:47.939398   36431 ovs.go:180] Error executing ovs-ofctl: ovs-ofctl: /var/run/openvswitch/br0.mgmt: failed to open socket (Connection refused)
I0916 13:55:48.921414   36431 ovs.go:180] Error executing ovs-ofctl: ovs-ofctl: /var/run/openvswitch/br0.mgmt: failed to open socket (Connection refused)
I0916 13:55:50.148192   36431 ovs.go:180] Error executing ovs-ofctl: ovs-ofctl: /var/run/openvswitch/br0.mgmt: failed to open socket (Connection refused)
I0916 13:55:51.679792   36431 ovs.go:180] Error executing ovs-ofctl: ovs-ofctl: /var/run/openvswitch/br0.mgmt: failed to open socket (Connection refused)
I0916 13:55:53.592832   36431 ovs.go:180] Error executing ovs-ofctl: ovs-ofctl: /var/run/openvswitch/br0.mgmt: failed to open socket (Connection refused)
I0916 13:55:55.982782   36431 ovs.go:180] Error executing ovs-ofctl: ovs-ofctl: /var/run/openvswitch/br0.mgmt: failed to open socket (Connection refused)
I0916 13:55:58.970235   36431 ovs.go:180] Error executing ovs-ofctl: ovs-ofctl: /var/run/openvswitch/br0.mgmt: failed to open socket (Connection refused)
F0916 13:55:58.970279   36431 cmd.go:111] Failed to start sdn: node SDN setup failed: timed out waiting for the condition
```

ovs is not doing great either
```
Failed to connect to bus: No data available
openvswitch is running in container
/etc/openvswitch/conf.db does not exist ... (warning).
Creating empty database /etc/openvswitch/conf.db.
ovsdb-server: /var/run/openvswitch/ovsdb-server.pid: pidfile check failed (No such process), aborting
Starting ovsdb-server ... failed!
```


Note You need to log in before you can comment on or make changes to this bug.