Bug 1704706

Summary: Multus deletion failures on freshly-booted nodes
Product: OpenShift Container Platform Reporter: Casey Callendrello <cdc>
Component: NetworkingAssignee: Casey Callendrello <cdc>
Status: CLOSED ERRATA QA Contact: Meng Bo <bmeng>
Severity: high Docs Contact:
Priority: high    
Version: 4.1.0CC: aos-bugs, bbennett, fpan
Target Milestone: ---   
Target Release: 4.1.0   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2019-06-04 10:48:18 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Casey Callendrello 2019-04-30 11:58:49 UTC
We saw some deletion failures on fresly-rebooted nodes:

Apr 30 10:37:18 ip-10-0-128-167 crio[2574]: 2019-04-30T10:37:18Z [verbose] Del: openshift-console:downloads-986db4698-n6qkw:openshift-sdn:eth0 {"cniVersion":"0.3.1","name":"openshift-sdn","type":"openshift-sdn"}
Apr 30 10:37:18 ip-10-0-128-167 crio[2574]: 2019-04-30T10:37:18Z [error] Multus: error in invoke Delegate del - "openshift-sdn": failed to send CNI request: Post http://dummy/: dial unix /var/run/openshift-sdn/cni-server.sock: connect: no such file or directory
Apr 30 10:37:18 ip-10-0-128-167 crio[2574]: time="2019-04-30 10:37:18.761334406Z" level=error msg="Error deleting network: Multus: error in invoke Delegate del - "openshift-sdn": failed to send CNI request: Post http://dummy/: dial unix /var/run/openshift-sdn/cni-server.sock: connect: no such file or directory

We should be deleting both the openshift-sdn and multus configuration files on boot. Then, multus waits for openshift-sdn to come up before writing its own configuration file.

Comment 1 Casey Callendrello 2019-04-30 12:01:30 UTC
I also noticed that our current file that removes the openshift-sdn file is broken due to a directory change.

Comment 2 Casey Callendrello 2019-04-30 12:20:59 UTC
filed https://github.com/openshift/machine-config-operator/pull/685

Comment 5 Meng Bo 2019-05-08 12:16:57 UTC
Tested on 4.1.0-0.nightly-2019-05-08-065958

There is no such error on the node boot up

Comment 7 errata-xmlrpc 2019-06-04 10:48:18 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2019:0758