Bug 1906655

Summary: [SDN]Cannot colloect ovsdb-server.log and ovs-vswitchd.log with gather_network_logs
Product: OpenShift Container Platform Reporter: huirwang
Component: NetworkingAssignee: Andrew Stoycos <astoycos>
Networking sub component: openshift-sdn QA Contact: huirwang
Status: CLOSED ERRATA Docs Contact:
Severity: medium    
Priority: medium CC: aconstan, anbhat, jdesousa
Version: 4.7   
Target Milestone: ---   
Target Release: 4.7.0   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2021-02-24 15:41:57 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description huirwang 2020-12-11 03:37:48 UTC
Description of problem:
Cannot colloect ovsdb-server.log and ovs-vswitchd.log with gather_network_logs

Version-Release number of selected component (if applicable):
4.7.0-0.nightly-2020-12-09-112139

How reproducible:
Always

Steps to Reproduce:
oc adm must-gather -- gather_network_logs huirwang-ipi1-4zcx6-worker-bqkk7
[must-gather      ] OUT Using must-gather plugin-in image: quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a2a827cef4c4925267cb3baa44d8de4990a8317c01239a985a3b9b4e5776b0b0
[must-gather      ] OUT namespace/openshift-must-gather-pn4x6 created
[must-gather      ] OUT clusterrolebinding.rbac.authorization.k8s.io/must-gather-sq7kw created
[must-gather      ] OUT pod for plug-in image quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a2a827cef4c4925267cb3baa44d8de4990a8317c01239a985a3b9b4e5776b0b0 created
[must-gather-g9brb] POD INFO: Gathering Multus data
[must-gather-g9brb] POD INFO: Gathering Openshift-SDN data
[must-gather-g9brb] POD INFO: Waiting for node network log collection to complete ...
[must-gather-g9brb] POD cat: /var/log/openvswitch/ovsdb-server.log: No such file or directory
[must-gather-g9brb] POD command terminated with exit code 1
[must-gather-g9brb] POD cat: /var/log/openvswitch/ovs-vswitchd.log: No such file or directory
[must-gather-g9brb] POD command terminated with exit code 1
[must-gather-g9brb] POD INFO: Node network log collection complete.
[must-gather-g9brb] OUT waiting for gather to complete
[must-gather-g9brb] OUT downloading gather output
[must-gather-g9brb] OUT receiving file list ... done
[must-gather-g9brb] OUT ./
[must-gather-g9brb] OUT network_logs/
[must-gather-g9brb] OUT network_logs/huirwang-ipi1-4zcx6-worker-bqkk7_iptables
[must-gather-g9brb] OUT network_logs/huirwang-ipi1-4zcx6-worker-bqkk7_ovs-gqqmn_ovsdb_log
[must-gather-g9brb] OUT network_logs/huirwang-ipi1-4zcx6-worker-bqkk7_ovs-gqqmn_vswitchd_log
[must-gather-g9brb] OUT network_logs/huirwang-ipi1-4zcx6-worker-bqkk7_ovs_dump
[must-gather-g9brb] OUT network_logs/ippools
[must-gather-g9brb] OUT network_logs/net_attach_def
[must-gather-g9brb] OUT network_logs/overlappingrangeipreservations
[must-gather-g9brb] OUT 
[must-gather-g9brb] OUT sent 182 bytes  received 112090 bytes  4236.68 bytes/sec
[must-gather-g9brb] OUT total size is 111484  speedup is 0.99
[must-gather      ] OUT clusterrolebinding.rbac.authorization.k8s.io/must-gather-sq7kw deleted
[must-gather      ] OUT namespace/openshift-must-gather-pn4x6 deleted

Actual results:
[must-gather-g9brb] POD cat: /var/log/openvswitch/ovsdb-server.log: No such file or directory
[must-gather-g9brb] POD command terminated with exit code 1
[must-gather-g9brb] POD cat: /var/log/openvswitch/ovs-vswitchd.log: No such file or directory
[must-gather-g9brb] POD command terminated with exit code 1

Expected results:
Should collect ovsdb-server.log and ovs-vswitchd.log without error.

Additional info:
Checked the code, currently using below way to collect logs in sdn. but it doesn't work any more.
 oc -n openshift-sdn exec ${OVS_POD} -- bash -c "cat /var/log/openvswitch/ovs-vswitchd.log" > ${NETWORK_LOG_PATH}/${NODE}_${OVS_POD}_vswitchd_log

oc -n openshift-sdn exec ovs-dtp5x -- bash -c "cat /var/log/openvswitch/ovs-vswitchd.log" > logs/ovs_vswitchd_log
cat: /var/log/openvswitch/ovs-vswitchd.log: No such file or directory
command terminated with exit code 1

oc rsh -n openshift-sdn ovs-dtp5x
sh-4.4# ls  /var/log/openvswitch/ovs-vswitchd.log
ls: cannot access '/var/log/openvswitch/ovs-vswitchd.log': No such file or directory

Comment 1 Andrew Stoycos 2020-12-18 22:17:59 UTC
See https://github.com/openshift/must-gather/pull/199

Comment 2 Juan Luis de Sousa-Valadas 2020-12-21 15:09:57 UTC
*** Bug 1907345 has been marked as a duplicate of this bug. ***

Comment 7 errata-xmlrpc 2021-02-24 15:41:57 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Moderate: OpenShift Container Platform 4.7.0 security, bug fix, and enhancement update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHSA-2020:5633