Bug 1774740

Summary: Failure of logrotate to exit causes cron.daily to lock indefinitely
Product: Red Hat Enterprise Linux Fast Datapath Reporter: Robert McSwain <rmcswain>
Component: openvswitchAssignee: OVN Team <ovnteam>
openvswitch sub component: other QA Contact: Jianlin Shi <jishi>
Status: NEW --- Docs Contact:
Severity: high    
Priority: unspecified CC: cshao, ctrautma, dholler, gveitmic, hyupark, lsvaty, mavital, mwest, peyu, qding, qiyuan, weiwang, yaniwang
Version: FDB 18.04   
Target Milestone: ---   
Target Release: ---   
Hardware: x86_64   
OS: Linux   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: Network RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Robert McSwain 2019-11-20 20:28:44 UTC
Issue:

Failure of "ovs-appctl -t /var/run/openvswitch/ovn-controller.$pid.ctl" to exit causes logrotate run to hang and cron.daily to lock indefinitely. 

Found that logrotate run from cron.daily is hanging on running /etc/logrotate.d/openvswitch, and more specifically on rotating portion of rotating the ovn-controller log which calls for `ovs-appctl -t "$ctl"  vlog/reopen 2>/dev/null" 

This is only failing for the ovn-controller, not ovsdb-server or ovs-vswitchd. 

/var/log/cron contains multiple entries containing "Job `cron.daily' locked by another anacron - skipping


Steps to Reproduce:
Run
# ovs-appctl -t /var/run/openvswitch/ovn-controller.$pid.ctl 

Observe that this fails on any hypervisor it's run on, even when run manually, hanging indefinitely.

Other notes:
There do not seem to be any logs at this time showing why this fails. Any additional debugging steps would be appreciated.

Comment 1 Dominik Holler 2019-11-25 14:00:00 UTC
I am unsure about the FDB version, yum says:
2.9.0-104.el7fdp