Bug 1530348

Summary: start/restart/reload of openvswitch service fails after yum update to ovs-2.9.0-0.2.20171212git6625e43.el7fdb
Product: Red Hat Enterprise Linux 7 Reporter: Jean-Tsung Hsiao <jhsiao>
Component: openvswitchAssignee: Aaron Conole <aconole>
Status: CLOSED DUPLICATE QA Contact: Jean-Tsung Hsiao <jhsiao>
Severity: high Docs Contact:
Priority: high    
Version: 7.5CC: atragler, ctrautma, fleitner, jhsiao, kzhang, manish2479, ralongi, rcain
Target Milestone: rc   
Target Release: ---   
Hardware: x86_64   
OS: Linux   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2018-01-08 19:29:09 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Jean-Tsung Hsiao 2018-01-02 17:06:01 UTC
Description of problem: Openvswitch upgrade from ovs-2.7.3-2 to ovs-2.9.0-0.2.20171212git6625e43.el7fdb


Version-Release number of selected component (if applicable):
[root@netqe5 hugepages]# rpm -q openvswitch
openvswitch-2.9.0-0.2.20171212git6625e43.el7fdb.x86_64
[root@netqe5 hugepages]# uname -a
Linux netqe5.knqe.lab.eng.bos.redhat.com 3.10.0-823.el7.x86_64 #1 SMP Wed Dec 13 21:17:45 EST 2017 x86_64 x86_64 x86_64 GNU/Linux

How reproducible: Reproducible


Steps to Reproduce:
1. Yum update from 2.7.3-2 to openvswitch- 2.9.0-0.2.20171212git6625e43.el7fdb.x86_64

2. systemctl start openvswitch
3.

Actual results: failed


Expected results: should succeed


Additional info:

Comment 2 Flavio Leitner 2018-01-05 13:30:58 UTC
Can you at least provide what is failing?
OVS logs and journal log is necessary here,

Comment 3 Jean-Tsung Hsiao 2018-01-07 16:24:39 UTC
(In reply to Flavio Leitner from comment #2)
> Can you at least provide what is failing?
> OVS logs and journal log is necessary here,

Hi Flavio,

Attached are two logs: "systemctl status ovsdb-server" and "journalctl -u ovsdb-server" collected when I worked with Aaron.

Based on the second log it looks like a ownership isse of/etc/openvswitch/conf.d file.

Jan 02 11:46:37 <jhsiao>        Starting ovsdb-server ovsdb-server: I/O error: /etc/openvswitch/conf.d
Jan 02 11:46:37 <jhsiao>        Jan 02 11:20:49 netqe5.knqe.lab.eng.bos.redhat.com ovs-ctl[2470]: [FAILED]
Jan 02 11:49:18 <jhsiao>        ownership issue of conf.d ?
Jan 02 11:50:52 <jhsiao>        I did a "yum update" from 2.7 to 2.9
Jan 02 11:57:59 <aconole>       okay.  there could be.


Thanks!

Jean

[root@netqe5 hugepages]# systemctl status ovsdb-server
● ovsdb-server.service - Open vSwitch Database Unit
   Loaded: loaded (/usr/lib/systemd/system/ovsdb-server.service; static; vendor preset: disabled)
   Active: failed (Result: start-limit) since Tue 2018-01-02 11:20:50 EST; 17min ago
  Process: 2642 ExecStart=/usr/share/openvswitch/scripts/ovs-ctl --no-ovs-vswitchd --no-monitor --system-id=random --ovs-user=${OVS_USER_ID} start $OPTIONS (code=exited, status=1/FAILURE)
  Process: 2639 ExecStartPre=/usr/bin/chown ${OVS_USER_ID} /var/run/openvswitch (code=exited, status=0/SUCCESS)
 
Jan 02 11:20:50 netqe5.knqe.lab.eng.bos.redhat.com systemd[1]: Failed to start Open vSwitch Database Unit.
Jan 02 11:20:50 netqe5.knqe.lab.eng.bos.redhat.com systemd[1]: Unit ovsdb-server.service entered failed state.
Jan 02 11:20:50 netqe5.knqe.lab.eng.bos.redhat.com systemd[1]: ovsdb-server.service failed.
Jan 02 11:20:50 netqe5.knqe.lab.eng.bos.redhat.com systemd[1]: ovsdb-server.service holdoff time over, scheduling restart.
Jan 02 11:20:50 netqe5.knqe.lab.eng.bos.redhat.com systemd[1]: start request repeated too quickly for ovsdb-server.service
Jan 02 11:20:50 netqe5.knqe.lab.eng.bos.redhat.com systemd[1]: Failed to start Open vSwitch Database Unit.
Jan 02 11:20:50 netqe5.knqe.lab.eng.bos.redhat.com systemd[1]: Unit ovsdb-server.service entered failed state.
Jan 02 11:20:50 netqe5.knqe.lab.eng.bos.redhat.com systemd[1]: ovsdb-server.service failed.
[root@netqe5 hugepages]# systemctl status openvswitch
● openvswitch.service - Open vSwitch
   Loaded: loaded (/usr/lib/systemd/system/openvswitch.service; disabled; vendor preset: disabled)
   Active: inactive (dead)
 
Jan 02 11:20:49 netqe5.knqe.lab.eng.bos.redhat.com systemd[1]: Dependency failed for Open vSwitch.
Jan 02 11:20:49 netqe5.knqe.lab.eng.bos.redhat.com systemd[1]: Job openvswitch.service/start failed with result 'dependency'.
[root@netqe5 hugepages]# systemctl status ovs-vswitchd
● ovs-vswitchd.service - Open vSwitch Forwarding Unit
   Loaded: loaded (/usr/lib/systemd/system/ovs-vswitchd.service; static; vendor preset: disabled)
   Active: inactive (dead)
 
Jan 02 11:20:49 netqe5.knqe.lab.eng.bos.redhat.com systemd[1]: Dependency failed for Open vSwitch Forwarding Unit.
Jan 02 11:20:49 netqe5.knqe.lab.eng.bos.redhat.com systemd[1]: Job ovs-vswitchd.service/start failed with result 'dependency'.

    [root@netqe5 hugepages]# journalctl -u ovsdb-server
    -- Logs begin at Tue 2018-01-02 06:19:38 EST, end at Tue 2018-01-02 11:40:01 EST. --
    Jan 02 11:20:48 netqe5.knqe.lab.eng.bos.redhat.com systemd[1]: Starting Open vSwitch Database Unit...
    Jan 02 11:20:48 netqe5.knqe.lab.eng.bos.redhat.com runuser[2501]: pam_unix(runuser:session): session opened for user root by (ui
    Jan 02 11:20:48 netqe5.knqe.lab.eng.bos.redhat.com runuser[2501]: pam_unix(runuser:session): session closed for user root
    Jan 02 11:20:48 netqe5.knqe.lab.eng.bos.redhat.com runuser[2504]: pam_unix(runuser:session): session opened for user root by (ui
    Jan 02 11:20:48 netqe5.knqe.lab.eng.bos.redhat.com runuser[2504]: pam_unix(runuser:session): session closed for user root
    Jan 02 11:20:49 netqe5.knqe.lab.eng.bos.redhat.com ovs-ctl[2470]: Starting ovsdb-server ovsdb-server: I/O error: /etc/openvswitc
    Jan 02 11:20:49 netqe5.knqe.lab.eng.bos.redhat.com ovs-ctl[2470]: [FAILED]
    Jan 02 11:20:49 netqe5.knqe.lab.eng.bos.redhat.com systemd[1]: ovsdb-server.service: control process exited, code=exited status=
    Jan 02 11:20:49 netqe5.knqe.lab.eng.bos.redhat.com systemd[1]: Failed to start Open vSwitch Database Unit.
    Jan 02 11:20:49 netqe5.knqe.lab.eng.bos.redhat.com systemd[1]: Unit ovsdb-server.service entered failed state.
    Jan 02 11:20:49 netqe5.knqe.lab.eng.bos.redhat.com systemd[1]: ovsdb-server.service failed.
    Jan 02 11:20:49 netqe5.knqe.lab.eng.bos.redhat.com systemd[1]: ovsdb-server.service holdoff time over, scheduling restart.
    Jan 02 11:20:49 netqe5.knqe.lab.eng.bos.redhat.com systemd[1]: Starting Open vSwitch Database Unit...
    Jan 02 11:20:49 netqe5.knqe.lab.eng.bos.redhat.com runuser[2544]: pam_unix(runuser:session): session opened for user root by (ui
    Jan 02 11:20:49 netqe5.knqe.lab.eng.bos.redhat.com runuser[2544]: pam_unix(runuser:session): session closed for user root
    Jan 02 11:20:49 netqe5.knqe.lab.eng.bos.redhat.com runuser[2547]: pam_unix(runuser:session): session opened for user root by (ui
    Jan 02 11:20:49 netqe5.knqe.lab.eng.bos.redhat.com runuser[2547]: pam_unix(runuser:session): session closed for user root
    Jan 02 11:20:49 netqe5.knqe.lab.eng.bos.redhat.com ovs-ctl[2513]: Starting ovsdb-server ovsdb-server: I/O error: /etc/openvswitc
    Jan 02 11:20:49 netqe5.knqe.lab.eng.bos.redhat.com ovs-ctl[2513]: [FAILED]
    Jan 02 11:20:49 netqe5.knqe.lab.eng.bos.redhat.com systemd[1]: ovsdb-server.service: control process exited, code=exited status=
    Jan 02 11:20:49 netqe5.knqe.lab.eng.bos.redhat.com systemd[1]: Failed to start Open vSwitch Database Unit.
    Jan 02 11:20:49 netqe5.knqe.lab.eng.bos.redhat.com systemd[1]: Unit ovsdb-server.service entered failed state.
    Jan 02 11:20:49 netqe5.knqe.lab.eng.bos.redhat.com systemd[1]: ovsdb-server.service failed.
    Jan 02 11:20:49 netqe5.knqe.lab.eng.bos.redhat.com systemd[1]: ovsdb-server.service holdoff time over, scheduling restart.
    Jan 02 11:20:49 netqe5.knqe.lab.eng.bos.redhat.com systemd[1]: Starting Open vSwitch Database Unit...
    Jan 02 11:20:49 netqe5.knqe.lab.eng.bos.redhat.com runuser[2587]: pam_unix(runuser:session): session opened for user root by (ui
    Jan 02 11:20:49 netqe5.knqe.lab.eng.bos.redhat.com runuser[2587]: pam_unix(runuser:session): session closed for user root
    Jan 02 11:20:49 netqe5.knqe.lab.eng.bos.redhat.com runuser[2590]: pam_unix(runuser:session): session opened for user root by (ui
    Jan 02 11:20:49 netqe5.knqe.lab.eng.bos.redhat.com runuser[2590]: pam_unix(runuser:session): session closed for user root
    Jan 02 11:20:49 netqe5.knqe.lab.eng.bos.redhat.com ovs-ctl[2556]: Starting ovsdb-server ovsdb-server: I/O error: /etc/openvswitc
    Jan 02 11:20:49 netqe5.knqe.lab.eng.bos.redhat.com ovs-ctl[2556]: [FAILED]
    Jan 02 11:20:49 netqe5.knqe.lab.eng.bos.redhat.com systemd[1]: ovsdb-server.service: control process exited, code=exited status=
    Jan 02 11:20:49 netqe5.knqe.lab.eng.bos.redhat.com systemd[1]: Failed to start Open vSwitch Database Unit.
    Jan 02 11:20:49 netqe5.knqe.lab.eng.bos.redhat.com systemd[1]: Unit ovsdb-server.service entered failed state.
    Jan 02 11:20:49 netqe5.knqe.lab.eng.bos.redhat.com systemd[1]: ovsdb-server.service failed.
    Jan 02 11:20:49 netqe5.knqe.lab.eng.bos.redhat.com systemd[1]: ovsdb-server.service holdoff time over, scheduling restart.
    Jan 02 11:20:49 netqe5.knqe.lab.eng.bos.redhat.com systemd[1]: Starting Open vSwitch Database Unit...
    Jan 02 11:20:49 netqe5.knqe.lab.eng.bos.redhat.com runuser[2630]: pam_unix(runuser:session): session opened for user root by (ui
    Jan 02 11:20:49 netqe5.knqe.lab.eng.bos.redhat.com runuser[2630]: pam_unix(runuser:session): session closed for user root
    Jan 02 11:20:49 netqe5.knqe.lab.eng.bos.redhat.com runuser[2633]: pam_unix(runuser:session): session opened for user root by (ui
    Jan 02 11:20:49 netqe5.knqe.lab.eng.bos.redhat.com runuser[2633]: pam_unix(runuser:session): session closed for user root
    Jan 02 11:20:49 netqe5.knqe.lab.eng.bos.redhat.com ovs-ctl[2599]: Starting ovsdb-server ovsdb-server: I/O error: /etc/openvswitc
    Jan 02 11:20:49 netqe5.knqe.lab.eng.bos.redhat.com ovs-ctl[2599]: [FAILED]
    Jan 02 11:20:49 netqe5.knqe.lab.eng.bos.redhat.com systemd[1]: ovsdb-server.service: control process exited, code=exited status=
    Jan 02 11:20:49 netqe5.knqe.lab.eng.bos.redhat.com systemd[1]: Failed to start Open vSwitch Database Unit.
    Jan 02 11:20:49 netqe5.knqe.lab.eng.bos.redhat.com systemd[1]: Unit ovsdb-server.service entered failed state.
    Jan 02 11:20:49 netqe5.knqe.lab.eng.bos.redhat.com systemd[1]: ovsdb-server.service failed.
    Jan 02 11:20:50 netqe5.knqe.lab.eng.bos.redhat.com systemd[1]: ovsdb-server.service holdoff time over, scheduling restart.
    Jan 02 11:20:50 netqe5.knqe.lab.eng.bos.redhat.com systemd[1]: Starting Open vSwitch Database Unit...
    Jan 02 11:20:50 netqe5.knqe.lab.eng.bos.redhat.com runuser[2673]: pam_unix(runuser:session): session opened for user root by (ui
    Jan 02 11:20:50 netqe5.knqe.lab.eng.bos.redhat.com runuser[2673]: pam_unix(runuser:session): session closed for user root
    Jan 02 11:20:50 netqe5.knqe.lab.eng.bos.redhat.com runuser[2676]: pam_unix(runuser:session): session opened for user root by (ui
    Jan 02 11:20:50 netqe5.knqe.lab.eng.bos.redhat.com runuser[2676]: pam_unix(runuser:session): session closed for user root
    Jan 02 11:20:50 netqe5.knqe.lab.eng.bos.redhat.com ovs-ctl[2642]: Starting ovsdb-server ovsdb-server: I/O error: /etc/openvswitc
    Jan 02 11:20:50 netqe5.knqe.lab.eng.bos.redhat.com ovs-ctl[2642]: [FAILED]
    Jan 02 11:20:50 netqe5.knqe.lab.eng.bos.redhat.com systemd[1]: ovsdb-server.service: control process exited, code=exited status=
    Jan 02 11:20:50 netqe5.knqe.lab.eng.bos.redhat.com systemd[1]: Failed to start Open vSwitch Database Unit.
    Jan 02 11:20:50 netqe5.knqe.lab.eng.bos.redhat.com systemd[1]: Unit ovsdb-server.service entered failed state.
    Jan 02 11:20:50 netqe5.knqe.lab.eng.bos.redhat.com systemd[1]: ovsdb-server.service failed.
    Jan 02 11:20:50 netqe5.knqe.lab.eng.bos.redhat.com systemd[1]: ovsdb-server.service holdoff time over, scheduling restart.
    Jan 02 11:20:50 netqe5.knqe.lab.eng.bos.redhat.com systemd[1]: start request repeated too quickly for ovsdb-server.service
    Jan 02 11:20:50 netqe5.knqe.lab.eng.bos.redhat.com systemd[1]: Failed to start Open vSwitch Database Unit.
    Jan 02 11:20:50 netqe5.knqe.lab.eng.bos.redhat.com systemd[1]: Unit ovsdb-server.service entered failed state.
    Jan 02 11:20:50 netqe5.knqe.lab.eng.bos.redhat.com systemd[1]: ovsdb-server.service failed.
    [root@netqe5 hugepages]#

Comment 4 Rick Alongi 2018-01-08 15:43:14 UTC
I installed the openstack selinux packages and attempted an update from openvswitch 2.850.4 to 2.9.0.2.  Service will not reload or restart.

There appears to be a problem with the /etc/openvswitch/conf.db file during the update/restart/reload process.

Info on steps below:

[root@netqe13 openvswitch]# yum install http://download-node-02.eng.bos.redhat.com/brewroot/packages/openvswitch/2.8.0/4.el7fdb/x86_64/openvswitch-2.8.0-4.el7fdb.x86_64.rpm
Loaded plugins: langpacks, product-id, search-disabled-repos, subscription-manager
This system is not registered with an entitlement server. You can use subscription-manager to register.
openvswitch-2.8.0-4.el7fdb.x86_64.rpm                                                                                                        | 6.1 MB  00:00:00     
Examining /var/tmp/yum-root-ldTneD/openvswitch-2.8.0-4.el7fdb.x86_64.rpm: 1:openvswitch-2.8.0-4.el7fdb.x86_64
Marking /var/tmp/yum-root-ldTneD/openvswitch-2.8.0-4.el7fdb.x86_64.rpm to be installed
Resolving Dependencies
--> Running transaction check
---> Package openvswitch.x86_64 1:2.8.0-4.el7fdb will be installed
--> Finished Dependency Resolution

Dependencies Resolved

====================================================================================================================================================================
 Package                          Arch                        Version                                 Repository                                               Size
====================================================================================================================================================================
Installing:
 openvswitch                      x86_64                      1:2.8.0-4.el7fdb                        /openvswitch-2.8.0-4.el7fdb.x86_64                       21 M

Transaction Summary
====================================================================================================================================================================
Install  1 Package

Total size: 21 M
Installed size: 21 M
Is this ok [y/d/N]: y
Downloading packages:
Running transaction check
Running transaction test
Transaction test succeeded
Running transaction
  Installing : 1:openvswitch-2.8.0-4.el7fdb.x86_64                                                                                                              1/1 
  Verifying  : 1:openvswitch-2.8.0-4.el7fdb.x86_64                                                                                                              1/1 

Installed:
  openvswitch.x86_64 1:2.8.0-4.el7fdb                                                                                                                               

Complete!

[root@netqe13 openvswitch]# systemctl enable openvswitch
Created symlink from /etc/systemd/system/multi-user.target.wants/openvswitch.service to /usr/lib/systemd/system/openvswitch.service.

[root@netqe13 openvswitch]# systemctl start openvswitch

[root@netqe13 openvswitch]# ovs-vsctl show
2c977b77-ec12-42a8-8098-6dd785950a27
    ovs_version: "2.8.0"
    
[root@netqe13 openvswitch]# systemctl status openvswitch
● openvswitch.service - Open vSwitch
   Loaded: loaded (/usr/lib/systemd/system/openvswitch.service; enabled; vendor preset: disabled)
   Active: active (exited) since Mon 2018-01-08 10:16:41 EST; 12s ago
  Process: 44458 ExecStart=/bin/true (code=exited, status=0/SUCCESS)
 Main PID: 44458 (code=exited, status=0/SUCCESS)

Jan 08 10:16:41 netqe13.knqe.lab.eng.bos.redhat.com systemd[1]: Starting Open vSwitch...
Jan 08 10:16:41 netqe13.knqe.lab.eng.bos.redhat.com systemd[1]: Started Open vSwitch.

[root@netqe13 openvswitch]# rpm -q container-selinux
container-selinux-2.36-1.gitff95335.el7.noarch

[root@netqe13 openvswitch]# rpm -q openstack-selinux
openstack-selinux-0.8.12-0.20171204232656.7e9ef4a.el7ost.noarch

[root@netqe13 openvswitch]# ls -alth /etc/openvswitch/
total 52K
-rw-r--r--.   1 openvswitch openvswitch  15K Jan  8 10:16 conf.db
drwxr-xr-x.   2 openvswitch openvswitch  124 Jan  8 10:16 .
drwxr-xr-x. 114 root        root        8.0K Jan  8 10:16 ..
-rw-r--r--.   1 openvswitch openvswitch  15K Jan  8 10:14 conf.db.backup7.15.0-544856471
-rw-r--r--.   1 openvswitch openvswitch   37 Jan  5 15:44 system-id.conf
-rw-------.   1 openvswitch openvswitch    0 Jan  5 15:44 .conf.db.~lock~
-rw-r--r--.   1 openvswitch openvswitch  163 Aug 30 19:00 default.conf

[root@netqe13 openvswitch]# yum -y update http://download-node-02.eng.bos.redhat.com/brewroot/packages/openvswitch/2.9.0/0.2.20171212git6625e43.el7fdb/x86_64/openvswitch-2.9.0-0.2.20171212git6625e43.el7fdb.x86_64.rpm
Loaded plugins: langpacks, product-id, search-disabled-repos, subscription-manager
This system is not registered with an entitlement server. You can use subscription-manager to register.
openvswitch-2.9.0-0.2.20171212git6625e43.el7fdb.x86_64.rpm                                                                                   | 6.1 MB  00:00:00     
Examining /var/tmp/yum-root-ldTneD/openvswitch-2.9.0-0.2.20171212git6625e43.el7fdb.x86_64.rpm: 1:openvswitch-2.9.0-0.2.20171212git6625e43.el7fdb.x86_64
Marking /var/tmp/yum-root-ldTneD/openvswitch-2.9.0-0.2.20171212git6625e43.el7fdb.x86_64.rpm as an update to 1:openvswitch-2.8.0-4.el7fdb.x86_64
Resolving Dependencies
--> Running transaction check
---> Package openvswitch.x86_64 1:2.8.0-4.el7fdb will be updated
---> Package openvswitch.x86_64 1:2.9.0-0.2.20171212git6625e43.el7fdb will be an update
--> Finished Dependency Resolution

Dependencies Resolved

====================================================================================================================================================================
 Package                Arch              Version                                          Repository                                                          Size
====================================================================================================================================================================
Updating:
 openvswitch            x86_64            1:2.9.0-0.2.20171212git6625e43.el7fdb            /openvswitch-2.9.0-0.2.20171212git6625e43.el7fdb.x86_64             21 M

Transaction Summary
====================================================================================================================================================================
Upgrade  1 Package

Total size: 21 M
Downloading packages:
Running transaction check
Running transaction test
Transaction test succeeded
Running transaction
  Updating   : 1:openvswitch-2.9.0-0.2.20171212git6625e43.el7fdb.x86_64                                                                                         1/2 
  Cleanup    : 1:openvswitch-2.8.0-4.el7fdb.x86_64                                                                                                              2/2 
  Verifying  : 1:openvswitch-2.9.0-0.2.20171212git6625e43.el7fdb.x86_64                                                                                         1/2 
  Verifying  : 1:openvswitch-2.8.0-4.el7fdb.x86_64                                                                                                              2/2 

Updated:
  openvswitch.x86_64 1:2.9.0-0.2.20171212git6625e43.el7fdb                                                                                                          

Complete!

[root@netqe13 openvswitch]# ls -alth /etc/openvswitch/
total 52K
drwxr-xr-x.   2 root        root         124 Jan  8 10:18 .
-rw-r--r--.   1 openvswitch openvswitch  15K Jan  8 10:16 conf.db
drwxr-xr-x. 114 root        root        8.0K Jan  8 10:16 ..
-rw-r--r--.   1 openvswitch openvswitch  15K Jan  8 10:14 conf.db.backup7.15.0-544856471
-rw-r--r--.   1 openvswitch openvswitch   37 Jan  5 15:44 system-id.conf
-rw-------.   1 openvswitch openvswitch    0 Jan  5 15:44 .conf.db.~lock~
-rw-r--r--.   1 root        root         163 Dec 11 19:01 default.conf

[root@netqe13 openvswitch]# ovs-vsctl show
2c977b77-ec12-42a8-8098-6dd785950a27
    ovs_version: "2.8.0"
    
[root@netqe13 openvswitch]# rpm -q openvswitch
openvswitch-2.9.0-0.2.20171212git6625e43.el7fdb.x86_64

[root@netqe13 openvswitch]# systemctl reload openvswitch
A dependency job for openvswitch.service failed. See 'journalctl -xe' for details.

[root@netqe13 openvswitch]# journalctl -xe
Jan 08 10:19:31 netqe13.knqe.lab.eng.bos.redhat.com ovs-ctl[44977]: /etc/openvswitch/conf.db does not exist ... (warning).
Jan 08 10:19:31 netqe13.knqe.lab.eng.bos.redhat.com runuser[45012]: pam_unix(runuser:session): session opened for user openvswitch by (uid=0)
Jan 08 10:19:31 netqe13.knqe.lab.eng.bos.redhat.com ovs-ctl[44977]: Creating empty database /etc/openvswitch/conf.db ovsdb-tool: I/O error: /etc/openvswitch/conf.db
Jan 08 10:19:31 netqe13.knqe.lab.eng.bos.redhat.com runuser[45012]: pam_unix(runuser:session): session closed for user openvswitch
Jan 08 10:19:31 netqe13.knqe.lab.eng.bos.redhat.com ovs-ctl[44977]: [FAILED]
Jan 08 10:19:31 netqe13.knqe.lab.eng.bos.redhat.com systemd[1]: ovsdb-server.service: control process exited, code=exited status=1
Jan 08 10:19:31 netqe13.knqe.lab.eng.bos.redhat.com systemd[1]: Failed to start Open vSwitch Database Unit.
-- Subject: Unit ovsdb-server.service has failed
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit ovsdb-server.service has failed.
-- 
-- The result is failed.
Jan 08 10:19:31 netqe13.knqe.lab.eng.bos.redhat.com systemd[1]: Unit ovsdb-server.service entered failed state.
Jan 08 10:19:31 netqe13.knqe.lab.eng.bos.redhat.com systemd[1]: ovsdb-server.service failed.
Jan 08 10:19:31 netqe13.knqe.lab.eng.bos.redhat.com systemd[1]: ovsdb-server.service holdoff time over, scheduling restart.
Jan 08 10:19:31 netqe13.knqe.lab.eng.bos.redhat.com systemd[1]: start request repeated too quickly for ovsdb-server.service
Jan 08 10:19:31 netqe13.knqe.lab.eng.bos.redhat.com systemd[1]: Failed to start Open vSwitch Database Unit.
-- Subject: Unit ovsdb-server.service has failed
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit ovsdb-server.service has failed.
-- 
-- The result is failed.
Jan 08 10:19:31 netqe13.knqe.lab.eng.bos.redhat.com systemd[1]: Unit ovsdb-server.service entered failed state.
Jan 08 10:19:31 netqe13.knqe.lab.eng.bos.redhat.com systemd[1]: ovsdb-server.service failed.

[root@netqe13 openvswitch]# ls -alth /etc/openvswitch/
total 36K
drwxr-xr-x.   2 root        root         109 Jan  8 10:19 .
-rw-r--r--.   1 openvswitch openvswitch  15K Jan  8 10:19 conf.db.backup7.15.0-544856471
drwxr-xr-x. 114 root        root        8.0K Jan  8 10:16 ..
-rw-r--r--.   1 openvswitch openvswitch   37 Jan  5 15:44 system-id.conf
-rw-------.   1 openvswitch openvswitch    0 Jan  5 15:44 .conf.db.~lock~
-rw-r--r--.   1 root        root         163 Dec 11 19:01 default.conf

[root@netqe13 openvswitch]# systemctl restart openvswitch
A dependency job for openvswitch.service failed. See 'journalctl -xe' for details.

[root@netqe13 openvswitch]# journalctl -xe
Jan 08 10:20:03 netqe13.knqe.lab.eng.bos.redhat.com ovs-ctl[45229]: /etc/openvswitch/conf.db does not exist ... (warning).
Jan 08 10:20:03 netqe13.knqe.lab.eng.bos.redhat.com runuser[45264]: pam_unix(runuser:session): session opened for user openvswitch by (uid=0)
Jan 08 10:20:03 netqe13.knqe.lab.eng.bos.redhat.com ovs-ctl[45229]: Creating empty database /etc/openvswitch/conf.db ovsdb-tool: I/O error: /etc/openvswitch/conf.db
Jan 08 10:20:03 netqe13.knqe.lab.eng.bos.redhat.com runuser[45264]: pam_unix(runuser:session): session closed for user openvswitch
Jan 08 10:20:03 netqe13.knqe.lab.eng.bos.redhat.com ovs-ctl[45229]: [FAILED]
Jan 08 10:20:03 netqe13.knqe.lab.eng.bos.redhat.com systemd[1]: ovsdb-server.service: control process exited, code=exited status=1
Jan 08 10:20:03 netqe13.knqe.lab.eng.bos.redhat.com systemd[1]: Failed to start Open vSwitch Database Unit.
-- Subject: Unit ovsdb-server.service has failed
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit ovsdb-server.service has failed.
-- 
-- The result is failed.
Jan 08 10:20:03 netqe13.knqe.lab.eng.bos.redhat.com systemd[1]: Unit ovsdb-server.service entered failed state.
Jan 08 10:20:03 netqe13.knqe.lab.eng.bos.redhat.com systemd[1]: ovsdb-server.service failed.
Jan 08 10:20:03 netqe13.knqe.lab.eng.bos.redhat.com systemd[1]: ovsdb-server.service holdoff time over, scheduling restart.
Jan 08 10:20:03 netqe13.knqe.lab.eng.bos.redhat.com systemd[1]: start request repeated too quickly for ovsdb-server.service
Jan 08 10:20:03 netqe13.knqe.lab.eng.bos.redhat.com systemd[1]: Failed to start Open vSwitch Database Unit.
-- Subject: Unit ovsdb-server.service has failed
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit ovsdb-server.service has failed.
-- 
-- The result is failed.
Jan 08 10:20:03 netqe13.knqe.lab.eng.bos.redhat.com systemd[1]: Unit ovsdb-server.service entered failed state.
Jan 08 10:20:03 netqe13.knqe.lab.eng.bos.redhat.com systemd[1]: ovsdb-server.service failed.

[root@netqe13 openvswitch]# ls -alth /etc/openvswitch/
total 36K
drwxr-xr-x.   2 root        root         109 Jan  8 10:19 .
-rw-r--r--.   1 openvswitch openvswitch  15K Jan  8 10:19 conf.db.backup7.15.0-544856471
drwxr-xr-x. 114 root        root        8.0K Jan  8 10:16 ..
-rw-r--r--.   1 openvswitch openvswitch   37 Jan  5 15:44 system-id.conf
-rw-------.   1 openvswitch openvswitch    0 Jan  5 15:44 .conf.db.~lock~
-rw-r--r--.   1 root        root         163 Dec 11 19:01 default.conf

Comment 5 Aaron Conole 2018-01-08 19:29:09 UTC
This should be fixed with the bugfix applied for 1489465 - please test with 2.9.0-0.3 to confirm - if it still is an issue reopen.

*** This bug has been marked as a duplicate of bug 1489465 ***

Comment 6 Manish 2018-05-31 19:19:51 UTC
Hi,

I upgraded to openvswitch-2.9.0-3.el7.x86_64 and still the problem exists.

Thank You