Hide Forgot
Created attachment 1160630 [details] vdsm logs Description of problem: vdsmd is not running and restore networks failed after server reboot. supervdsm.log --> restore-net::ERROR::2016-05-23 15:03:35,105::__init__::54::root::(__exit__) Failed rollback transaction last known good network. Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/network/netswitch.py", line 130, in _setup_legacy bondings, _netinfo) File "/usr/lib/python2.7/site-packages/vdsm/network/legacy_switch.py", line 471, in add_missing_networks _netinfo=_netinfo, **attrs) File "/usr/lib/python2.7/site-packages/vdsm/network/legacy_switch.py", line 180, in wrapped return func(network, configurator, **kwargs) File "/usr/lib/python2.7/site-packages/vdsm/network/legacy_switch.py", line 250, in _add_network net_ent_to_configure.configure(**options) File "/usr/lib/python2.7/site-packages/vdsm/network/models.py", line 186, in configure self.configurator.configureBridge(self, **opts) File "/usr/lib/python2.7/site-packages/vdsm/network/configurators/ifcfg.py", line 111, in configureBridge _ifup(bridge) File "/usr/lib/python2.7/site-packages/vdsm/network/configurators/ifcfg.py", line 846, in _ifup _exec_ifup(iface, cgroup) File "/usr/lib64/python2.7/contextlib.py", line 24, in __exit__ self.gen.next() File "/usr/lib/python2.7/site-packages/vdsm/network/configurators/ifcfg.py", line 991, in _wait_for_event mon.stop() File "/usr/lib/python2.7/site-packages/vdsm/network/netlink/monitor.py", line 164, in stop raise MonitorError(E_NOT_RUNNING) MonitorError: 1 restore-net::INFO::2016-05-23 15:03:35,107::netconfpersistence::198::root::(_clearDisk) Clearing /var/run/vdsm/netconf/nets/ and /var/run/vdsm/netconf/bonds/ restore-net::DEBUG::2016-05-23 15:03:35,107::netconfpersistence::193::root::(_clear_dir) No existent config to clear on /var/run/vdsm/netconf/bonds/ restore-net::ERROR::2016-05-23 15:03:35,107::vdsm-restore-net-config::447::root::(restore) unified restoration failed. Traceback (most recent call last): File "/usr/share/vdsm/vdsm-restore-net-config", line 442, in restore unified_restoration() File "/usr/share/vdsm/vdsm-restore-net-config", line 142, in unified_restoration '_inRollback': True}) File "/usr/lib/python2.7/site-packages/vdsm/network/api.py", line 228, in setupNetworks _setup_networks(networks, bondings, options) File "/usr/lib/python2.7/site-packages/vdsm/network/api.py", line 255, in _setup_networks netswitch.setup(networks, bondings, options, in_rollback) File "/usr/lib/python2.7/site-packages/vdsm/network/netswitch.py", line 109, in setup _setup_legacy(legacy_nets, legacy_bonds, options, in_rollback) File "/usr/lib/python2.7/site-packages/vdsm/network/netswitch.py", line 130, in _setup_legacy bondings, _netinfo) File "/usr/lib/python2.7/site-packages/vdsm/network/legacy_switch.py", line 471, in add_missing_networks _netinfo=_netinfo, **attrs) File "/usr/lib/python2.7/site-packages/vdsm/network/legacy_switch.py", line 180, in wrapped return func(network, configurator, **kwargs) File "/usr/lib/python2.7/site-packages/vdsm/network/legacy_switch.py", line 250, in _add_network net_ent_to_configure.configure(**options) File "/usr/lib/python2.7/site-packages/vdsm/network/models.py", line 186, in configure self.configurator.configureBridge(self, **opts) File "/usr/lib/python2.7/site-packages/vdsm/network/configurators/ifcfg.py", line 111, in configureBridge _ifup(bridge) File "/usr/lib/python2.7/site-packages/vdsm/network/configurators/ifcfg.py", line 846, in _ifup _exec_ifup(iface, cgroup) File "/usr/lib64/python2.7/contextlib.py", line 24, in __exit__ self.gen.next() File "/usr/lib/python2.7/site-packages/vdsm/network/configurators/ifcfg.py", line 991, in _wait_for_event mon.stop() File "/usr/lib/python2.7/site-packages/vdsm/network/netlink/monitor.py", line 164, in stop raise MonitorError(E_NOT_RUNNING) MonitorError: 1 Version-Release number of selected component (if applicable): vdsm-4.18.0-16.git51df339.el7.centos.x86_64 4.0.0-0.7.master.el7ev How reproducible: Not clear, every second reboot on puma22.scl.lab.tlv.redhat.com HW for example. Steps to Reproduce: 1. Install host 4.0 in engine 4.0(latest downstream) 2. Reboot server Actual results: Failed rollback transaction last known good network unified restoration failed vdsmd is nor running and host stays in non-responsive state in the engine Expected results: Should work as expected, restore-net should work and vdsmd must run after reboots Additional info:
Verified on - 4.0.0.2-0.1.el7ev and vdsm-4.18.1-11.gita92976e.el7ev.x86_64
oVirt 4.0.0 has been released, closing current release.