Description of problem: This is split from BZ1425194 after discussion at https://bugzilla.redhat.com/show_bug.cgi?id=1425194#c6 ~~~ Description of problem: I was testing 3.6 NGN to 4.1 upgrade and after reboot (...): ~~~ -- Logs begin at Mon 2017-02-20 19:33:14 CET, end at Mon 2017-02-20 19:36:36 CET. -- Feb 20 19:33:25 localhost.localdomain systemd[1]: Starting oVirt ImageIO Daemon... Feb 20 19:33:28 localhost.localdomain ovirt-imageio-daemon[1130]: Traceback (most recent call last): Feb 20 19:33:28 localhost.localdomain ovirt-imageio-daemon[1130]: File "/usr/bin/ovirt-imageio-daemon", line 14, in <module> Feb 20 19:33:28 localhost.localdomain ovirt-imageio-daemon[1130]: server.main(sys.argv) Feb 20 19:33:28 localhost.localdomain ovirt-imageio-daemon[1130]: File "/usr/lib/python2.7/site-packages/ovirt_imageio_daemon/server.py", line 50, in main Feb 20 19:33:28 localhost.localdomain ovirt-imageio-daemon[1130]: configure_logger() Feb 20 19:33:28 localhost.localdomain ovirt-imageio-daemon[1130]: File "/usr/lib/python2.7/site-packages/ovirt_imageio_daemon/server.py", line 68, in configure_logger Feb 20 19:33:28 localhost.localdomain ovirt-imageio-daemon[1130]: logging.config.fileConfig(conf, disable_existing_loggers=False) Feb 20 19:33:28 localhost.localdomain ovirt-imageio-daemon[1130]: File "/usr/lib64/python2.7/logging/config.py", line 78, in fileConfig Feb 20 19:33:28 localhost.localdomain ovirt-imageio-daemon[1130]: handlers = _install_handlers(cp, formatters) Feb 20 19:33:28 localhost.localdomain ovirt-imageio-daemon[1130]: File "/usr/lib64/python2.7/logging/config.py", line 156, in _install_handlers Feb 20 19:33:28 localhost.localdomain ovirt-imageio-daemon[1130]: h = klass(*args) Feb 20 19:33:28 localhost.localdomain ovirt-imageio-daemon[1130]: File "/usr/lib64/python2.7/logging/handlers.py", line 117, in __init__ Feb 20 19:33:28 localhost.localdomain ovirt-imageio-daemon[1130]: BaseRotatingHandler.__init__(self, filename, mode, encoding, delay) Feb 20 19:33:28 localhost.localdomain ovirt-imageio-daemon[1130]: File "/usr/lib64/python2.7/logging/handlers.py", line 64, in __init__ Feb 20 19:33:28 localhost.localdomain ovirt-imageio-daemon[1130]: logging.FileHandler.__init__(self, filename, mode, encoding, delay) Feb 20 19:33:28 localhost.localdomain ovirt-imageio-daemon[1130]: File "/usr/lib64/python2.7/logging/__init__.py", line 902, in __init__ Feb 20 19:33:28 localhost.localdomain ovirt-imageio-daemon[1130]: StreamHandler.__init__(self, self._open()) Feb 20 19:33:28 localhost.localdomain ovirt-imageio-daemon[1130]: File "/usr/lib64/python2.7/logging/__init__.py", line 925, in _open Feb 20 19:33:28 localhost.localdomain ovirt-imageio-daemon[1130]: stream = open(self.baseFilename, self.mode) ~~~ Following solved the issue [root@dell-r210ii-03 ~]# install -d -o vdsm -g kvm -m 755 /var/log/ovirt-imageio-daemon [root@dell-r210ii-03 ~]# systemctl restart ovirt-imageio-daemon [root@dell-r210ii-03 ~]# systemctl status ovirt-imageio-daemon ● ovirt-imageio-daemon.service - oVirt ImageIO Daemon Loaded: loaded (/usr/lib/systemd/system/ovirt-imageio-daemon.service; disabled; vendor preset: disabled) Active: active (running) since Mon 2017-02-20 19:38:59 CET; 3s ago Main PID: 26443 (ovirt-imageio-d) CGroup: /system.slice/ovirt-imageio-daemon.service └─26443 /usr/bin/python /usr/bin/ovirt-imageio-daemon Feb 20 19:38:59 dell-r210ii-03.rhev.lab.eng.brq.redhat.com systemd[1]: Starting oVirt ImageIO Daemon... Feb 20 19:38:59 dell-r210ii-03.rhev.lab.eng.brq.redhat.com systemd[1]: Started oVirt ImageIO Daemon. ~~~ Version-Release number of selected component (if applicable): redhat-release-virtualization-host-content-4.1-0.6.el7.x86_64 RHVH-3.6-20170217.5-RHVH-x86_64 How reproducible: 1 in 1 Steps to Reproduce: 1. have 3.6 ngn and upgrade into 4.1 ngn in 3.6 engine 2. 3. Actual results: ovirt-imageio-daemon not running Expected results: should be running Additional info:
which version of ovirt-imageio-daemon is installed after upgrade?
(In reply to Dan Kenigsberg from comment #2) > which version of ovirt-imageio-daemon is installed after upgrade? 3.6 ngn doesn't have imageio at all, so after upgrade to 4.1 ngn it will have its own imageio version: [root@dell-r210ii-03 ~]# rpm -qa ovirt\* ovirt-setup-lib-1.0.1-1.el7ev.noarch ovirt-node-ng-nodectl-4.0.4-0.20160920.0.el7.noarch ovirt-hosted-engine-ha-1.3.5.9-2.el7ev.noarch ovirt-vmconsole-1.0.4-1.el7ev.noarch ovirt-hosted-engine-setup-1.3.7.3-1.el7ev.noarch ovirt-vmconsole-host-1.0.4-1.el7ev.noarch ovirt-host-deploy-1.4.1-1.el7ev.noarch [root@dell-r210ii-03 ~]# rpm -qa \*virtualization-host redhat-release-virtualization-host-3.6-0.2.el7.x86_64 after upgrade to 4.1-beta ngn: [root@dell-r210ii-03 ~]# rpm -qa ovirt\* ovirt-node-ng-nodectl-4.1.0-0.20170104.1.el7.noarch ovirt-imageio-common-1.0.0-0.el7ev.noarch ovirt-engine-sdk-python-3.6.9.1-1.el7ev.noarch ovirt-setup-lib-1.1.0-1.el7ev.noarch ovirt-vmconsole-host-1.0.4-1.el7ev.noarch ovirt-imageio-daemon-1.0.0-0.el7ev.noarch ovirt-hosted-engine-ha-2.1.0.1-1.el7ev.noarch ovirt-hosted-engine-setup-2.1.0.1-1.el7ev.noarch ovirt-vmconsole-1.0.4-1.el7ev.noarch ovirt-host-deploy-1.6.0-1.el7ev.noarch [root@dell-r210ii-03 ~]# rpm -qa \*virtualization-host redhat-release-virtualization-host-4.1-0.6.el7.x86_64 and again /var/log/ovirt-imageio-daemon is the issue.
I would expect that this is because /var is a separate filesystem. We rsync the new FS over to the LV, then mount /var (which does not have /var/log/ovirt-imageio-daemon) on top of it. We probably need an additional hook inside imgbased's osupdater to copy paths on the new /var which do not exist on the LV.
Daniel, is this a dup of bug 1401901 ? shouldn't ovirt-imageio--1.0.0-0.el7ev.noarch have fixed this already?
(In reply to Dan Kenigsberg from comment #5) > Daniel, is this a dup of bug 1401901 ? > > shouldn't ovirt-imageio--1.0.0-0.el7ev.noarch have fixed this already? @Nir - what do you think? An issue with /var/log as suggested in https://bugzilla.redhat.com/show_bug.cgi?id=1425502#c4
(In reply to Daniel Erez from comment #6) > @Nir - what do you think? An issue with /var/log as suggested in > https://bugzilla.redhat.com/show_bug.cgi?id=1425502#c4 Yes, seems that comment 4 is correct.
Is this patch included in latest build for 4.1?
Should this be modified?
Test version: From: redhat-virtualization-host-3.6-20170404.0 To: redhat-virtualization-host-4.1-20170403.0 imgbased-0.9.20-0.1.el7ev.noarch Test steps: 1. Install redhat-virtualization-host-3.6-20170404.0 2. Add it to engine 3.6(3.6 cluster), add NFS storage domain to host in engine UI 3. Login rhvh-3.6, setup local repos, update it to rhvh-4.1 redhat-virtualization-host-4.1-20170403.0 # yum update 4. Reboot and login rhvh-4.1, check ovirt-imageio-daemon status, check rhvh-4.1 status in engine UI Test results: After step4, ovirt-imageio-daemon is active, rhvh-4.1 is up in engine UI. [root@dhcp-10-16 ~]# systemctl status ovirt-imageio-daemon ● ovirt-imageio-daemon.service - oVirt ImageIO Daemon Loaded: loaded (/usr/lib/systemd/system/ovirt-imageio-daemon.service; disabled; vendor preset: disabled) Active: active (running) since Thu 2017-04-06 01:45:13 EDT; 8min ago Main PID: 1118 (ovirt-imageio-d) CGroup: /system.slice/ovirt-imageio-daemon.service └─1118 /usr/bin/python /usr/bin/ovirt-imageio-daemon Apr 06 01:45:08 localhost.localdomain systemd[1]: Starting oVirt ImageIO Daemon... Apr 06 01:45:13 localhost.localdomain systemd[1]: Started oVirt ImageIO Daemon. So this bug is fixed in imgbased-0.9.20-0.1.el7ev.noarch, change the status to VERIFIED.