Created attachment 1226198 [details] logs Description of problem: imageio fails during system startup How reproducible: ? Steps to Reproduce: ? Actual results: on rhel 7.3 on system startup imageio complaints that it cannot be started. Expected results: no errors on startup. Additional info: excerpt from log: Nov 29 16:30:43 struska1 abrt-server: Not saving repeating crash in '/usr/bin/ovirt-imageio-daemon' Nov 29 16:30:43 struska1 ovirt-imageio-daemon: Traceback (most recent call last): Nov 29 16:30:43 struska1 ovirt-imageio-daemon: File "/usr/bin/ovirt-imageio-daemon", line 14, in <module> Nov 29 16:30:43 struska1 ovirt-imageio-daemon: server.main(sys.argv) Nov 29 16:30:43 struska1 ovirt-imageio-daemon: File "/usr/lib/python2.7/site-packages/ovirt_imageio_daemon/server.py", line 50, in main Nov 29 16:30:43 struska1 ovirt-imageio-daemon: configure_logger() Nov 29 16:30:43 struska1 ovirt-imageio-daemon: File "/usr/lib/python2.7/site-packages/ovirt_imageio_daemon/server.py", line 68, in configure_logger Nov 29 16:30:43 struska1 ovirt-imageio-daemon: logging.config.fileConfig(conf, disable_existing_loggers=False) Nov 29 16:30:43 struska1 ovirt-imageio-daemon: File "/usr/lib64/python2.7/logging/config.py", line 78, in fileConfig Nov 29 16:30:43 struska1 ovirt-imageio-daemon: handlers = _install_handlers(cp, formatters) Nov 29 16:30:43 struska1 ovirt-imageio-daemon: File "/usr/lib64/python2.7/logging/config.py", line 156, in _install_handlers Nov 29 16:30:43 struska1 ovirt-imageio-daemon: h = klass(*args) Nov 29 16:30:43 struska1 ovirt-imageio-daemon: File "/usr/lib64/python2.7/logging/handlers.py", line 117, in __init__ Nov 29 16:30:43 struska1 ovirt-imageio-daemon: BaseRotatingHandler.__init__(self, filename, mode, encoding, delay) Nov 29 16:30:43 struska1 ovirt-imageio-daemon: File "/usr/lib64/python2.7/logging/handlers.py", line 64, in __init__ Nov 29 16:30:43 struska1 ovirt-imageio-daemon: logging.FileHandler.__init__(self, filename, mode, encoding, delay) Nov 29 16:30:43 struska1 ovirt-imageio-daemon: File "/usr/lib64/python2.7/logging/__init__.py", line 902, in __init__ Nov 29 16:30:43 struska1 ovirt-imageio-daemon: StreamHandler.__init__(self, self._open()) Nov 29 16:30:43 struska1 ovirt-imageio-daemon: File "/usr/lib64/python2.7/logging/__init__.py", line 925, in _open Nov 29 16:30:43 struska1 ovirt-imageio-daemon: stream = open(self.baseFilename, self.mode) Nov 29 16:30:43 struska1 ovirt-imageio-daemon: IOError: [Errno 13] Permission denied: '/var/log/ovirt-imageio-daemon/daemon.log' Nov 29 16:30:43 struska1 systemd: ovirt-imageio-daemon.service: main process exited, code=exited, status=1/FAILURE Nov 29 16:30:43 struska1 systemd: Failed to start oVirt ImageIO Daemon.
Raz, have we ever seen this in the QE envs?
Allon, After few days, I didn't get respond from any QE team about this, so (In reply to Allon Mureinik from comment #1) > Raz, have we ever seen this in the QE envs? Allon, After few days, I didn't get respond from any QE team about this, so no, we never saw this
I saw this twice when was trying to add host to rhv-m. This is a bug for sure and it affects vdsm directly, cause it can't be started. It's seems to be a race between what installed first.. -- Unit ovirt-imageio-daemon.service has begun starting up. Dec 18 11:49:43 compute-0.localdomain ovirt-imageio-daemon[23023]: Traceback (most recent call last): Dec 18 11:49:43 compute-0.localdomain ovirt-imageio-daemon[23023]: File "/usr/bin/ovirt-imageio-daemon", line 14, in <module> Dec 18 11:49:43 compute-0.localdomain ovirt-imageio-daemon[23023]: server.main(sys.argv) Dec 18 11:49:43 compute-0.localdomain ovirt-imageio-daemon[23023]: File "/usr/lib/python2.7/site-packages/ovirt_imageio_daemon/server.py", line 51, in main Dec 18 11:49:43 compute-0.localdomain ovirt-imageio-daemon[23023]: configure_logger() Dec 18 11:49:43 compute-0.localdomain ovirt-imageio-daemon[23023]: File "/usr/lib/python2.7/site-packages/ovirt_imageio_daemon/server.py", line 69, in configure_logger Dec 18 11:49:43 compute-0.localdomain ovirt-imageio-daemon[23023]: logging.config.fileConfig(conf, disable_existing_loggers=False) Dec 18 11:49:43 compute-0.localdomain ovirt-imageio-daemon[23023]: File "/usr/lib64/python2.7/logging/config.py", line 78, in fileConfig Dec 18 11:49:43 compute-0.localdomain ovirt-imageio-daemon[23023]: handlers = _install_handlers(cp, formatters) Dec 18 11:49:43 compute-0.localdomain ovirt-imageio-daemon[23023]: File "/usr/lib64/python2.7/logging/config.py", line 156, in _install_handlers Dec 18 11:49:43 compute-0.localdomain ovirt-imageio-daemon[23023]: h = klass(*args) Dec 18 11:49:43 compute-0.localdomain ovirt-imageio-daemon[23023]: File "/usr/lib64/python2.7/logging/handlers.py", line 117, in __init__ Dec 18 11:49:43 compute-0.localdomain ovirt-imageio-daemon[23023]: BaseRotatingHandler.__init__(self, filename, mode, encoding, delay) Dec 18 11:49:43 compute-0.localdomain ovirt-imageio-daemon[23023]: File "/usr/lib64/python2.7/logging/handlers.py", line 64, in __init__ Dec 18 11:49:43 compute-0.localdomain ovirt-imageio-daemon[23023]: logging.FileHandler.__init__(self, filename, mode, encoding, delay) Dec 18 11:49:43 compute-0.localdomain ovirt-imageio-daemon[23023]: File "/usr/lib64/python2.7/logging/__init__.py", line 902, in __init__ Dec 18 11:49:43 compute-0.localdomain ovirt-imageio-daemon[23023]: StreamHandler.__init__(self, self._open()) Dec 18 11:49:43 compute-0.localdomain ovirt-imageio-daemon[23023]: File "/usr/lib64/python2.7/logging/__init__.py", line 925, in _open Dec 18 11:49:43 compute-0.localdomain ovirt-imageio-daemon[23023]: stream = open(self.baseFilename, self.mode) Dec 18 11:49:43 compute-0.localdomain ovirt-imageio-daemon[23023]: IOError: [Errno 13] Permission denied: '/var/log/ovirt-imageio-daemon/daemon.log' Dec 18 11:49:43 compute-0.localdomain systemd[1]: ovirt-imageio-daemon.service: main process exited, code=exited, status=1/FAILURE Dec 18 11:49:43 compute-0.localdomain systemd[1]: Failed to start oVirt ImageIO Daemon. -- Subject: Unit ovirt-imageio-daemon.service has failed -- Defined-By: systemd -- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel -- -- Unit ovirt-imageio-daemon.service has failed.
If I am not mistaken, this is due to a race between ovirt-imageio and vdsm's %post install scripts. If ovirt-imageio is first to run, the script fails, and vdsm would not start up.
I think this is a duplicate of bug 1401901.
*** This bug has been marked as a duplicate of bug 1401901 ***