Bug 1116070

Created attachment 914530 [details]
engine log

For some reason, libvirtd failed to start. Does it run when started manually with

  /sbin/initctl start libvirtd

? Does `virsh -r` connect to it?

Could you attach /etc/libvirt/libvirtd.conf ?

when i reproduced this bug first time, it was on in our automated tests on jenkins, probably right after new 3.5 host was added, and now they passed so maybe it works if host was manually configured before, i will try it on clean host, host upgraded from 3.4 and other scenarios and report back

Please reopen when you do!

ok, reproduced today - both engine and host were clean, installed today, so it can probably be reproduced only on clean host and engine

libvirt seems to be already running but vdsmd fails to start
# initctl start libvirtd
initctl: Job is already running: libvirtd

# /etc/init.d/vdsmd restart
Shutting down vdsm daemon: 
vdsm watchdog stop                                         [  OK  ]
vdsm: not running                                          [FAILED]
vdsm: Running run_final_hooks
vdsm stop                                                  [  OK  ]
initctl: Job is already running: libvirtd
vdsm: Running mkdirs
vdsm: Running configure_coredump
vdsm: Running configure_vdsm_logs
vdsm: Running run_init_hooks
vdsm: Running gencerts
vdsm: Running check_is_configured
libvirt is already configured for vdsm
vdsm: Running validate_configuration
SUCCESS: ssl configured to true. No conflicts
vdsm: Running prepare_transient_repository
vdsm: Running syslog_available
vdsm: Running nwfilter
libvir: XML-RPC error : authentication failed: authentication failed
...
...
libvir: XML-RPC error : authentication failed: authentication failed
Traceback (most recent call last):
  File "/usr/bin/vdsm-tool", line 154, in main
    return tool_command[cmd]["command"](*args)
  File "/usr/lib64/python2.6/site-packages/vdsm/tool/nwfilter.py", line 37, in main
    conn = libvirtconnection.get(None, False)
  File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 151, in get
    conn = _open_qemu_connection()
  File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 95, in _open_qemu_connection
    return utils.retry(libvirtOpen, timeout=10, sleep=0.2)
  File "/usr/lib64/python2.6/site-packages/vdsm/utils.py", line 1086, in retry
    return func()
  File "/usr/lib64/python2.6/site-packages/libvirt.py", line 102, in openAuth
    if ret is None:raise libvirtError('virConnectOpenAuth() failed')
libvirtError: authentication failed: authentication failed
vdsm: stopped during execute nwfilter task (task returned with error code 1).
vdsm start                                                 [FAILED]


virsh -r connects

Created attachment 918159 [details]
libvirtd.conf

are you sure you are not running into the current python-pthreading bug?
https://bugzilla.redhat.com/show_bug.cgi?id=1117795 ?

Host installations currently fail if you have python-pthreading-0.1.3-2
installed.

this leads to your error (can't start vdsm, libvirtd already running)

try upgrading using yum as I just saw that python-pthreading-0.1.3-3 hit epel
production release.

HTH

PS: if it still reproduces, you really have hit another bug.

i didn't see python-pthreading-0.1.3-3 when i tried to upgrade, so i downgraded to python-pthreading-0.1.2-1 as mentioned in python-pthreading bug

this didn't help and i'm still getting same error

if you need access to engine & host where i'm reproducing this, contact me on irc or email

please check if this the same case as https://bugzilla.redhat.com/show_bug.cgi?id=1121561

if yes, close as duplicated.

*** This bug has been marked as a duplicate of bug 1121561 ***