Description of problem: VDSM fail to set libvirt password and then fail to start VDSM service. Checking configuration status... Running configure... Reconfiguration of sanlock is done. Done configuring modules to VDSM. Traceback (most recent call last): File "/usr/bin/vdsm-tool", line 154, in main return tool_command[cmd]["command"](*args) File "/usr/lib64/python2.6/site-packages/vdsm/tool/passwd.py", line 50, in set_saslpasswd stderr=subprocess.PIPE, close_fds=True) File "/usr/lib64/python2.6/subprocess.py", line 642, in __init__ errread, errwrite) File "/usr/lib64/python2.6/subprocess.py", line 1234, in _execute_child raise child_exception OSError: [Errno 2] No such file or directory vdsm-tool configure --force is not solve this issue WA is to set libvirt passwork manually: saslpasswd2 -a libvirt vdsm@ovirt Version-Release number of selected component (if applicable): How reproducible: Steps to Reproduce: 1. Install VDSM 3.4 2. Upgrade to VDSM 3.5 Additional info: /etc/init.d/vdsmd start initctl: Job is already running: libvirtd vdsm: Running mkdirs vdsm: Running configure_coredump vdsm: Running configure_vdsm_logs vdsm: Running run_init_hooks vdsm: Running gencerts vdsm: Running check_is_configured libvirt is already configured for vdsm vdsm: Running validate_configuration SUCCESS: ssl configured to true. No conflicts vdsm: Running prepare_transient_repository vdsm: Running syslog_available vdsm: Running nwfilter libvir: XML-RPC error : authentication failed: authentication failed libvir: XML-RPC error : authentication failed: authentication failed libvir: XML-RPC error : authentication failed: authentication failed libvir: XML-RPC error : authentication failed: authentication failed libvir: XML-RPC error : authentication failed: authentication failed libvir: XML-RPC error : authentication failed: authentication failed libvir: XML-RPC error : authentication failed: authentication failed libvir: XML-RPC error : authentication failed: authentication failed libvir: XML-RPC error : authentication failed: authentication failed libvir: XML-RPC error : authentication failed: authentication failed libvir: XML-RPC error : authentication failed: authentication failed libvir: XML-RPC error : authentication failed: authentication failed libvir: XML-RPC error : authentication failed: authentication failed libvir: XML-RPC error : authentication failed: authentication failed libvir: XML-RPC error : authentication failed: authentication failed libvir: XML-RPC error : authentication failed: authentication failed libvir: XML-RPC error : authentication failed: authentication failed libvir: XML-RPC error : authentication failed: authentication failed libvir: XML-RPC error : authentication failed: authentication failed libvir: XML-RPC error : authentication failed: authentication failed libvir: XML-RPC error : authentication failed: authentication failed libvir: XML-RPC error : authentication failed: authentication failed libvir: XML-RPC error : authentication failed: authentication failed libvir: XML-RPC error : authentication failed: authentication failed libvir: XML-RPC error : authentication failed: authentication failed libvir: XML-RPC error : authentication failed: authentication failed libvir: XML-RPC error : authentication failed: authentication failed libvir: XML-RPC error : authentication failed: authentication failed libvir: XML-RPC error : authentication failed: authentication failed libvir: XML-RPC error : authentication failed: authentication failed libvir: XML-RPC error : authentication failed: authentication failed libvir: XML-RPC error : authentication failed: authentication failed libvir: XML-RPC error : authentication failed: authentication failed libvir: XML-RPC error : authentication failed: authentication failed libvir: XML-RPC error : authentication failed: authentication failed libvir: XML-RPC error : authentication failed: authentication failed libvir: XML-RPC error : authentication failed: authentication failed libvir: XML-RPC error : authentication failed: authentication failed libvir: XML-RPC error : authentication failed: authentication failed libvir: XML-RPC error : authentication failed: authentication failed libvir: XML-RPC error : authentication failed: authentication failed libvir: XML-RPC error : authentication failed: authentication failed libvir: XML-RPC error : authentication failed: authentication failed libvir: XML-RPC error : authentication failed: authentication failed libvir: XML-RPC error : authentication failed: authentication failed libvir: XML-RPC error : authentication failed: authentication failed libvir: XML-RPC error : authentication failed: authentication failed libvir: XML-RPC error : authentication failed: authentication failed libvir: XML-RPC error : authentication failed: authentication failed libvir: XML-RPC error : authentication failed: authentication failed Traceback (most recent call last): File "/usr/bin/vdsm-tool", line 154, in main return tool_command[cmd]["command"](*args) File "/usr/lib64/python2.6/site-packages/vdsm/tool/nwfilter.py", line 37, in main conn = libvirtconnection.get(None, False) File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 151, in get conn = _open_qemu_connection() File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 95, in _open_qemu_connection return utils.retry(libvirtOpen, timeout=10, sleep=0.2) File "/usr/lib64/python2.6/site-packages/vdsm/utils.py", line 1086, in retry return func() File "/usr/lib64/python2.6/site-packages/libvirt.py", line 102, in openAuth if ret is None:raise libvirtError('virConnectOpenAuth() failed') libvirtError: authentication failed: authentication failed vdsm: stopped during execute nwfilter task (task returned with error code 1). vdsm start [FAILED]
Meni - why opening on ovirt-node? Does it happen only on ovirt-node?
Meni, According to the bug description the vdsm upgrade is manual. How can this happen on ovirt-node ?
Yaniv, Please take a look it looks like NOTABUG ... as long as this is a manual upgrade than it could be simply rerun vdsm-tool ?
I'm not sure its not a bug . ""VDSM fail to set libvirt password and then fail to start VDSM service."" in that case means that /etc/pki/vdsm/keys/libvirt_password wasn't exist after the upgrade. is it reproducible ? can you describe the steps that lead to that? I upgraded many time 3.4 to 3.5 and never encounter such issue.
Hi Yaniv, Doesn't it duplicates BZ#1114993? At least the symptom/traceback/ovirt version seems the same.
Meni, to help to identify where the problem lies. Please state the exact steps you took (how you deployed the iso, how you ran the upgrade). And what - if - oVirt Node ISO you used.
Douglas, here you go, your first Node bug :)
Sorry it's was on VDSM. and I think it's duplicate of https://bugzilla.redhat.com/show_bug.cgi?id=1114993
Marking as duplicate, fell free to re-open anytime if the error persist. *** This bug has been marked as a duplicate of bug 1114993 ***