Bug 1116070 - failed to run vdsm when installing host to new engine
Summary: failed to run vdsm when installing host to new engine
Keywords:
Status: CLOSED DUPLICATE of bug 1121561
Alias: None
Product: oVirt
Classification: Retired
Component: vdsm
Version: 3.5
Hardware: Unspecified
OS: Unspecified
unspecified
unspecified
Target Milestone: ---
: 3.5.0
Assignee: Yaniv Bronhaim
QA Contact: Gil Klein
URL:
Whiteboard: infra
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2014-07-03 16:38 UTC by movciari
Modified: 2016-02-10 19:32 UTC (History)
12 users (show)

Fixed In Version:
Doc Type: Bug Fix
Doc Text:
Clone Of:
Environment:
Last Closed: 2014-07-23 08:01:00 UTC
oVirt Team: Infra
Embargoed:


Attachments (Terms of Use)
host-deploy log (336.14 KB, text/x-log)
2014-07-03 16:38 UTC, movciari
no flags Details
engine log (94.37 KB, text/x-log)
2014-07-03 16:39 UTC, movciari
no flags Details
libvirtd.conf (13.18 KB, text/plain)
2014-07-15 13:27 UTC, movciari
no flags Details

Description movciari 2014-07-03 16:38:43 UTC
Created attachment 914529 [details]
host-deploy log

Description of problem:
when installing host, i get error:
Failed to install Host jenkins. Failed to execute stage 'Closing up': Command '/sbin/service' failed to execute.


Version-Release number of selected component (if applicable):


How reproducible:
always on this host

Steps to Reproduce:
1. install host

Actual results:
install failed

Expected results:
host should be installed

Additional info:

Comment 1 movciari 2014-07-03 16:39:22 UTC
Created attachment 914530 [details]
engine log

Comment 2 Dan Kenigsberg 2014-07-03 17:59:07 UTC
For some reason, libvirtd failed to start. Does it run when started manually with

  /sbin/initctl start libvirtd

? Does `virsh -r` connect to it?

Could you attach /etc/libvirt/libvirtd.conf ?

Comment 3 movciari 2014-07-09 12:48:06 UTC
when i reproduced this bug first time, it was on in our automated tests on jenkins, probably right after new 3.5 host was added, and now they passed so maybe it works if host was manually configured before, i will try it on clean host, host upgraded from 3.4 and other scenarios and report back

Comment 4 Dan Kenigsberg 2014-07-09 18:50:28 UTC
Please reopen when you do!

Comment 5 movciari 2014-07-15 13:26:45 UTC
ok, reproduced today - both engine and host were clean, installed today, so it can probably be reproduced only on clean host and engine

libvirt seems to be already running but vdsmd fails to start
# initctl start libvirtd
initctl: Job is already running: libvirtd

# /etc/init.d/vdsmd restart
Shutting down vdsm daemon: 
vdsm watchdog stop                                         [  OK  ]
vdsm: not running                                          [FAILED]
vdsm: Running run_final_hooks
vdsm stop                                                  [  OK  ]
initctl: Job is already running: libvirtd
vdsm: Running mkdirs
vdsm: Running configure_coredump
vdsm: Running configure_vdsm_logs
vdsm: Running run_init_hooks
vdsm: Running gencerts
vdsm: Running check_is_configured
libvirt is already configured for vdsm
vdsm: Running validate_configuration
SUCCESS: ssl configured to true. No conflicts
vdsm: Running prepare_transient_repository
vdsm: Running syslog_available
vdsm: Running nwfilter
libvir: XML-RPC error : authentication failed: authentication failed
...
...
libvir: XML-RPC error : authentication failed: authentication failed
Traceback (most recent call last):
  File "/usr/bin/vdsm-tool", line 154, in main
    return tool_command[cmd]["command"](*args)
  File "/usr/lib64/python2.6/site-packages/vdsm/tool/nwfilter.py", line 37, in main
    conn = libvirtconnection.get(None, False)
  File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 151, in get
    conn = _open_qemu_connection()
  File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 95, in _open_qemu_connection
    return utils.retry(libvirtOpen, timeout=10, sleep=0.2)
  File "/usr/lib64/python2.6/site-packages/vdsm/utils.py", line 1086, in retry
    return func()
  File "/usr/lib64/python2.6/site-packages/libvirt.py", line 102, in openAuth
    if ret is None:raise libvirtError('virConnectOpenAuth() failed')
libvirtError: authentication failed: authentication failed
vdsm: stopped during execute nwfilter task (task returned with error code 1).
vdsm start                                                 [FAILED]


virsh -r connects

Comment 6 movciari 2014-07-15 13:27:13 UTC
Created attachment 918159 [details]
libvirtd.conf

Comment 7 Sven Kieske 2014-07-16 07:46:49 UTC
are you sure you are not running into the current python-pthreading bug?
https://bugzilla.redhat.com/show_bug.cgi?id=1117795 ?

Host installations currently fail if you have python-pthreading-0.1.3-2
installed.

this leads to your error (can't start vdsm, libvirtd already running)

try upgrading using yum as I just saw that python-pthreading-0.1.3-3 hit epel
production release.

HTH

PS: if it still reproduces, you really have hit another bug.

Comment 8 movciari 2014-07-16 08:23:36 UTC
i didn't see python-pthreading-0.1.3-3 when i tried to upgrade, so i downgraded to python-pthreading-0.1.2-1 as mentioned in python-pthreading bug

this didn't help and i'm still getting same error

if you need access to engine & host where i'm reproducing this, contact me on irc or email

Comment 9 Yaniv Bronhaim 2014-07-22 15:53:25 UTC
please check if this the same case as https://bugzilla.redhat.com/show_bug.cgi?id=1121561

if yes, close as duplicated.

Comment 10 movciari 2014-07-23 08:01:00 UTC

*** This bug has been marked as a duplicate of bug 1121561 ***


Note You need to log in before you can comment on or make changes to this bug.