Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 1151987

Summary: [RHEL 7] Add 3.4 RHEL 7 host to rhev 3.5 fails - vdsm cannot be started
Product: Red Hat Enterprise Virtualization Manager Reporter: Ori Gofen <ogofen>
Component: vdsmAssignee: Yaniv Bronhaim <ybronhei>
Status: CLOSED NOTABUG QA Contact: Pavel Stehlik <pstehlik>
Severity: high Docs Contact:
Priority: unspecified    
Version: 3.5.0CC: acanan, alonbl, bazulay, ecohen, gklein, iheim, lpeer, lsurette, ogofen, oourfali, rbalakri, Rhev-m-bugs, yeylon
Target Milestone: ---   
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard: infra
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2014-10-23 10:10:18 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: Infra RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Attachments:
Description Flags
vdsm+engine+host-deploy logs
none
logs none

Description Ori Gofen 2014-10-13 09:19:13 UTC
Created attachment 946287 [details]
vdsm+engine+host-deploy logs

Description of problem:
couldn't add a "3.4 host" on a "3.5 rhevm",the datacenter compatibility version was set to 3.4,and so the cluster.

message on ui:"Host camel installation failed. Command returned failure code 1 during SSH session 'root.11X.X'." 

ava.io.IOException: Command returned failure code 1 during SSH session 'root.11X.X'
	at org.ovirt.engine.core.uutils.ssh.SSHClient.executeCommand(SSHClient.java:527) [uutils.jar:]
	at org.ovirt.engine.core.uutils.ssh.SSHDialog.executeCommand(SSHDialog.java:318) [uutils.jar:]
	at org.ovirt.engine.core.bll.VdsDeploy.execute(VdsDeploy.java:1118) [bll.jar:]
	at org.ovirt.engine.core.bll.InstallVdsInternalCommand.installHost(InstallVdsInternalCommand.java:151) [bll.jar:]
	at org.ovirt.engine.core.bll.InstallVdsInternalCommand.executeCommand(InstallVdsInternalCommand.java:78) [bll.jar:]
	at org.ovirt.engine.core.bll.CommandBase.executeWithoutTransaction(CommandBase.java:1168) [bll.jar:]
	at org.ovirt.engine.core.bll.CommandBase.executeActionInTransactionScope(CommandBase.java:1307) [bll.jar:]
	at org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1932) [bll.jar:]
	at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:174) [utils.jar:]
	at org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:116) [utils.jar:]
	at org.ovirt.engine.core.bll.CommandBase.execute(CommandBase.java:1331) [bll.jar:]
	at org.ovirt.engine.core.bll.CommandBase.executeAction(CommandBase.java:344) [bll.jar:]
	at org.ovirt.engine.core.bll.MultipleActionsRunner.executeValidatedCommand(MultipleActionsRunner.java:191) [bll.jar:]
	at org.ovirt.engine.core.bll.MultipleActionsRunner.runCommands(MultipleActionsRunner.java:158) [bll.jar:]
	at org.ovirt.engine.core.bll.MultipleActionsRunner$2.run(MultipleActionsRunner.java:167) [bll.jar:]
	at org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:90) [utils.jar:]
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [rt.jar:1.7.0_65]
	at java.util.concurrent.FutureTask.run(FutureTask.java:262) [rt.jar:1.7.0_65]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [rt.jar:1.7.0_65]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [rt.jar:1.7.0_65]
	at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_65]

Version-Release number of selected component (if applicable):
vdsm-xmlrpc-4.14.13-2.el7ev.noarch
vdsm-python-zombiereaper-4.14.13-2.el7ev.noarch
vdsm-4.14.13-2.el7ev.x86_64
vdsm-python-4.14.13-2.el7ev.x86_64
vdsm-cli-4.14.13-2.el7ev.noarch

rhevm-3.5.0-0.14.beta.el6ev.noarch
rhevm-setup-plugins-3.5.0-0.3.master.el6_5.noarch
rhevm-dependencies-3.5.0-0.1.master.el6_5.noarch
rhevm-spice-client-x64-msi-3.5-2.el6.noarch
rhevm-spice-client-x86-cab-3.5-2.el6.noarch
rhevm-doc-3.5.0-1.el6eng.noarch
rhevm-lib-3.5.0-0.14.beta.el6ev.noarch
rhevm-setup-plugin-ovirt-engine-common-3.5.0-0.14.beta.el6ev.noarch
rhevm-setup-3.5.0-0.14.beta.el6ev.noarch


How reproducible:
100%

Steps to Reproduce:
-Have a host with RHEL 7 os installed
1.install vdsm
2.add host to 3.5 rhevm setup ( please set dc's and cluster's compatibility version to >3.5)

Actual results:
operation fails

Expected results:
operation should succeed

Additional info:

Comment 1 Alon Bar-Lev 2014-10-14 13:27:15 UTC
2014-10-13 11:56:05 DEBUG otopi.plugins.otopi.services.systemd plugin.executeRaw:785 execute: ('/bin/systemctl', 'start', 'vdsmd.service'), executable='None', cwd='None', env=None
2014-10-13 11:56:24 DEBUG otopi.plugins.otopi.services.systemd plugin.executeRaw:803 execute-result: ('/bin/systemctl', 'start', 'vdsmd.service'), rc=1
2014-10-13 11:56:24 DEBUG otopi.plugins.otopi.services.systemd plugin.execute:861 execute-output: ('/bin/systemctl', 'start', 'vdsmd.service') stdout:


2014-10-13 11:56:24 DEBUG otopi.plugins.otopi.services.systemd plugin.execute:866 execute-output: ('/bin/systemctl', 'start', 'vdsmd.service') stderr:
Job for vdsmd.service failed. See 'systemctl status vdsmd.service' and 'journalctl -xn' for details.

Comment 2 Yaniv Bronhaim 2014-10-22 08:55:00 UTC
is it reproducible ? can you add the output of "journalctl | grep vdsm" to see what fails?

Comment 3 Yaniv Bronhaim 2014-10-22 09:16:22 UTC
I noticed when I installed vdsm at first: 
Oct 22 12:07:19 dhcp-0-134.tlv.redhat.com vdsm[23774]: vdsm vds WARNING Unable to load the json rpc server module. Please make sure it is installed.
Oct 22 12:07:40 dhcp-0-134.tlv.redhat.com vdsm[23774]: vdsm BindingXMLRPC.RequestHandler ERROR Bad request syntax ('CONNECT')
Oct 22 12:07:40 dhcp-0-134.tlv.redhat.com vdsm[23774]: vdsm root ERROR client ('10.35.1.85', 43280)
                                                         File "/usr/share/vdsm/BindingXMLRPC.py", line 211, in parse_request

I added "yum install vdsm-yajsonrpc.noarch vdsm-jsonrpc.noarch" and it works

can be the same case in your environment ?

Comment 4 Ori Gofen 2014-10-22 13:50:58 UTC
Created attachment 949401 [details]
logs

Yaniv, I believe you right,
I have just installed av12.3 on top of RHEL7, the operation was successful

[root@RHEL7Server ~]# rpm -qa | grep jsonrpc
vdsm-jsonrpc-4.14.17-1.el7.noarch
vdsm-yajsonrpc-4.14.17-1.el7.noarch

The packages are installed.

btw the operation seem to be failing on logs though:

2014-10-21 17:31:18,098 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-7-thread-25) [44f9fbb] java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException
2014-10-21 17:31:18,101 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-7-thread-25) [44f9fbb] Command PollVDSCommand(HostName = ogofen-vdsa, HostId = d1a12f5f-9e04-4f59-b59b-0e05bb5d2fdd) execution failed. Exception: RuntimeException: java.util.concurrent.ExecutionException: java.lang.reflect.InvocationTargetException

This bug can be closed as CURR or be verified