Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 1077110

Summary: Host's Compatibility Version doesn't match the Cluster's Compatibility Version
Product: Red Hat Enterprise Virtualization Manager Reporter: Pavel Stehlik <pstehlik>
Component: ovirt-engineAssignee: Liran Zelkha <lzelkha>
Status: CLOSED CURRENTRELEASE QA Contact: Tareq Alayan <talayan>
Severity: high Docs Contact:
Priority: unspecified    
Version: 3.4.0CC: aberezin, acathrow, bazulay, danken, emesika, gklein, iheim, james.radtke, lpeer, mkalinin, oourfali, Rhev-m-bugs, ybronhei, yeylon
Target Milestone: ---Keywords: Triaged
Target Release: 3.5.0   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard: infra
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2014-04-30 07:38:06 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: Infra RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Pavel Stehlik 2014-03-17 09:26:37 UTC
Description of problem:
Adding host with vdsm-4.14.2-0.3.el6ev into RHEVM 3.3:

2014-03-17 09:03:45,588 INFO  [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand] (DefaultQuartzScheduler_Worker-68) [6e5bfc2d] FINISH, SetVdsStatusVDSCommand, log id: 15a1c4f8
2014-03-17 09:03:45,674 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-68) [6e5bfc2d] Correlation ID: 6e5bfc2d, Job ID: 74054dc8-1f87-4aa8-b4b6-4488663459cd, Call Stack: null, Custom Event ID: -1, Message: Host srh-209 is installed with VDSM version (4.14) and cannot join cluster Default which is compatible with VDSM versions [4.13, 4.9, 4.11, 4.12, 4.10].



Version-Release number of selected component (if applicable):
rhevm-3.3.0-0.45.el6ev.noarch
vdsm-4.14.2-0.3.el6ev.x86_64

How reproducible:


Steps to Reproduce:
1.
2.
3.

Actual results:


Expected results:
Newer vdsm supports also older RHEVM releases.

Additional info:

Nothing in the vdsm log - just caps:
Thread-66::DEBUG::2014-03-17 10:22:31,496::BindingXMLRPC::1069::vds::(wrapper) return getCapabilities with {'status': {'message': 'Done', 'code': 0}, 'info': {'HBAInventory': {'iSCSI': [{'InitiatorName': 'iqn.1994-05.com.redhat:ffc99f79f134'}], 'FC': []}, 'packages2': {'kernel': {'release': '430.el6.x86_64', 'buildtime': 1383660361.0, 'version': '2.6.32'}, 'spice-server': {'release': '6.el6_5.1', 'buildtime': 1385990636L, 'version': '0.12.4'}, 'vdsm': {'release': '0.3.el6ev', 'buildtime': 1393947299L, 'version': '4.14.2'}, 'qemu-kvm': {'release': '2.415.el6_5.4', 'buildtime': 1392114915L, 'version': '0.12.1.2'}, 'libvirt': {'release': '29.el6_5.4', 'buildtime': 1392204040L, 'version': '0.10.2'}, 'qemu-img': {'release': '2.415.el6_5.4', 'buildtime': 1392114915L, 'version': '0.12.1.2'}, 'mom': {'release': '8.el6ev', 'buildtime': 1385547925L, 'version': '0.3.2'}}, 'cpuModel': 'Intel(R) Xeon(R) CPU           X5650  @ 2.67GHz', 'hooks': {}, 'cpuSockets': '1', 'vmTypes': ['kvm'], 'supportedProtocols': ['2.2', '2.3'], 'networks': {'rhevm': {'iface': 'rhevm', 'addr': '10.34.63.209', 'cfg': {'IPV6INIT': 'yes', 'MTU': '1500', 'DELAY': '30', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': 'befae6c5-2b2c-4aa2-816c-3646760638a8'}, 'ipv6addrs': ['fe80::e61f:13ff:fe69:cc20/64', '2620:52:0:223c:e61f:13ff:fe69:cc20/64'], 'gateway': '10.34.63.254', 'netmask': '255.255.252.0', 'stp': 'off', 'bridged': True, 'mtu': '1500', 'ipv6gateway': 'fe80:52:0:223c::3fe', 'ports': ['eth0']}}, 'bridges': {'rhevm': {'addr': '10.34.63.209', 'cfg': {'IPV6INIT': 'yes', 'MTU': '1500', 'DELAY': '30', 'NM_CONTROLLED': 'no', 'BOOTPROTO': 'dhcp', 'DEVICE': 'rhevm', 'TYPE': 'Bridge', 'ONBOOT': 'yes', 'UUID': 'befae6c5-2b2c-4aa2-816c-3646760638a8'}, 'ipv6addrs': ['fe80::e61f:13ff:fe69:cc20/64', '2620:52:0:223c:e61f:13ff:fe69:cc20/64'], 'mtu': '1500', 'netmask': '255.255.252.0', 'stp': 'off', 'ipv6gateway': 'fe80:52:0:223c::3fe', 'gateway': '10.34.63.254', 'ports': ['eth0']}, ';vdsmdummy;': {'addr': '', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500', 'netmask': '', 'stp': 'off', 'ipv6gateway': '::', 'gateway': '', 'ports': []}}, 'uuid': '4D11F658-9FA4-3E12-B9BE-A7C05C980738', 'lastClientIface': 'rhevm', 'nics': {'eth1': {'netmask': '', 'addr': '', 'hwaddr': 'e4:1f:13:69:cc:22', 'cfg': {'DEVICE': 'eth1', 'HWADDR': 'e4:1f:13:69:cc:22', 'ONBOOT': 'no', 'MTU': '1500'}, 'ipv6addrs': ['fe80::e61f:13ff:fe69:cc22/64', '2620:52:0:223c:e61f:13ff:fe69:cc22/64'], 'speed': 1000, 'mtu': '1500'}, 'eth0': {'netmask': '', 'addr': '', 'hwaddr': 'e4:1f:13:69:cc:20', 'cfg': {'BRIDGE': 'rhevm', 'UUID': 'befae6c5-2b2c-4aa2-816c-3646760638a8', 'NM_CONTROLLED': 'no', 'MTU': '1500', 'HWADDR': 'e4:1f:13:69:cc:20', 'DEVICE': 'eth0', 'ONBOOT': 'yes', 'IPV6INIT': 'yes'}, 'ipv6addrs': [], 'speed': 1000, 'mtu': '1500'}}, 'software_revision': '0.3', 'management_ip': '0.0.0.0', 'clusterLevels': ['3.0', '3.1', '3.2', '3.3', '3.4'], 'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,arch_perfmon,pebs,bts,rep_good,xtopology,nonstop_tsc,aperfmperf,pni,dtes64,monitor,ds_cpl,vmx,smx,est,tm2,ssse3,cx16,xtpr,pdcm,pcid,dca,sse4_1,sse4_2,popcnt,lahf_lm,arat,epb,dts,tpr_shadow,vnmi,flexpriority,ept,vpid,model_Nehalem,model_Conroe,model_coreduo,model_core2duo,model_Penryn,model_n270', 'ISCSIInitiatorName': 'iqn.1994-05.com.redhat:ffc99f79f134', 'netConfigDirty': 'False', 'supportedENGINEs': ['3.0', '3.1', '3.2', '3.3', '3.4'], 'reservedMem': '321', 'bondings': {'bond4': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond0': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond1': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond2': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}, 'bond3': {'netmask': '', 'addr': '', 'slaves': [], 'hwaddr': '00:00:00:00:00:00', 'cfg': {}, 'ipv6addrs': [], 'mtu': '1500'}}, 'software_version': '4.14', 'memSize': '19978', 'cpuSpeed': '2660.000', 'version_name': 'Snow Man', 'vlans': {}, 'cpuCores': '6', 'kvmEnabled': 'true', 'guestOverhead': '65', 'supportedRHEVMs': ['3.0'], 'cpuThreads': '12', 'emulatedMachines': [u'rhel6.5.0', u'pc', u'rhel6.4.0', u'rhel6.3.0', u'rhel6.2.0', u'rhel6.1.0', u'rhel6.0.0', u'rhel5.5.0', u'rhel5.4.4', u'rhel5.4.0'], 'rngSources': ['random'], 'operatingSystem': {'release': '6.5.0.1.el6', 'version': '6Server', 'name': 'RHEL'}, 'lastClient': '10.34.63.19'}}
Thread-67::DEBUG::2014-03-17 10:22:31,544::BindingXMLRPC::1062::vds::(wrapper) client [10.34.63.19]::call getHardwareInfo with () {} flowID [77aaf45c]
Thread-67::DEBUG::2014-03-17 10:22:31,563::BindingXMLRPC::1069::vds::(wrapper) return getHardwareInfo with {'status': {'message': 'Done', 'code': 0}, 'info': {'systemProductName': 'System x3550 M3 -[7944J2G]-', 'systemSerialNumber': 'KD95K79', 'systemFamily': 'System x', 'systemVersion': '00', 'systemUUID': '4d11f658-9fa4-3e12-b9be-a7c05c980738', 'systemManufacturer': 'IBM'}}

Comment 4 Dan Kenigsberg 2014-03-24 10:32:43 UTC
If Engine sees itself in the supportedENGINES of a Vdsm of an unknown version, and that Vdsm has the relevant clusterLevel, Engine should believe it and take it into the cluster.

Please add an Engine-side unit test for this case, as it is not the first time we need this bug.

Comment 5 James Radtke 2014-04-22 19:37:37 UTC
I have experienced the same error
"Host's Compatibility Version doesn't match the Cluster's Compatibility Version"

Which I have appeared to have resolved by replacing our /etc/sudoers file with one customized for RHEL Hypervisors for RHEV.  

Specifically adding:
vdsm    ALL=(ALL)       NOPASSWD: ALL

I have ran in to numerous issues due to using a Centralized LDAP and configuration management.

Comment 6 Liran Zelkha 2014-04-23 16:42:26 UTC
Hi James,

Are you sure this is the issue you run into? Shouldn't be relevant to the sudoers file or to the Centralized LDAP. 
In any case, the fix is currently merged in master.

Comment 7 Eli Mesika 2014-04-28 08:16:37 UTC
Reopening the BZ since fix caused a regression.
Fixing patch was reverted

Comment 8 Pavel Stehlik 2014-08-14 09:35:25 UTC
Unacceptable to closing as WORKSFORME as this is BUG which was solved in rhevm-3.3.0-0.46.el6ev, which is 3.3.0.1

Comment 9 Oved Ourfali 2014-08-14 13:00:50 UTC
(In reply to Pavel Stehlik from comment #8)
> Unacceptable to closing as WORKSFORME as this is BUG which was solved in
> rhevm-3.3.0-0.46.el6ev, which is 3.3.0.1

are you sure?
We had a fix, but reverted it, and saw that it doesn't reproduce.
If it true, however, then you're right, and it should have been closed currentrelease.