Bug 1154769

Summary: Host brown-vdsd.qa.lab.tlv.redhat.com installation failed. Network error during communication with the host.
Product: Red Hat Enterprise Virtualization Manager Reporter: Nikolai Sednev <nsednev>
Component: ovirt-engineAssignee: Nobody <nobody>
Status: CLOSED NOTABUG QA Contact:
Severity: urgent Docs Contact:
Priority: urgent    
Version: 3.5.0CC: bazulay, danken, ecohen, gklein, iheim, lpeer, lsurette, lvernia, nsednev, oourfali, rbalakri, Rhev-m-bugs, yeylon
Target Milestone: ---Keywords: Regression
Target Release: 3.5.0   
Hardware: x86_64   
OS: Linux   
Whiteboard: network
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2014-10-26 01:31:00 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: Network RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 1125909, 1142879, 1149470    
Attachments:
Description Flags
logs
none
deploylog
none
logs from engine and deployment of host none

Description Nikolai Sednev 2014-10-20 17:15:26 UTC
Created attachment 948639 [details]
logs

Description of problem:
Host brown-vdsd.qa.lab.tlv.redhat.com installation failed. Network error during communication with the host.

Version-Release number of selected component (if applicable):
rhevm-3.5.0-0.14.beta.el6ev.noarch
qemu-kvm-rhev-1.5.3-60.el7_0.10.x86_64
libvirt-1.1.1-29.el7_0.3.x86_64
vdsm-4.13.2-4.el7.x86_64
sanlock-3.1.0-2.el7.x86_64
Red Hat Enterprise Linux Server release 7.0 (Maipo)


How reproducible:
100%

Steps to Reproduce:
1.Add freshly installed RHEL7.0 host to RHEVM3.5 engine via WEBUI.

Actual results:
rhevm_bridge not created and host not added

Expected results:
Host should be added.

Additional info:

Comment 1 Oved Ourfali 2014-10-21 06:09:28 UTC
Can you provide the host deploy log?
See engine.log:

2014-10-20 19:49:51,536 INFO  [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeploy) Installation brown-vdsd.qa.lab.tlv.redhat.com: Retrieving installation logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20141020194951-brown-vdsd.qa.lab.tlv.redhat.com-6abc50fa.log'

Comment 3 Nikolai Sednev 2014-10-21 07:52:19 UTC
Created attachment 948826 [details]
deploylog

Comment 4 Dan Kenigsberg 2014-10-21 11:48:42 UTC
Nikolai, is NetworkManager running? It must be turned off on 3.5.0 beta.

Does your host have /etc/sysconfig/network-scripts/ifcfg-lo ?
What happens when you do `ifup lo` as root?

Comment 5 Nikolai Sednev 2014-10-22 14:07:32 UTC
NetworkManager was running, so I followed https://access.redhat.com/documentation/en-US/Red_Hat_Enterprise_Linux/6/html/Deployment_Guide/ch-NetworkManager.html and turned it off as you advised.

Host has /etc/sysconfig/network-scripts/ifcfg-lo and it's up by default.
[root@blue-vdsc ~]# ifconfig
enp4s0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet 10.35.103.12  netmask 255.255.255.0  broadcast 10.35.103.255
        inet6 fe80::21a:64ff:fe12:3499  prefixlen 64  scopeid 0x20<link>
        ether 00:1a:64:12:34:99  txqueuelen 1000  (Ethernet)
        RX packets 36919  bytes 49147258 (46.8 MiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 6010  bytes 777829 (759.5 KiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

lo: flags=73<UP,LOOPBACK,RUNNING>  mtu 65536
        inet 127.0.0.1  netmask 255.0.0.0
        inet6 ::1  prefixlen 128  scopeid 0x10<host>
        loop  txqueuelen 0  (Local Loopback)
        RX packets 4  bytes 420 (420.0 B)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 4  bytes 420 (420.0 B)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

I tried to reproduce the scenario again on latest repositories and host failed to be added with this exception "Host blue-vdsc.qa.lab.tlv.redhat.com installation failed. Command returned failure code 1 during SSH session 'root.lab.tlv.redhat.com'.".
I used engine: rhevm-3.5.0-0.15.beta.el6ev.noarch.
Please see logs attached.

Comment 6 Nikolai Sednev 2014-10-22 14:08:11 UTC
Created attachment 949405 [details]
logs from engine and deployment of host

Comment 7 Dan Kenigsberg 2014-10-26 01:31:00 UTC
Nikolai, vdsm-4.13.2-4.el7.x86_64 is too ancient to be interesting - it's from non-updated rhev-3.3. A great deal of work has taken place since then to support el7.

Sorry for noticing this only now.

Please reopen the bug if it reproduces with rhev-3.5's vdsm-4.16.z.