Bug 1373018

Summary: Hosted Engine fails to deploy with "Couldnt connect to VDSM within 240 seconds"
Product: Red Hat Enterprise Virtualization Manager Reporter: Roger Heslop <rheslop>
Component: ovirt-hosted-engine-setupAssignee: Sandro Bonazzola <sbonazzo>
Status: CLOSED DUPLICATE QA Contact: meital avital <mavital>
Severity: high Docs Contact:
Priority: unspecified    
Version: 4.0.0CC: fdeutsch, gklein, lsurette, rheslop, stirabos, ykaul
Target Milestone: ---   
Target Release: ---   
Hardware: x86_64   
OS: Linux   
Whiteboard: integration
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2016-09-08 09:44:27 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: Integration RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Attachments:
Description Flags
sosreport taken after failure seen above none

Description Roger Heslop 2016-09-04 19:49:41 UTC
Created attachment 1197698 [details]
sosreport taken after failure seen above

Description of problem:


Version-Release number of selected component (if applicable):


How reproducible:


Steps to Reproduce:
1. Install RHV-H 4.0 on KVM based VM using 'RHVH-4.0-20160822.8-RHVH-x86_64-dvd1.iso', ensuring that host-cpu option is enabled and that embedded virtualization is working.

2. Configure networking / subscription-management.  (Disabled IPv6 networking to avoid bugzilla 1372134, also ensured /var is > than 4 GB to avoid bugzilla 1338511 

3. Run 'hosted-engine --deploy'



Actual results:
 
[ INFO  ] Stage: Initializing
[ INFO  ] Generating a temporary VNC password.
[ INFO  ] Stage: Environment setup
          During customization use CTRL-D to abort.
          Continuing will configure this host for serving as hypervisor and create a VM where you have to install the engine afterwards.
          Are you sure you want to continue? (Yes, No)[Yes]: yes
          It has been detected that this program is executed through an SSH connection without using screen.
          Continuing with the installation may lead to broken installation if the network connection fails.
          It is highly recommended to abort the installation and run it inside a screen session using command "screen".
          Do you want to continue anyway? (Yes, No)[No]: yes
[ INFO  ] Hardware supports virtualization
          Configuration files: []
          Log file: /var/log/ovirt-hosted-engine-setup/ovirt-hosted-engine-setup-20160830153149-2llh9d.log
          Version: otopi-1.5.1 (otopi-1.5.1-3.el7ev)
[ INFO  ] Stage: Environment packages setup
[ INFO  ] Stage: Programs detection
[ INFO  ] Stage: Environment setup
[ INFO  ] Waiting for VDSM to reply
[ INFO  ] Waiting for VDSM to reply
[ INFO  ] Waiting for VDSM to reply
[ INFO  ] Waiting for VDSM to reply
[ INFO  ] Waiting for VDSM to reply
[ INFO  ] Waiting for VDSM to reply
[ INFO  ] Waiting for VDSM to reply
[ INFO  ] Waiting for VDSM to reply
[ INFO  ] Waiting for VDSM to reply
[ INFO  ] Waiting for VDSM to reply
[ ERROR ] Failed to execute stage 'Environment setup': Couldnt  connect to VDSM within 240 seconds
[ INFO  ] Stage: Clean up
[ INFO  ] Generating answer file '/var/lib/ovirt-hosted-engine-setup/answers/answers-20160830153652.conf'
[ INFO  ] Stage: Pre-termination
[ INFO  ] Stage: Termination
[ ERROR ] Hosted Engine deployment failed: this system is not reliable, please check the issue, fix and redeploy
          Log file is located at /var/log/ovirt-hosted-engine-setup/ovirt-hosted-engine-setup-20160830153149-2llh9d.log



Expected results:

Normal installation process after answering hosted-engine based questions

Additional info:

vdsmd is running ( via 'systemctl status vdsmd') however within 'Virtual Machines' section of cockpit, it reads:

Vdsm execution failed! Please check that:
- VDSM is set up properly (i.e. /etc/pki/vdsm/certs/cacert.pem is required)
- [path_to_cokcpit-ovirt-plugin]/vdsm/vdsm is executable,

VDSM path: /usr/share/cockpit/ovirt-dashboard/vdsm/vdsm/vdsm 


Ensured that /usr/share/cockpit/ovirt-dashboard/vdsm/vdsm/vdsm is executable and that /etc/pki/vdsm/certs/cacert.pem is present

Comment 1 Simone Tiraboschi 2016-09-08 09:44:27 UTC
The issue is here:

2016-09-03 14:09:56 DEBUG otopi.plugins.gr_he_setup.system.vdsmenv plugin.execute:926 execute-output: ('/bin/vdsm-tool', 'configure', '--force') stderr:
/usr/lib/python2.7/site-packages/vdsm/tool/dump_volume_chains.py:28: DeprecationWarning: vdscli uses xmlrpc. since ovirt 3.6 xmlrpc is deprecated, please use vdsm.jsonrpcvdscli
  from vdsm import vdscli
hostname: Name or service not known

Was the hostname of that host (rhev-0.vmnet.local) correctly resolvable on that host via DNS?

under /etc/nsswitch.conf you still have
 hosts:      files dns
without 'myhostname' (see rhbz#1329943) and there was no entry for that hostname under /etc/hosts so your only option was the DNS.

*** This bug has been marked as a duplicate of bug 1358530 ***