Bug 1241470

Summary: [RHEV-H] Failed to setup networks during deploy Hosted Engine via soft iscsi storage
Product: Red Hat Enterprise Virtualization Manager Reporter: cshao <cshao>
Component: vdsmAssignee: Nobody <nobody>
Status: CLOSED DUPLICATE QA Contact: Aharon Canan <acanan>
Severity: urgent Docs Contact:
Priority: urgent    
Version: 3.5.4CC: bazulay, cshao, ecohen, fdeutsch, gklein, hadong, huiwa, leiwang, lpeer, lsurette, mgoldboi, sbonazzo, yaniwang, ycui, yeylon, ylavi
Target Milestone: ---Keywords: Regression, TestBlocker
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard: node
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2015-07-09 11:11:00 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: Node RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 1059435, 1250199    
Attachments:
Description Flags
ovirt-hosted-engine-setup-20150709090616-sp2x3e.log
none
HE.tar.gz
none
sosreport.tar.gz none

Description cshao 2015-07-09 09:53:49 UTC
Created attachment 1050205 [details]
ovirt-hosted-engine-setup-20150709090616-sp2x3e.log

Description of problem:
Failed to setup networks during deploy Hosted Engine.

RuntimeError: Failed to setup networks {'rhevm': {'nic': 'eth0', 'bootproto': 'dhcp', 'blockingdhcp': True}}. Error code: "16" message: "Unexpected exception"

Version-Release number of selected component (if applicable):
ovirt-node-3.2.3-11.el6.noarch
ovirt-node-plugin-hosted-engine-0.2.0-16.0.el6ev.noarch
ovirt-hosted-engine-setup-1.2.5.1-1.el6ev.noarch
ovirt-hosted-engine-ha-1.2.6-2.el6ev.noarch
rhev-hypervisor6-6.7-20150707.0.el6ev

How reproducible:
100%

Steps to Reproduce:
1. Install RHEV-H and enabled Network.
2. File the ISO/OVA URL with correct path
3. Click <Setup Hosted Engine>
4. Finish the configuration in console.

Actual results:
Failed to deploy HE, it will auto jump to TUI from console.
Check log file, an error occurs during setup Hosted Engine.

Expected results:
Deploy HE can succeed without error.

Additional info:

Comment 1 cshao 2015-07-09 09:56:39 UTC
Add keyword "regression"; "Testblocker" due to no such issue on rhev-hypervisor6-6.7-20150609.0, and this bug blocker our all HE testing.

Comment 2 Ying Cui 2015-07-09 10:19:59 UTC
(In reply to shaochen from comment #1)
> Add keyword "regression"; "Testblocker" due to no such issue on
> rhev-hypervisor6-6.7-20150609.0, and this bug blocker our all HE testing.

version info on rhev-hypervisor6-6.7-20150609.0
ovirt-node-3.2.3-3.el6.noarch
ovirt-hosted-engine-ha-1.2.6-2.el6ev.noarch
ovirt-node-plugin-hosted-engine-0.2.0-15.0.el6ev.noarch
ovirt-hosted-engine-setup-1.2.2-3.el6ev.noarch
ovirt-host-deploy-1.3.0-2.el6ev.noarch

Comment 4 Sandro Bonazzola 2015-07-09 11:11:00 UTC
Moving to vdsm, looks like a duplicate of bug #1235591.

*** This bug has been marked as a duplicate of bug 1235591 ***

Comment 6 cshao 2015-07-09 11:30:10 UTC
Created attachment 1050233 [details]
HE.tar.gz

Upload /var/log/*.*

Comment 7 Fabian Deutsch 2015-07-09 11:35:22 UTC
Ying, does this bug go away when you start he-setup again?

Comment 8 cshao 2015-07-09 11:35:42 UTC
Created attachment 1050234 [details]
sosreport.tar.gz

Upload sosreport

Comment 9 Sandro Bonazzola 2015-07-09 11:36:53 UTC
As far as I can tell this can't be even reproduced with some reliability.
vdsm infra team tried to investigate on that and couldn't find the issue.
On hosted engine side, the tool just receive underlying errors from vdsm.
If you manage to reproduce the issue in a reliable way we can try to get rid of it.

BTW since it was verified as a known issue and not as a resolved issue I don't see this as a regression.

Comment 10 Ying Cui 2015-07-09 11:39:33 UTC
(In reply to Fabian Deutsch from comment #7)
> Ying, does this bug go away when you start he-setup again?

Fabian, Yes, test he-setup again, still this issue.

Comment 11 cshao 2015-07-09 11:39:53 UTC
(In reply to Fabian Deutsch from comment #7)
> Ying, does this bug go away when you start he-setup again?

No, still existing.

NOTE:
I run hosted-engine --deploy on console still got failed.

Comment 12 Sandro Bonazzola 2015-07-09 12:05:45 UTC
Comment on attachment 1050234 [details]
sosreport.tar.gz

This log is unrelated to the issue reported:

Traceback (most recent call last):
  File "/usr/lib/python2.6/site-packages/otopi/context.py", line 142, in _executeMethod
  File "/usr/share/ovirt-hosted-engine-setup/plugins/ovirt-hosted-engine-setup/storage/storage.py", line 937, in _late_customization
  File "/usr/share/ovirt-hosted-engine-setup/plugins/ovirt-hosted-engine-setup/storage/storage.py", line 330, in _getExistingDomain
  File "/usr/share/ovirt-hosted-engine-setup/plugins/ovirt-hosted-engine-setup/storage/storage.py", line 502, in _storageServerConnection
RuntimeError: Connection to storage server failed



Here there's a connection error to the storage.

Comment 13 Fabian Deutsch 2015-07-09 12:51:26 UTC
Ying, according to comment 12 this can be an issue with the used storage. What kind of storage are you using and could there be networking problems?

Comment 14 cshao 2015-07-10 01:11:29 UTC
(In reply to Fabian Deutsch from comment #13)
> Ying, according to comment 12 this can be an issue with the used storage.
> What kind of storage are you using and could there be networking problems?

The first time, I used iscsi storage through ISO.
The second time, I used nfs storage through ISO.

Today I will have a try through OVA and update result in here.

Thanks!

Comment 15 cshao 2015-07-10 03:19:05 UTC
This time I test HE with ISO + NFS can successful. Seem it only occurs on ISO + Soft iSCSI.