Bug 1366013

Summary: Bare-metal RHV self-hosted two-hypervisor deployment reports access-insights registration failure on second hypervisor
Product: Red Hat Quickstart Cloud Installer Reporter: jkim
Component: Installation - RHEVAssignee: Fabian von Feilitzsch <fabian>
Status: CLOSED DUPLICATE QA Contact: Dave Johnson <dajohnso>
Severity: unspecified Docs Contact: Dan Macpherson <dmacpher>
Priority: unspecified    
Version: 1.0CC: bthurber, jmatthew
Target Milestone: ---Keywords: Triaged
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2016-08-17 16:34:48 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Attachments:
Description Flags
satellite sosreport
none
hypervisor sosreport none

Description jkim 2016-08-10 18:13:07 UTC
Description of problem:
In Bare-Metal testing, configured a RHV self-hosted deployment with 2 hypervisors, with access-insights option selected.  The second hypervisor reports that a failure has occured with '/usr/bin/redhat-access-insights --register' returning a '1' expecting a '0'


Version-Release number of selected component (if applicable):
QCI-1.0-RHEL-7-20160809.t.1

How reproducible:
Uncertain

Steps to Reproduce:
1. Install and configure QCI 
2. Deploy RHV with self-hosted
3. Select 2 discovered nodes for hypervisor
4. Select access-insights option

Actual results:
Error reported in the second hypervisor that says "/usr/bin/redhat-access-insights --register returning a '1' expecting a '0'"

Expected results:
Successful deployment

Additional info:
Workaround the issue with the following steps:
1. Logon to the second hypervisor
2. issue the command '/usr/bin/redhat-access-insights --register'\
3. puppet agent -t
4. resume the failed task at the Satellite's WebUI
5. Rest of the deployment successfully completes

Comment 3 John Matthews 2016-08-10 20:23:45 UTC
Spoke to lphiri in IRC about this issue, he suspects this may be an intermittent backend issue with candlepin.

Comment 4 jkim 2016-08-10 20:26:52 UTC
Created attachment 1189794 [details]
satellite sosreport

Comment 5 jkim 2016-08-10 20:28:05 UTC
Comment on attachment 1189794 [details]
satellite sosreport

Satellite sosreport

Comment 6 jkim 2016-08-10 20:38:55 UTC
Created attachment 1189795 [details]
hypervisor sosreport

Comment 7 jkim 2016-08-10 20:41:13 UTC
From the Hypervisor h2.example.com
/var/log/messages:
Aug 10 14:13:50 h2 puppet-agent[5321]: (/Stage[main]/Access_insights_client/Package[redhat-access-insights]/ensure) created
Aug 10 14:13:54 h2 puppet-agent[5321]: (/Stage[main]/Access_insights_client/Exec[/usr/bin/redhat-access-insights --register]/returns) ERROR: Upload failed!
Aug 10 14:13:54 h2 puppet-agent[5321]: (/Stage[main]/Access_insights_client/Exec[/usr/bin/redhat-access-insights --register]/returns) Debug Information:
Aug 10 14:13:54 h2 puppet-agent[5321]: (/Stage[main]/Access_insights_client/Exec[/usr/bin/redhat-access-insights --register]/returns) HTTP Status Code: 502
Aug 10 14:13:54 h2 puppet-agent[5321]: (/Stage[main]/Access_insights_client/Exec[/usr/bin/redhat-access-insights --register]/returns) HTTP Status Text: Bad Gateway
Aug 10 14:13:54 h2 puppet-agent[5321]: /usr/bin/redhat-access-insights --register returned 1 instead of one of [0]
Aug 10 14:13:54 h2 puppet-agent[5321]: (/Stage[main]/Access_insights_client/Exec[/usr/bin/redhat-access-insights --register]/returns) change from notrun to 0 failed: /usr/bin/redhat-access-insights --register returned 1 instead of one of [0]
Aug 10 14:13:54 h2 puppet-agent[5321]: (/Stage[main]/Access_insights_client/File[/etc/redhat-access-insights/redhat-access-insights.conf]/content) content changed '{md5}4ca47ad4720567de81a5896381d830a4' to '{md5}9636ddb503bf0bf77f141b8ea2408ae5'

Comment 8 jkim 2016-08-10 20:45:00 UTC
From Satellite sat62fusor.example.com
/var/log/httpd/foreman-ssl_access_ssl.log
10.9.45.11 - fb09c12c-9fba-4c55-9e9b-120d6f0b2701 [10/Aug/2016:10:13:50 -0400] "POST /redhat_access/r/insights/v1/systems HTTP/1.1" 502 60 "-" "redhat-access-insights/1.0.6"

Comment 9 John Matthews 2016-08-17 16:26:56 UTC
We are deferring this issue to post-GA

Comment 10 John Matthews 2016-08-17 16:34:48 UTC

*** This bug has been marked as a duplicate of bug 1367762 ***