Bug 1335700

Summary: migrate_foreman error upgrading from 6.1 to 6.2 -> error: Some backend services are not running
Product: Red Hat Satellite Reporter: Brad Buckingham <bbuckingham>
Component: Content ManagementAssignee: Eric Helms <ehelms>
Status: CLOSED ERRATA QA Contact: Lukas Pramuk <lpramuk>
Severity: high Docs Contact:
Priority: unspecified    
Version: 6.2.0CC: cwelton
Target Milestone: UnspecifiedKeywords: Triaged
Target Release: Unused   
Hardware: Unspecified   
OS: Unspecified   
URL: http://projects.theforeman.org/issues/14675
Whiteboard:
Fixed In Version: katello-installer-base-3.0.0.25-1 Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2016-07-27 11:18:58 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 1335807    
Attachments:
Description Flags
Satellite upgrade installer log none

Description Brad Buckingham 2016-05-13 02:01:13 UTC
Created attachment 1156958 [details]
Satellite upgrade installer log

Description of problem:

Attempting to upgrade to an early version of Satellite 6.2 Beta (internal build) from 6.1 is resulting in an error during foreman_migrate.

Version-Release number of selected component (if applicable):

Satellite 6.2 Snap 11

How reproducible:

Always

Steps to Reproduce:
1. install Satellite 6.1
2. update packages to Satellite 6.2
3. patch system to include fixes for bug 1334961, bug 1335675 & bug 1335699
4. satellite-installer --scenario satellite --upgrade --force

Actual results:

# foreman-installer --upgrade
Upgrading...
Upgrade Step: stop_services...
Upgrade Step: start_databases...
Upgrade Step: update_http_conf...
Upgrade Step: migrate_pulp...
Upgrade Step: start_httpd...
Upgrade Step: migrate_candlepin...
Upgrade Step: migrate_foreman...
Upgrade step migrate_foreman failed. Check logs for more information.

Expected results:

No error during the migrate_foreman step.

Additional info:

Note: see attached log for complete installer run.

In the /var/log/foreman-installer/satellite.log, the following is observed:

...[snip]...

[ INFO 2016-05-13 00:17:14 main] Upgrade Step: migrate_foreman...
[ERROR 2016-05-13 00:17:47 main] rake aborted!
StandardError: An error has occurred, this and all later migrations canceled:

Some backend services are not running: {:status=>"FAIL", :services=>{:pulp=>{:status=>"FAIL", :message=>"404 Resource Not Found"}, :pulp_auth=>{:status=>"FAIL", :message=>"Skipped pulp_auth check after failed pulp check"}, :candlepin=>{:status=>"FAIL", :message=>"Connection refused - connect(2) for \"localhost\" port 8443"}, :candlepin_auth=>{:status=>"FAIL", :message=>"A backend service [ Candlepin ] is unreachable"}, :foreman_tasks=>{:status=>"ok", :duration_ms=>"6"}}}/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.0.0.28/db/migrate/20150930183738_migrate_content_hosts.rb:297:in `up'

...[snip]...

/opt/theforeman/tfm/root/usr/share/gems/gems/katello-3.0.0.28/db/migrate/20150930183738_migrate_content_hosts.rb:297:in `up'

...[snip]...

Comment 2 Justin Sherrill 2016-05-13 16:16:42 UTC
Connecting redmine issue http://projects.theforeman.org/issues/14675 from this bug

Comment 3 Bryan Kearney 2016-05-13 18:15:39 UTC
Upstream bug component is Content Management

Comment 4 Bryan Kearney 2016-05-13 18:15:41 UTC
Moving to POST since upstream bug http://projects.theforeman.org/issues/14675 has been closed

Comment 5 Lukas Pramuk 2016-05-27 14:13:20 UTC
VERIFIED.

@Sat-6.2.0-Snap13.1

# satellite-installer -S satellite --upgrade 
Upgrading...
Upgrade Step: stop_services...
Upgrade Step: start_databases...
Upgrade Step: update_http_conf...
Upgrade Step: migrate_pulp...
Upgrade Step: fix_pulp_httpd_conf...
Upgrade Step: start_httpd...
Upgrade Step: start_qpidd...
Upgrade Step: start_pulp...
Upgrade Step: migrate_candlepin...
Upgrade Step: start_tomcat...
Upgrade Step: fix_katello_settings_file...
Upgrade Step: migrate_foreman...
Upgrade Step: migrate_gutterball...
Upgrade Step: remove_nodes_distributors...
Upgrade Step: Running installer...
...

>>> migrate_foreman step succeeded

Comment 6 Bryan Kearney 2016-07-27 11:18:58 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2016:1501