Bug 1458680

Summary: Upgrade [6.2 -> 6.3]: Failed Upgrade Step: migrate_pulp
Product: Red Hat Satellite Reporter: Sanket Jagtap <sjagtap>
Component: PulpAssignee: satellite6-bugs <satellite6-bugs>
Status: CLOSED ERRATA QA Contact: Chris Roberts <chrobert>
Severity: medium Docs Contact:
Priority: medium    
Version: 6.3.0CC: bbuckingham, bkearney, chrobert, ehelms, inecas, jcallaha, mbacovsk, mhrivnak, pcreech, sghai, ttereshc
Target Milestone: UnspecifiedKeywords: PrioBumpQA, Reopened, Triaged
Target Release: Unused   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2018-02-21 16:54:37 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 1458642    
Attachments:
Description Flags
foreman-debug none

Description Sanket Jagtap 2017-06-05 08:19:49 UTC
Description of problem:
Build: Satellite 6.3 snap1

Version-Release number of selected component (if applicable):
sat6.2.9 -> sat6.3.0 snap1

How reproducible:


Steps to Reproduce:
1. yum update -y
2. satellite-installer --scenario satellite --upgrade
3. Failed Upgrade Step: migrate_pulp

Upgrade Step: migrate_pulp...
grep -qe '7.[[:digit:]]' /etc/redhat-release finished successfully!
sed -i -e 's?/var/run/mongodb/mongodb.pid?/var/run/mongodb/mongod.pid?g' /etc/mongod.conf finished successfully!
62334
pgrep mongod finished successfully!
Attempting to connect to localhost:27017
Attempting to connect to localhost:27017
Write concern for Mongo connection: {}
Loading content types.
Loading type descriptors []
Parsing type descriptors
Validating type descriptor syntactic integrity
Validating type descriptor semantic integrity
Loading unit model: erratum = pulp_rpm.plugins.db.models:Errata
Loading unit model: distribution = pulp_rpm.plugins.db.models:Distribution
Loading unit model: srpm = pulp_rpm.plugins.db.models:SRPM
Loading unit model: package_group = pulp_rpm.plugins.db.models:PackageGroup
Loading unit model: package_category = pulp_rpm.plugins.db.models:PackageCategory
Loading unit model: iso = pulp_rpm.plugins.db.models:ISO
Loading unit model: package_environment = pulp_rpm.plugins.db.models:PackageEnvironment
Loading unit model: drpm = pulp_rpm.plugins.db.models:DRPM
Loading unit model: package_langpacks = pulp_rpm.plugins.db.models:PackageLangpacks
Loading unit model: rpm = pulp_rpm.plugins.db.models:RPM
Loading unit model: yum_repo_metadata_file = pulp_rpm.plugins.db.models:YumMetadataFile
Loading unit model: docker_blob = pulp_docker.plugins.models:Blob
Loading unit model: docker_manifest = pulp_docker.plugins.models:Manifest
Loading unit model: docker_image = pulp_docker.plugins.models:Image
Loading unit model: docker_tag = pulp_docker.plugins.models:Tag
Loading unit model: puppet_module = pulp_puppet.plugins.db.models:Module
Loading unit model: ostree = pulp_ostree.plugins.db.model:Branch
Updating the database with types []
Found the following type definitions that were not present in the update collection [puppet_module, node, drpm, ostree, repository, erratum, docker_blob, docker_manifest, yum_repo_metadata_fi
le, package_group, package_category, iso, package_environment, docker_tag, distribution, rpm, srpm, docker_image]
Updating the database with types [puppet_module, docker_tag, ostree, package_langpacks, erratum, docker_blob, docker_manifest, yum_repo_metadata_file, package_group, package_category, iso, package_environment, drpm, distribution, rpm, srpm, docker_image]
Found the following type definitions that were not present in the update collection [node, repository]
Content types loaded.
Ensuring the admin role and user are in place.
Admin role and user are in place.
Beginning database migrations.
Applying pulp.server.db.migrations version 25
Migration to pulp.server.db.migrations version 25 complete.
Applying pulp.server.db.migrations version 26
Migration to pulp.server.db.migrations version 26 complete.
Applying pulp.server.db.migrations version 27
Migration to pulp.server.db.migrations version 27 complete.
Applying pulp.server.db.migrations version 28
Migration to pulp.server.db.migrations version 28 complete.
Migration package pulp_docker.plugins.migrations is up to date at version 2
Migration package pulp_puppet.plugins.migrations is up to date at version 5
Applying pulp_rpm.plugins.migrations version 35
Migration to pulp_rpm.plugins.migrations version 35 complete.
Applying pulp_rpm.plugins.migrations version 36
Migration to pulp_rpm.plugins.migrations version 36 complete.
Applying pulp_rpm.plugins.migrations version 37
Applying migration pulp_rpm.plugins.migrations.0037_rpm_primary_repodata_new_location failed.

Halting migrations due to a migration failure.
'ascii' codec can't decode byte 0x9c in position 1: ordinal not in range(128)
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/pulp/server/db/manage.py", line 227, in main
    return _auto_manage_db(options)
  File "/usr/lib/python2.7/site-packages/pulp/server/db/manage.py", line 294, in _auto_manage_db
    migrate_database(options)
  File "/usr/lib/python2.7/site-packages/pulp/server/db/manage.py", line 129, in migrate_database
    update_current_version=not options.test)
  File "/usr/lib/python2.7/site-packages/pulp/server/db/migrate/models.py", line 186, in apply_migration
    migration.migrate()
  File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/migrations/0037_rpm_primary_repodata_new_location.py", line 44, in migrate
    migrate_rpm_base(rpm_collection, rpm)
  File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/migrations/0037_rpm_primary_repodata_new_location.py", line 59, in migrate_rpm_base
    delta['repodata'] = fix_location(unit['repodata'], unit['filename'])
  File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/migrations/0037_rpm_primary_repodata_new_location.py", line 73, in fix_location
    faked_primary = fake_xml_element(repodata['primary'])
  File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/migrations/0037_rpm_primary_repodata_new_location.py", line 111, in fake_xml_element
    repodata_snippet.encode(codec)
UnicodeDecodeError: 'ascii' codec can't decode byte 0x9c in position 1: ordinal not in range(128)

su - apache -s /bin/bash -c pulp-manage-db failed! Check the output for error!
Upgrade step migrate_pulp failed. Check logs for more information.

Actual results:
Installer failed

Expected results: upgrade should be successful.

Additional info:

Comment 3 Sachin Ghai 2017-06-06 02:52:49 UTC
Created attachment 1285190 [details]
foreman-debug

Comment 5 pulp-infra@redhat.com 2017-06-19 20:02:14 UTC
The Pulp upstream bug status is at NEW. Updating the external tracker on this bug.

Comment 6 pulp-infra@redhat.com 2017-06-19 20:02:20 UTC
The Pulp upstream bug priority is at Normal. Updating the external tracker on this bug.

Comment 8 pulp-infra@redhat.com 2017-06-20 13:33:16 UTC
The Pulp upstream bug status is at CLOSED - NOTABUG. Updating the external tracker on this bug.

Comment 10 Sachin Ghai 2017-07-04 10:38:25 UTC
I'm not sure why this bug was closed as "Not a Bug". Something was missing so we faced the reported issue. It should be on ON_QA as migration issue is fixed in snap5.

Comment 12 Chris Roberts 2017-08-23 16:12:54 UTC
Upgrade completed ok:

/opt/theforeman/tfm/root/usr/share/gems/gems/redhat_access-2.0.3/app/services/redhat_access/telemetry/look_ups.rb:171: warning: key :hosts is duplicated and overwritten on line 172
Importing Subscriptions
foreman-rake katello:upgrades:3.3:import_subscriptions finished successfully!
Upgrade completed!

Comment 13 pulp-infra@redhat.com 2018-01-04 18:02:48 UTC
The Pulp upstream bug status is at NEW. Updating the external tracker on this bug.

Comment 14 Satellite Program 2018-02-21 16:54:37 UTC
Since the problem described in this bug report should be resolved in a recent advisory, it has been closed with a resolution of ERRATA.
> > 
> > For information on the advisory, and where to find the updated files, follow the link below.
> > 
> > If the solution does not work for you, open a new bug report.
> > 
> > https://access.redhat.com/errata/RHSA-2018:0336