Bug 1370952

Summary: RHEL6 Satellite 6.2 upgrade error - Mongo Bug SERVER-12481
Product: Red Hat Satellite Reporter: Mike McCune <mmccune>
Component: PackagingAssignee: satellite6-bugs <satellite6-bugs>
Status: CLOSED WONTFIX QA Contact: Katello QA List <katello-qa-list>
Severity: urgent Docs Contact:
Priority: high    
Version: 6.2.0CC: bbuckingham, bkearney, ehelms, jalviso, jcallaha, mhrivnak, mmccune, stbenjam
Target Milestone: UnspecifiedKeywords: Triaged
Target Release: UnusedFlags: bkearney: needinfo? (mmccune)
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2017-06-02 18:06:57 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:

Description Mike McCune 2016-08-28 22:45:16 UTC
Customer reports upgrading from Satellite 6.1.9 to 6.2 results in an error from MongoDB: mongodb-2.4.6-2.el6sat

Loading unit model: docker_tag = pulp_docker.plugins.models:Tag
missing Extra
Traceback (most recent call last):
  File "/usr/lib/python2.6/site-packages/pulp/server/db/manage.py", line 193, in main
    return _auto_manage_db(options)
  File "/usr/lib/python2.6/site-packages/pulp/server/db/manage.py", line 256, in _auto_manage_db
    migrate_database(options)
  File "/usr/lib/python2.6/site-packages/pulp/server/db/manage.py", line 142, in migrate_database
    ensure_database_indexes()
  File "/usr/lib/python2.6/site-packages/pulp/server/db/manage.py", line 179, in ensure_database_indexes
    model_class.ensure_indexes()
  File "/usr/lib/python2.6/site-packages/mongoengine/document.py", line 738, in ensure_indexes
    collection = cls._get_collection()
  File "/usr/lib/python2.6/site-packages/mongoengine/document.py", line 210, in _get_collection
    cls.ensure_indexes()
  File "/usr/lib/python2.6/site-packages/mongoengine/document.py", line 766, in ensure_indexes
    collection.create_index(fields, background=background, **opts)
  File "/usr/lib64/python2.6/site-packages/pymongo/collection.py", line 1380, in create_index
    self.__create_index(keys, kwargs)
  File "/usr/lib64/python2.6/site-packages/pymongo/collection.py", line 1297, in __create_index
    sock_info, index, True, False, False, wcn)
  File "/usr/lib64/python2.6/site-packages/pymongo/collection.py", line 530, in _insert
    check_keys, manipulate, write_concern, op_id, bypass_doc_val)
  File "/usr/lib64/python2.6/site-packages/pymongo/collection.py", line 519, in _insert_one
    check_keys, acknowledged, concern, False, self.codec_options)
  File "/usr/lib64/python2.6/site-packages/pymongo/collection.py", line 458, in _legacy_write
    rqst_id, msg, max_size, acknowledged)
  File "/usr/lib64/python2.6/site-packages/pymongo/pool.py", line 264, in legacy_write
    return helpers._check_gle_response(response)
  File "/usr/lib64/python2.6/site-packages/pymongo/helpers.py", line 236, in _check_gle_response
    raise OperationFailure(details["err"], code, result)
OperationFailure: missing Extra

This appears to be caused by the bug in Mongo here:

https://jira.mongodb.org/browse/SERVER-12481

Will update to a more recent version of Mongo to resolve this, most likely mongodb-2.4.12-3

Comment 1 Mike McCune 2016-08-28 23:00:22 UTC
This blocks the upgrade entirely with no known current workaround.

Comment 2 Mike McCune 2016-08-28 23:01:18 UTC
NOTE: This only effects RHEL6, RHEL7 has a newer version of Mongodb.

Comment 3 Mike McCune 2016-08-28 23:04:12 UTC
** HOTFIX RPMS **

1) Download the mongodb-2.4.12-3.el6.tar.gz file from this bugzilla.

2) Extract archive on your Satellite server

3) ensure the mongodb service is stopped: service stop mongodb

4) Upgrade to 2.4.12:

rpm -Uvh mongodb-2.4.12-3.el6sat.x86_64.rpm libmongodb-2.4.12-3.el6sat.x86_64.rpm mongodb-server-2.4.12-3.el6sat.x86_64.rpm

5) start the upgrade process again:

satellite-installer --upgrade

Comment 4 Mike McCune 2016-08-28 23:11:21 UTC
Link to downloadable archive with updated packages:

http://people.redhat.com/~mmccune/1370952/mongodb-2.4.12-3.el6.tar.gz

Comment 13 Bryan Kearney 2017-06-02 18:06:57 UTC
We are not plannign to fix this on satellite 6.3. If you are seeing this on satellite 6.2.z please feel free to re-open with additional information.