Bug 1177160 - pulp-manage-db fails after 2.5 upgrade - key too large to index
Summary: pulp-manage-db fails after 2.5 upgrade - key too large to index
Keywords:
Status: CLOSED DUPLICATE of bug 1175616
Alias: None
Product: Pulp
Classification: Retired
Component: z_other
Version: 2.5
Hardware: x86_64
OS: Linux
unspecified
urgent
Target Milestone: ---
: ---
Assignee: pulp-bugs
QA Contact: pulp-qe-list
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2014-12-24 16:26 UTC by Shaun Hull
Modified: 2015-01-05 17:05 UTC (History)
1 user (show)

Fixed In Version:
Doc Type: Bug Fix
Doc Text:
Clone Of:
Environment:
Last Closed: 2015-01-05 17:05:48 UTC
Embargoed:


Attachments (Terms of Use)

Description Shaun Hull 2014-12-24 16:26:22 UTC
Description of problem:

Updated to 2.5 and attempted to run pulp-manage-db as apache. Exit message is "UpdateFailed [erratum]". In the syslog  there is a "key too large to index" message.


Version-Release number of selected component (if applicable): 2.5.1


How reproducible: Always

1. yum update pulp packages from 2.5.0 to 2.5.1
2. remove published repos as instructed in upgrade instructions: sudo rm -rf /var/lib/pulp/published/yum/*
3. run pulp-manage-db:  sudo -u apache pulp-manage-db

Actual results:

[terminal]
bash-4.2$ pulp-manage-db
Loading content types.
UpdateFailed [erratum]
bash-4.2$ pulp-manage-db
Loading content types.
UpdateFailed [erratum]


[syslog]
Dec 24 09:10:49 servername pulp: pulp.server.db.manage:INFO: Loading content types.
Dec 24 09:10:49 servername pulp: db:INFO: Loading type descriptors [iso_support.json, rpm_support.json, puppet.json]
Dec 24 09:10:49 servername pulp: db:INFO: Parsing type descriptors
Dec 24 09:10:49 servername pulp: db:INFO: Validating type descriptor syntactic integrity
Dec 24 09:10:49 servername pulp: db:INFO: Validating type descriptor semantic integrity
Dec 24 09:10:49 servername pulp: db:INFO: Updating the database with types [iso, distribution, drpm, erratum, package_group, package_category, package_environment, rpm, srpm, yum_repo_metadata_file, puppet_module]
Dec 24 09:10:49 servername pulp: db:ERROR: Exception updating search indexes for type [erratum]
Dec 24 09:10:49 servername pulp: db:ERROR: Traceback (most recent call last):
Dec 24 09:10:49 servername pulp: db:ERROR:   File "/usr/lib/python2.7/site-packages/pulp/plugins/types/database.py", line 124, in update_database
Dec 24 09:10:49 servername pulp: db:ERROR:     _update_search_indexes(type_def)
Dec 24 09:10:49 servername pulp: db:ERROR:   File "/usr/lib/python2.7/site-packages/pulp/plugins/types/database.py", line 312, in _update_search_indexes
Dec 24 09:10:49 servername pulp: db:ERROR:     _update_indexes(type_def, False)
Dec 24 09:10:49 servername pulp: db:ERROR:   File "/usr/lib/python2.7/site-packages/pulp/plugins/types/database.py", line 299, in _update_indexes
Dec 24 09:10:49 servername pulp: db:ERROR:     index_name = collection.ensure_index(mongo_index, unique=unique, drop_dups=False)
Dec 24 09:10:49 servername pulp: db:ERROR:   File "/usr/lib/python2.7/site-packages/pulp/server/db/connection.py", line 144, in retry
Dec 24 09:10:49 servername pulp: db:ERROR:     return method(*args, **kwargs)
Dec 24 09:10:49 servername pulp: db:ERROR:   File "/usr/lib64/python2.7/site-packages/pymongo/collection.py", line 916, in ensure_index
Dec 24 09:10:49 servername pulp: db:ERROR:     return self.create_index(key_or_list, cache_for, **kwargs)
Dec 24 09:10:49 servername pulp: db:ERROR:   File "/usr/lib/python2.7/site-packages/pulp/server/db/connection.py", line 144, in retry
Dec 24 09:10:49 servername pulp: db:ERROR:     return method(*args, **kwargs)
Dec 24 09:10:49 servername pulp: db:ERROR:   File "/usr/lib64/python2.7/site-packages/pymongo/collection.py", line 823, in create_index
Dec 24 09:10:49 servername pulp: db:ERROR:     **self._get_wc_override())
Dec 24 09:10:49 servername pulp: db:ERROR:   File "/usr/lib64/python2.7/site-packages/pymongo/collection.py", line 357, in insert
Dec 24 09:10:49 servername pulp: db:ERROR:     continue_on_error, self.__uuid_subtype), safe)
Dec 24 09:10:49 servername pulp: db:ERROR:   File "/usr/lib/python2.7/site-packages/pulp/server/db/connection.py", line 167, in _with_end_request
Dec 24 09:10:49 servername pulp: db:ERROR:     return method(*args, **kwargs)
Dec 24 09:10:49 servername pulp: db:ERROR:   File "/usr/lib64/python2.7/site-packages/pymongo/mongo_client.py", line 920, in _send_message
Dec 24 09:10:49 servername pulp: db:ERROR:     rv = self.__check_response_to_last_error(response)
Dec 24 09:10:49 servername pulp: db:ERROR:   File "/usr/lib64/python2.7/site-packages/pymongo/mongo_client.py", line 863, in __check_response_to_last_error
Dec 24 09:10:49 servername pulp: db:ERROR:     raise OperationFailure(details["err"], details["code"])
Dec 24 09:10:49 servername pulp: db:ERROR: OperationFailure: Btree::insert: key too large to index, failing pulp_database.units_erratum.$title_1 1267 { : "ghc-7.0.4-46.el6,haskell-platform-2011.4.0.0-6.el6,ghc-rpm-macros-0.15.5-1.el6,hscolour-1.19-6.el6,ghc-HUnit-1.2.4.2-3.el6,ghc-transformers-0.2.2.0-14..." }
Dec 24 09:11:15 servername pulp: pulp.server.db.manage:CRITICAL: UpdateFailed [erratum]
Dec 24 09:11:15 servername pulp: pulp.server.db.manage:CRITICAL: Traceback (most recent call last):
Dec 24 09:11:15 servername pulp: pulp.server.db.manage:CRITICAL:   File "/usr/lib/python2.7/site-packages/pulp/server/db/manage.py", line 111, in main
Dec 24 09:11:15 servername pulp: pulp.server.db.manage:CRITICAL:     _auto_manage_db(options)
Dec 24 09:11:15 servername pulp: pulp.server.db.manage:CRITICAL:   File "/usr/lib/python2.7/site-packages/pulp/server/db/manage.py", line 135, in _auto_manage_db
Dec 24 09:11:15 servername pulp: pulp.server.db.manage:CRITICAL:     load_content_types()
Dec 24 09:11:15 servername pulp: pulp.server.db.manage:CRITICAL:   File "/usr/lib/python2.7/site-packages/pulp/plugins/loader/api.py", line 414, in load_content_types
Dec 24 09:11:15 servername pulp: pulp.server.db.manage:CRITICAL:     _load_type_definitions(descriptors)
Dec 24 09:11:15 servername pulp: pulp.server.db.manage:CRITICAL:   File "/usr/lib/python2.7/site-packages/pulp/plugins/loader/api.py", line 451, in _load_type_definitions
Dec 24 09:11:15 servername pulp: pulp.server.db.manage:CRITICAL:     database.update_database(definitions)
Dec 24 09:11:15 servername pulp: pulp.server.db.manage:CRITICAL:   File "/usr/lib/python2.7/site-packages/pulp/plugins/types/database.py", line 131, in update_database
Dec 24 09:11:15 servername pulp: pulp.server.db.manage:CRITICAL:     raise UpdateFailed(error_defs)
Dec 24 09:11:15 servername pulp: pulp.server.db.manage:CRITICAL: UpdateFailed: UpdateFailed [erratum]
Dec 24 09:11:15 servername pulp: pulp.server.db.manage:CRITICAL:




Expected results:


Additional info:

Very similar to 1175818

Installed packages
[root@delppsmon01 yum]# yum list installed |grep pulp
pulp-admin-client.noarch            2.5.1-1.el7              @pulp-v2-stable    
pulp-puppet-admin-extensions.noarch 2.5.1-1.el7              @pulp-v2-stable    
pulp-puppet-plugins.noarch          2.5.1-1.el7              @pulp-v2-stable    
pulp-rpm-admin-extensions.noarch    2.5.1-1.el7              @pulp-v2-stable    
pulp-rpm-plugins.noarch             2.5.1-1.el7              @pulp-v2-stable    
pulp-selinux.noarch                 2.5.1-1.el7              @pulp-v2-stable    
pulp-server.noarch                  2.5.1-1.el7              @pulp-v2-stable    
python-billiard.x86_64              1:3.3.0.17-1.el7         @pulp-v2-beta      
python-celery.noarch                3.1.11-1.el7             @pulp-v2-beta      
python-gofer.noarch                 1.3.1-1.el7              @pulp-v2-stable    
python-gofer-qpid.noarch            1.3.1-1.el7              @pulp-v2-stable    
python-isodate.noarch               0.5.0-4.pulp.el7         @pulp-v2-beta      
python-kombu.noarch                 1:3.0.15-12.pulp.el7     @pulp-v2-beta      
python-nectar.noarch                1.3.1-1.el7              @pulp-v2-beta      
python-pulp-bindings.noarch         2.5.1-1.el7              @pulp-v2-stable    
python-pulp-client-lib.noarch       2.5.1-1.el7              @pulp-v2-stable    
python-pulp-common.noarch           2.5.1-1.el7              @pulp-v2-stable    
python-pulp-puppet-common.noarch    2.5.1-1.el7              @pulp-v2-stable    
python-pulp-rpm-common.noarch       2.5.1-1.el7              @pulp-v2-stable    
python-requests.noarch              2.2.1-1.el7              @pulp-v2-beta      
python-semantic-version.noarch      2.2.0-3.el7              @pulp-v2-beta      
python-webpy.noarch                 0.37-3.el7               @pulp-v2-beta

Comment 1 Sayli Karmarkar 2015-01-05 17:05:48 UTC

*** This bug has been marked as a duplicate of bug 1175616 ***


Note You need to log in before you can comment on or make changes to this bug.