Description of problem: Syncing an epel5 repo fails on errata sync Version-Release number of selected component (if applicable): [root@ibm-x3650m4-02-vm-04 ~]# rpm -qa pulp-server pulp-server-2.6.0-0.2.beta.el7.noarch [root@ibm-x3650m4-02-vm-04 ~]# How reproducible: Steps to Reproduce: 1. create a repo with epel5 feed (https://dl.fedoraproject.org/pub/epel/5/i386/) 2.Sync the repo 3. Actual results: oot@ibm-x3650m4-02-vm-04 ~]# pulp-admin rpm repo sync run --repo-id epel5 +----------------------------------------------------------------------+ Synchronizing Repository [epel5] +----------------------------------------------------------------------+ This command may be exited via ctrl+c without affecting the request. Downloading metadata... [-] ... completed Downloading repository content... [==================================================] 100% RPMs: 50/50 items Delta RPMs: 0/0 items ... completed Downloading distribution files... [==================================================] 100% Distributions: 0/0 items ... completed Importing errata... [-] ... failed Task Failed Importer indicated a failed response Expected results: Additional info: Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp.plugins.conduits.mixins:ERROR: (11400-51040) Content unit association failed [Unit [key={'id': 'FEDORA-EPEL-2014-3695'}] [type=erratum] [id=None]] Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp.plugins.conduits.mixins:ERROR: (11400-51040) Traceback (most recent call last): Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp.plugins.conduits.mixins:ERROR: (11400-51040) File "/usr/lib/python2.7/site-packages/pulp/plugins/conduits/mixins.py", line 486, in save_unit Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp.plugins.conduits.mixins:ERROR: (11400-51040) unit.id = self._update_unit(unit, pulp_unit) Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp.plugins.conduits.mixins:ERROR: (11400-51040) File "/usr/lib/python2.7/site-packages/pulp/plugins/conduits/mixins.py", line 518, in _update_unit Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp.plugins.conduits.mixins:ERROR: (11400-51040) return self._add_unit(unit, pulp_unit) Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp.plugins.conduits.mixins:ERROR: (11400-51040) File "/usr/lib/python2.7/site-packages/pulp/plugins/conduits/mixins.py", line 540, in _add_unit Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp.plugins.conduits.mixins:ERROR: (11400-51040) unit_id = content_manager.add_content_unit(unit.type_id, None, pulp_unit) Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp.plugins.conduits.mixins:ERROR: (11400-51040) File "/usr/lib/python2.7/site-packages/pulp/server/managers/content/cud.py", line 35, in add_content_unit Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp.plugins.conduits.mixins:ERROR: (11400-51040) collection.insert(unit_doc, safe=True) Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp.plugins.conduits.mixins:ERROR: (11400-51040) File "/usr/lib/python2.7/site-packages/pulp/server/db/connection.py", line 155, in retry Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp.plugins.conduits.mixins:ERROR: (11400-51040) return method(*args, **kwargs) Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp.plugins.conduits.mixins:ERROR: (11400-51040) File "/usr/lib64/python2.7/site-packages/pymongo/collection.py", line 357, in insert Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp.plugins.conduits.mixins:ERROR: (11400-51040) continue_on_error, self.__uuid_subtype), safe) Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp.plugins.conduits.mixins:ERROR: (11400-51040) File "/usr/lib64/python2.7/site-packages/pymongo/mongo_client.py", line 920, in _send_message Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp.plugins.conduits.mixins:ERROR: (11400-51040) rv = self.__check_response_to_last_error(response) Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp.plugins.conduits.mixins:ERROR: (11400-51040) File "/usr/lib64/python2.7/site-packages/pymongo/mongo_client.py", line 863, in __check_response_to_last_error Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp.plugins.conduits.mixins:ERROR: (11400-51040) raise OperationFailure(details["err"], details["code"]) Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp.plugins.conduits.mixins:ERROR: (11400-51040) OperationFailure: insertDocument :: caused by :: 17280 Btree::insert: key too large to index, failing pulp_database.units_erratum.$title_1 1408 { : "globus-common-15.26-1.el5,globus-gsi-proxy-ssl-5.7-1.el5,globus-gsi-openssl-error-3.5-1.el5,globus-openssl-module-4.6-1.el5,globus-gsi-cert-utils-9.10..." } Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp_rpm.plugins.importers.yum.sync:ERROR: (11400-51040) sync failed Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp_rpm.plugins.importers.yum.sync:ERROR: (11400-51040) Traceback (most recent call last): Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp_rpm.plugins.importers.yum.sync:ERROR: (11400-51040) File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/importers/yum/sync.py", line 134, in run Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp_rpm.plugins.importers.yum.sync:ERROR: (11400-51040) self.get_errata(metadata_files) Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp_rpm.plugins.importers.yum.sync:ERROR: (11400-51040) File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/importers/yum/sync.py", line 470, in get_errata Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp_rpm.plugins.importers.yum.sync:ERROR: (11400-51040) self.save_fileless_units(errata_file_handle, updateinfo.PACKAGE_TAG, updateinfo.process_package_element) Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp_rpm.plugins.importers.yum.sync:ERROR: (11400-51040) File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/importers/yum/sync.py", line 541, in save_fileless_units Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp_rpm.plugins.importers.yum.sync:ERROR: (11400-51040) self.sync_conduit.save_unit(unit) Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp_rpm.plugins.importers.yum.sync:ERROR: (11400-51040) File "/usr/lib/python2.7/site-packages/pulp/plugins/conduits/mixins.py", line 486, in save_unit Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp_rpm.plugins.importers.yum.sync:ERROR: (11400-51040) unit.id = self._update_unit(unit, pulp_unit) Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp_rpm.plugins.importers.yum.sync:ERROR: (11400-51040) File "/usr/lib/python2.7/site-packages/pulp/plugins/conduits/mixins.py", line 518, in _update_unit Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp_rpm.plugins.importers.yum.sync:ERROR: (11400-51040) return self._add_unit(unit, pulp_unit) Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp_rpm.plugins.importers.yum.sync:ERROR: (11400-51040) File "/usr/lib/python2.7/site-packages/pulp/plugins/conduits/mixins.py", line 540, in _add_unit Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp_rpm.plugins.importers.yum.sync:ERROR: (11400-51040) unit_id = content_manager.add_content_unit(unit.type_id, None, pulp_unit) Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp_rpm.plugins.importers.yum.sync:ERROR: (11400-51040) File "/usr/lib/python2.7/site-packages/pulp/server/managers/content/cud.py", line 35, in add_content_unit Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp_rpm.plugins.importers.yum.sync:ERROR: (11400-51040) collection.insert(unit_doc, safe=True) Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp_rpm.plugins.importers.yum.sync:ERROR: (11400-51040) File "/usr/lib/python2.7/site-packages/pulp/server/db/connection.py", line 155, in retry Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp_rpm.plugins.importers.yum.sync:ERROR: (11400-51040) return method(*args, **kwargs) Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp_rpm.plugins.importers.yum.sync:ERROR: (11400-51040) File "/usr/lib64/python2.7/site-packages/pymongo/collection.py", line 357, in insert Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp_rpm.plugins.importers.yum.sync:ERROR: (11400-51040) continue_on_error, self.__uuid_subtype), safe) Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp_rpm.plugins.importers.yum.sync:ERROR: (11400-51040) File "/usr/lib64/python2.7/site-packages/pymongo/mongo_client.py", line 920, in _send_message Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp_rpm.plugins.importers.yum.sync:ERROR: (11400-51040) rv = self.__check_response_to_last_error(response) Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp_rpm.plugins.importers.yum.sync:ERROR: (11400-51040) File "/usr/lib64/python2.7/site-packages/pymongo/mongo_client.py", line 863, in __check_response_to_last_error Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp_rpm.plugins.importers.yum.sync:ERROR: (11400-51040) raise OperationFailure(details["err"], details["code"]) Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp_rpm.plugins.importers.yum.sync:ERROR: (11400-51040) ImporterConduitException: insertDocument :: caused by :: 17280 Btree::insert: key too large to index, failing pulp_database.units_erratum.$title_1 1408 { : "globus-common-15.26-1.el5,globus-gsi-proxy-ssl-5.7-1.el5,globus-gsi-openssl-error-3.5-1.el5,globus-openssl-module-4.6-1.el5,globus-gsi-cert-utils-9.10..." } Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11329]: celery.worker.job:ERROR: (11329-51040) Task pulp.server.tasks.repository.sync_with_auto_publish[2e51c19d-0562-42a3-b67d-9ba9cea37179] raised unexpected: PulpExecutionException('Importer indicated a failed response',) Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11329]: celery.worker.job:ERROR: (11329-51040) Traceback (most recent call last): Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11329]: celery.worker.job:ERROR: (11329-51040) File "/usr/lib/python2.7/site-packages/celery/app/trace.py", line 240, in trace_task Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11329]: celery.worker.job:ERROR: (11329-51040) R = retval = fun(*args, **kwargs) Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11329]: celery.worker.job:ERROR: (11329-51040) File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line 328, in __call__ Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11329]: celery.worker.job:ERROR: (11329-51040) return super(Task, self).__call__(*args, **kwargs) Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11329]: celery.worker.job:ERROR: (11329-51040) File "/usr/lib/python2.7/site-packages/celery/app/trace.py", line 437, in __protected_call__ Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11329]: celery.worker.job:ERROR: (11329-51040) return self.run(*args, **kwargs) Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11329]: celery.worker.job:ERROR: (11329-51040) File "/usr/lib/python2.7/site-packages/pulp/server/tasks/repository.py", line 210, in sync_with_auto_publish Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11329]: celery.worker.job:ERROR: (11329-51040) sync_result = managers.repo_sync_manager().sync(repo_id, sync_config_override=overrides) Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11329]: celery.worker.job:ERROR: (11329-51040) File "/usr/lib/python2.7/site-packages/pulp/server/managers/repo/sync.py", line 113, in sync Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11329]: celery.worker.job:ERROR: (11329-51040) raise PulpExecutionException(_('Importer indicated a failed response')) Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11329]: celery.worker.job:ERROR: (11329-51040) PulpExecutionException: Importer indicated a failed response
I tried an epel6 repo and it failed as well.
*** This bug has been marked as a duplicate of bug 1175616 ***