Bug 1178834

Summary:	Not able to sync epel5 errata in 2.6
Product:	[Retired] Pulp	Reporter:	Preethi Thomas <pthomas>
Component:	rpm-support	Assignee:	pulp-bugs
Status:	CLOSED DUPLICATE	QA Contact:	pulp-qe-list
Severity:	high	Docs Contact:
Priority:	unspecified
Version:	2.6 Beta	CC:	skarmark
Target Milestone:	---
Target Release:	---
Hardware:	Unspecified
OS:	Unspecified
Whiteboard:
Fixed In Version:		Doc Type:	Bug Fix
Doc Text:		Story Points:	---
Clone Of:		Environment:
Last Closed:	2015-01-05 17:10:13 UTC	Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:

Description Preethi Thomas 2015-01-05 14:25:57 UTC

Description of problem:

Syncing an epel5 repo fails on errata sync

Version-Release number of selected component (if applicable):
[root@ibm-x3650m4-02-vm-04 ~]# rpm -qa pulp-server
pulp-server-2.6.0-0.2.beta.el7.noarch
[root@ibm-x3650m4-02-vm-04 ~]# 


How reproducible:


Steps to Reproduce:
1. create a repo with epel5 feed (https://dl.fedoraproject.org/pub/epel/5/i386/)
2.Sync the repo
3.

Actual results:
oot@ibm-x3650m4-02-vm-04 ~]# pulp-admin rpm repo sync run --repo-id epel5
+----------------------------------------------------------------------+
                    Synchronizing Repository [epel5]
+----------------------------------------------------------------------+

This command may be exited via ctrl+c without affecting the request.


Downloading metadata...
[-]
... completed

Downloading repository content...
[==================================================] 100%
RPMs:       50/50 items
Delta RPMs: 0/0 items

... completed

Downloading distribution files...
[==================================================] 100%
Distributions: 0/0 items
... completed

Importing errata...
[-]
... failed


Task Failed

Importer indicated a failed response


Expected results:


Additional info:

Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp.plugins.conduits.mixins:ERROR: (11400-51040) Content unit association failed [Unit [key={'id': 'FEDORA-EPEL-2014-3695'}] [type=erratum] [id=None]]
Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp.plugins.conduits.mixins:ERROR: (11400-51040) Traceback (most recent call last):
Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp.plugins.conduits.mixins:ERROR: (11400-51040)   File "/usr/lib/python2.7/site-packages/pulp/plugins/conduits/mixins.py", line 486, in save_unit
Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp.plugins.conduits.mixins:ERROR: (11400-51040)     unit.id = self._update_unit(unit, pulp_unit)
Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp.plugins.conduits.mixins:ERROR: (11400-51040)   File "/usr/lib/python2.7/site-packages/pulp/plugins/conduits/mixins.py", line 518, in _update_unit
Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp.plugins.conduits.mixins:ERROR: (11400-51040)     return self._add_unit(unit, pulp_unit)
Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp.plugins.conduits.mixins:ERROR: (11400-51040)   File "/usr/lib/python2.7/site-packages/pulp/plugins/conduits/mixins.py", line 540, in _add_unit
Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp.plugins.conduits.mixins:ERROR: (11400-51040)     unit_id = content_manager.add_content_unit(unit.type_id, None, pulp_unit)
Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp.plugins.conduits.mixins:ERROR: (11400-51040)   File "/usr/lib/python2.7/site-packages/pulp/server/managers/content/cud.py", line 35, in add_content_unit
Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp.plugins.conduits.mixins:ERROR: (11400-51040)     collection.insert(unit_doc, safe=True)
Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp.plugins.conduits.mixins:ERROR: (11400-51040)   File "/usr/lib/python2.7/site-packages/pulp/server/db/connection.py", line 155, in retry
Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp.plugins.conduits.mixins:ERROR: (11400-51040)     return method(*args, **kwargs)
Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp.plugins.conduits.mixins:ERROR: (11400-51040)   File "/usr/lib64/python2.7/site-packages/pymongo/collection.py", line 357, in insert
Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp.plugins.conduits.mixins:ERROR: (11400-51040)     continue_on_error, self.__uuid_subtype), safe)
Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp.plugins.conduits.mixins:ERROR: (11400-51040)   File "/usr/lib64/python2.7/site-packages/pymongo/mongo_client.py", line 920, in _send_message
Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp.plugins.conduits.mixins:ERROR: (11400-51040)     rv = self.__check_response_to_last_error(response)
Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp.plugins.conduits.mixins:ERROR: (11400-51040)   File "/usr/lib64/python2.7/site-packages/pymongo/mongo_client.py", line 863, in __check_response_to_last_error
Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp.plugins.conduits.mixins:ERROR: (11400-51040)     raise OperationFailure(details["err"], details["code"])
Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp.plugins.conduits.mixins:ERROR: (11400-51040) OperationFailure: insertDocument :: caused by :: 17280 Btree::insert: key too large to index, failing pulp_database.units_erratum.$title_1 1408 { : "globus-common-15.26-1.el5,globus-gsi-proxy-ssl-5.7-1.el5,globus-gsi-openssl-error-3.5-1.el5,globus-openssl-module-4.6-1.el5,globus-gsi-cert-utils-9.10..." }
Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp_rpm.plugins.importers.yum.sync:ERROR: (11400-51040) sync failed
Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp_rpm.plugins.importers.yum.sync:ERROR: (11400-51040) Traceback (most recent call last):
Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp_rpm.plugins.importers.yum.sync:ERROR: (11400-51040)   File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/importers/yum/sync.py", line 134, in run
Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp_rpm.plugins.importers.yum.sync:ERROR: (11400-51040)     self.get_errata(metadata_files)
Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp_rpm.plugins.importers.yum.sync:ERROR: (11400-51040)   File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/importers/yum/sync.py", line 470, in get_errata
Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp_rpm.plugins.importers.yum.sync:ERROR: (11400-51040)     self.save_fileless_units(errata_file_handle, updateinfo.PACKAGE_TAG, updateinfo.process_package_element)
Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp_rpm.plugins.importers.yum.sync:ERROR: (11400-51040)   File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/importers/yum/sync.py", line 541, in save_fileless_units
Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp_rpm.plugins.importers.yum.sync:ERROR: (11400-51040)     self.sync_conduit.save_unit(unit)
Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp_rpm.plugins.importers.yum.sync:ERROR: (11400-51040)   File "/usr/lib/python2.7/site-packages/pulp/plugins/conduits/mixins.py", line 486, in save_unit
Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp_rpm.plugins.importers.yum.sync:ERROR: (11400-51040)     unit.id = self._update_unit(unit, pulp_unit)
Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp_rpm.plugins.importers.yum.sync:ERROR: (11400-51040)   File "/usr/lib/python2.7/site-packages/pulp/plugins/conduits/mixins.py", line 518, in _update_unit
Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp_rpm.plugins.importers.yum.sync:ERROR: (11400-51040)     return self._add_unit(unit, pulp_unit)
Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp_rpm.plugins.importers.yum.sync:ERROR: (11400-51040)   File "/usr/lib/python2.7/site-packages/pulp/plugins/conduits/mixins.py", line 540, in _add_unit
Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp_rpm.plugins.importers.yum.sync:ERROR: (11400-51040)     unit_id = content_manager.add_content_unit(unit.type_id, None, pulp_unit)
Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp_rpm.plugins.importers.yum.sync:ERROR: (11400-51040)   File "/usr/lib/python2.7/site-packages/pulp/server/managers/content/cud.py", line 35, in add_content_unit
Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp_rpm.plugins.importers.yum.sync:ERROR: (11400-51040)     collection.insert(unit_doc, safe=True)
Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp_rpm.plugins.importers.yum.sync:ERROR: (11400-51040)   File "/usr/lib/python2.7/site-packages/pulp/server/db/connection.py", line 155, in retry
Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp_rpm.plugins.importers.yum.sync:ERROR: (11400-51040)     return method(*args, **kwargs)
Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp_rpm.plugins.importers.yum.sync:ERROR: (11400-51040)   File "/usr/lib64/python2.7/site-packages/pymongo/collection.py", line 357, in insert
Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp_rpm.plugins.importers.yum.sync:ERROR: (11400-51040)     continue_on_error, self.__uuid_subtype), safe)
Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp_rpm.plugins.importers.yum.sync:ERROR: (11400-51040)   File "/usr/lib64/python2.7/site-packages/pymongo/mongo_client.py", line 920, in _send_message
Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp_rpm.plugins.importers.yum.sync:ERROR: (11400-51040)     rv = self.__check_response_to_last_error(response)
Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp_rpm.plugins.importers.yum.sync:ERROR: (11400-51040)   File "/usr/lib64/python2.7/site-packages/pymongo/mongo_client.py", line 863, in __check_response_to_last_error
Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp_rpm.plugins.importers.yum.sync:ERROR: (11400-51040)     raise OperationFailure(details["err"], details["code"])
Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11400]: pulp_rpm.plugins.importers.yum.sync:ERROR: (11400-51040) ImporterConduitException: insertDocument :: caused by :: 17280 Btree::insert: key too large to index, failing pulp_database.units_erratum.$title_1 1408 { : "globus-common-15.26-1.el5,globus-gsi-proxy-ssl-5.7-1.el5,globus-gsi-openssl-error-3.5-1.el5,globus-openssl-module-4.6-1.el5,globus-gsi-cert-utils-9.10..." }
Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11329]: celery.worker.job:ERROR: (11329-51040) Task pulp.server.tasks.repository.sync_with_auto_publish[2e51c19d-0562-42a3-b67d-9ba9cea37179] raised unexpected: PulpExecutionException('Importer indicated a failed response',)
Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11329]: celery.worker.job:ERROR: (11329-51040) Traceback (most recent call last):
Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11329]: celery.worker.job:ERROR: (11329-51040)   File "/usr/lib/python2.7/site-packages/celery/app/trace.py", line 240, in trace_task
Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11329]: celery.worker.job:ERROR: (11329-51040)     R = retval = fun(*args, **kwargs)
Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11329]: celery.worker.job:ERROR: (11329-51040)   File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line 328, in __call__
Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11329]: celery.worker.job:ERROR: (11329-51040)     return super(Task, self).__call__(*args, **kwargs)
Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11329]: celery.worker.job:ERROR: (11329-51040)   File "/usr/lib/python2.7/site-packages/celery/app/trace.py", line 437, in __protected_call__
Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11329]: celery.worker.job:ERROR: (11329-51040)     return self.run(*args, **kwargs)
Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11329]: celery.worker.job:ERROR: (11329-51040)   File "/usr/lib/python2.7/site-packages/pulp/server/tasks/repository.py", line 210, in sync_with_auto_publish
Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11329]: celery.worker.job:ERROR: (11329-51040)     sync_result = managers.repo_sync_manager().sync(repo_id, sync_config_override=overrides)
Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11329]: celery.worker.job:ERROR: (11329-51040)   File "/usr/lib/python2.7/site-packages/pulp/server/managers/repo/sync.py", line 113, in sync
Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11329]: celery.worker.job:ERROR: (11329-51040)     raise PulpExecutionException(_('Importer indicated a failed response'))
Jan 05 08:19:46 ibm-x3650m4-02-vm-04.lab.eng.bos.redhat.com pulp[11329]: celery.worker.job:ERROR: (11329-51040) PulpExecutionException: Importer indicated a failed response

Comment 1 Preethi Thomas 2015-01-05 14:53:57 UTC

I tried an epel6 repo and it failed as well.

Comment 2 Sayli Karmarkar 2015-01-05 17:10:13 UTC


*** This bug has been marked as a duplicate of bug 1175616 ***