Created attachment 938503 [details] log Description of problem: Exception occurs on generating sqlite files if you use -generate-sqlite true Version-Release number of selected component (if applicable): [root@qe-blade-11 ~]# rpm -qa pulp-server pulp-server-2.5.0-0.1.alpha.el7.noarch [root@qe-blade-11 ~]# How reproducible: Steps to Reproduce: 1. create a repo with --generate-sqlite true 2. Run repo sync 3. Actual results: [root@qe-blade-11 ~]# pulp-admin rpm repo create --repo-id fedora --feed http://download.devel.redhat.com/released/F-19/GOLD/Fedora/x86_64/os/ --generate-sqlite true --validate true Successfully created repository [fedora] [root@qe-blade-11 ~]# [root@qe-blade-11 ~]# [root@qe-blade-11 ~]# pulp-admin rpm repo sync run --repo-id fedora +----------------------------------------------------------------------+ Synchronizing Repository [fedora] +----------------------------------------------------------------------+ This command may be exited via ctrl+c without affecting the request. Downloading metadata... [|] ... completed Downloading repository content... [==================================================] 100% RPMs: 3949/3949 items Delta RPMs: 0/0 items ... completed Downloading distribution files... [==================================================] 100% Distributions: 7/7 items ... completed Importing errata... [-] ... completed Importing package groups/categories... [\] ... completed Task Succeeded Initializing repo metadata [-] ... completed Publishing Distribution files [-] ... completed Publishing RPMs [==================================================] 100% 3949 of 3949 items ... completed Publishing Delta RPMs ... skipped Publishing Errata [-] ... completed Publishing Comps file [==================================================] 100% 124 of 124 items ... completed Publishing Metadata. [-] ... completed Closing repo metadata [-] ... completed Generating sqlite files [-] ... failed A general pulp exception occurred Task Failed A general pulp exception occurred Expected results: Additional info:
Sep 18 11:26:54 qe-blade-11.idmqe.lab.eng.bos.redhat.com pulp[29103]: pulp.server.managers.repo.publish:ERROR: Exception caught from plugin during publish for repo [F20] Sep 18 11:26:54 qe-blade-11.idmqe.lab.eng.bos.redhat.com pulp[29103]: pulp.server.managers.repo.publish:ERROR: Traceback (most recent call last): Sep 18 11:26:54 qe-blade-11.idmqe.lab.eng.bos.redhat.com pulp[29103]: pulp.server.managers.repo.publish:ERROR: File "/usr/lib/python2.7/site-packages/pulp/server/managers/repo/publish.py", line 126, in _do_publish Sep 18 11:26:54 qe-blade-11.idmqe.lab.eng.bos.redhat.com pulp[29103]: pulp.server.managers.repo.publish:ERROR: publish_report = publish_repo(transfer_repo, conduit, call_config) Sep 18 11:26:54 qe-blade-11.idmqe.lab.eng.bos.redhat.com pulp[29103]: pulp.server.managers.repo.publish:ERROR: File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line 470, in wrap_f Sep 18 11:26:54 qe-blade-11.idmqe.lab.eng.bos.redhat.com pulp[29103]: pulp.server.managers.repo.publish:ERROR: return f(*args, **kwargs) Sep 18 11:26:54 qe-blade-11.idmqe.lab.eng.bos.redhat.com pulp[29103]: pulp.server.managers.repo.publish:ERROR: File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/distributors/yum/distributor.py", line 143, in publish_repo Sep 18 11:26:54 qe-blade-11.idmqe.lab.eng.bos.redhat.com pulp[29103]: pulp.server.managers.repo.publish:ERROR: return self._publisher.publish() Sep 18 11:26:54 qe-blade-11.idmqe.lab.eng.bos.redhat.com pulp[29103]: pulp.server.managers.repo.publish:ERROR: File "/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py", line 507, in publish Sep 18 11:26:54 qe-blade-11.idmqe.lab.eng.bos.redhat.com pulp[29103]: pulp.server.managers.repo.publish:ERROR: return self.process_lifecycle() Sep 18 11:26:54 qe-blade-11.idmqe.lab.eng.bos.redhat.com pulp[29103]: pulp.server.managers.repo.publish:ERROR: File "/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py", line 456, in process_lifecycle Sep 18 11:26:54 qe-blade-11.idmqe.lab.eng.bos.redhat.com pulp[29103]: pulp.server.managers.repo.publish:ERROR: super(PluginStep, self).process_lifecycle() Sep 18 11:26:54 qe-blade-11.idmqe.lab.eng.bos.redhat.com pulp[29103]: pulp.server.managers.repo.publish:ERROR: File "/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py", line 121, in process_lifecycle Sep 18 11:26:54 qe-blade-11.idmqe.lab.eng.bos.redhat.com pulp[29103]: pulp.server.managers.repo.publish:ERROR: step.process() Sep 18 11:26:54 qe-blade-11.idmqe.lab.eng.bos.redhat.com pulp[29103]: pulp.server.managers.repo.publish:ERROR: File "/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py", line 179, in process Sep 18 11:26:54 qe-blade-11.idmqe.lab.eng.bos.redhat.com pulp[29103]: pulp.server.managers.repo.publish:ERROR: self._process_block() Sep 18 11:26:54 qe-blade-11.idmqe.lab.eng.bos.redhat.com pulp[29103]: pulp.server.managers.repo.publish:ERROR: File "/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py", line 214, in _process_block Sep 18 11:26:54 qe-blade-11.idmqe.lab.eng.bos.redhat.com pulp[29103]: pulp.server.managers.repo.publish:ERROR: self.process_main() Sep 18 11:26:54 qe-blade-11.idmqe.lab.eng.bos.redhat.com pulp[29103]: pulp.server.managers.repo.publish:ERROR: File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/distributors/yum/publish.py", line 879, in process_main Sep 18 11:26:54 qe-blade-11.idmqe.lab.eng.bos.redhat.com pulp[29103]: pulp.server.managers.repo.publish:ERROR: raise PulpCodedException(message=result_string) Sep 18 11:26:54 qe-blade-11.idmqe.lab.eng.bos.redhat.com pulp[29103]: pulp.server.managers.repo.publish:ERROR: PulpCodedException: A general pulp exception occurred Sep 18 11:26:54 qe-blade-11.idmqe.lab.eng.bos.redhat.com pulp[29007]: celery.worker.job:ERROR: Task pulp.server.managers.repo.publish.publish[06304c23-ce9b-4e2d-a635-11326d63bfa2] raised unexpected: PulpCodedException() Sep 18 11:26:54 qe-blade-11.idmqe.lab.eng.bos.redhat.com pulp[29007]: celery.worker.job:ERROR: Traceback (most recent call last): Sep 18 11:26:54 qe-blade-11.idmqe.lab.eng.bos.redhat.com pulp[29007]: celery.worker.job:ERROR: File "/usr/lib/python2.7/site-packages/celery/app/trace.py", line 240, in trace_task Sep 18 11:26:54 qe-blade-11.idmqe.lab.eng.bos.redhat.com pulp[29007]: celery.worker.job:ERROR: R = retval = fun(*args, **kwargs) Sep 18 11:26:54 qe-blade-11.idmqe.lab.eng.bos.redhat.com pulp[29007]: celery.worker.job:ERROR: File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line 315, in __call__ Sep 18 11:26:54 qe-blade-11.idmqe.lab.eng.bos.redhat.com pulp[29007]: celery.worker.job:ERROR: return super(Task, self).__call__(*args, **kwargs) Sep 18 11:26:54 qe-blade-11.idmqe.lab.eng.bos.redhat.com pulp[29007]: celery.worker.job:ERROR: File "/usr/lib/python2.7/site-packages/celery/app/trace.py", line 437, in __protected_call__ Sep 18 11:26:54 qe-blade-11.idmqe.lab.eng.bos.redhat.com pulp[29007]: celery.worker.job:ERROR: return self.run(*args, **kwargs) Sep 18 11:26:54 qe-blade-11.idmqe.lab.eng.bos.redhat.com pulp[29007]: celery.worker.job:ERROR: File "/usr/lib/python2.7/site-packages/pulp/server/managers/repo/publish.py", line 98, in publish Sep 18 11:26:54 qe-blade-11.idmqe.lab.eng.bos.redhat.com pulp[29007]: celery.worker.job:ERROR: transfer_repo, conduit, call_config) Sep 18 11:26:54 qe-blade-11.idmqe.lab.eng.bos.redhat.com pulp[29007]: celery.worker.job:ERROR: File "/usr/lib/python2.7/site-packages/pulp/server/managers/repo/publish.py", line 126, in _do_publish Sep 18 11:26:54 qe-blade-11.idmqe.lab.eng.bos.redhat.com pulp[29007]: celery.worker.job:ERROR: publish_report = publish_repo(transfer_repo, conduit, call_config) Sep 18 11:26:54 qe-blade-11.idmqe.lab.eng.bos.redhat.com pulp[29007]: celery.worker.job:ERROR: File "/usr/lib/python2.7/site-packages/pulp/server/async/tasks.py", line 470, in wrap_f Sep 18 11:26:54 qe-blade-11.idmqe.lab.eng.bos.redhat.com pulp[29007]: celery.worker.job:ERROR: return f(*args, **kwargs) Sep 18 11:26:54 qe-blade-11.idmqe.lab.eng.bos.redhat.com pulp[29007]: celery.worker.job:ERROR: File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/distributors/yum/distributor.py", line 143, in publish_repo Sep 18 11:26:54 qe-blade-11.idmqe.lab.eng.bos.redhat.com pulp[29007]: celery.worker.job:ERROR: return self._publisher.publish() Sep 18 11:26:54 qe-blade-11.idmqe.lab.eng.bos.redhat.com pulp[29007]: celery.worker.job:ERROR: File "/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py", line 507, in publish Sep 18 11:26:54 qe-blade-11.idmqe.lab.eng.bos.redhat.com pulp[29007]: celery.worker.job:ERROR: return self.process_lifecycle() Sep 18 11:26:54 qe-blade-11.idmqe.lab.eng.bos.redhat.com pulp[29007]: celery.worker.job:ERROR: File "/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py", line 456, in process_lifecycle Sep 18 11:26:54 qe-blade-11.idmqe.lab.eng.bos.redhat.com pulp[29007]: celery.worker.job:ERROR: super(PluginStep, self).process_lifecycle() Sep 18 11:26:54 qe-blade-11.idmqe.lab.eng.bos.redhat.com pulp[29007]: celery.worker.job:ERROR: File "/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py", line 121, in process_lifecycle Sep 18 11:26:54 qe-blade-11.idmqe.lab.eng.bos.redhat.com pulp[29007]: celery.worker.job:ERROR: step.process() Sep 18 11:26:54 qe-blade-11.idmqe.lab.eng.bos.redhat.com pulp[29007]: celery.worker.job:ERROR: File "/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py", line 179, in process Sep 18 11:26:54 qe-blade-11.idmqe.lab.eng.bos.redhat.com pulp[29007]: celery.worker.job:ERROR: self._process_block() Sep 18 11:26:54 qe-blade-11.idmqe.lab.eng.bos.redhat.com pulp[29007]: celery.worker.job:ERROR: File "/usr/lib/python2.7/site-packages/pulp/plugins/util/publish_step.py", line 214, in _process_block Sep 18 11:26:54 qe-blade-11.idmqe.lab.eng.bos.redhat.com pulp[29007]: celery.worker.job:ERROR: self.process_main() Sep 18 11:26:54 qe-blade-11.idmqe.lab.eng.bos.redhat.com pulp[29007]: celery.worker.job:ERROR: File "/usr/lib/python2.7/site-packages/pulp_rpm/plugins/distributors/yum/publish.py", line 879, in process_main Sep 18 11:26:54 qe-blade-11.idmqe.lab.eng.bos.redhat.com pulp[29007]: celery.worker.job:ERROR: raise PulpCodedException(message=result_string) Sep 18 11:26:54 qe-blade-11.idmqe.lab.eng.bos.redhat.com pulp[29007]: celery.worker.job:ERROR: PulpCodedException: A general pulp exception occurred Sep 18 11:26:54 qe-blade-11.idmqe.lab.eng.bos.redhat.com pulp[29151]: celery.worker.strategy:INFO: Received task: pulp.server.async.tasks._release_resource[9535db9a-ca5e-494e-8e5c-52dd9c0c24b5]
PR available here: https://github.com/pulp/pulp/pull/1176
Merged to 2.5-testing -> 2.5-dev -> master
build: 2.5.0-0.6.beta
verified [root@cloud-qe-15 ~]# rpm -qa pulp-server pulp-server-2.5.0-0.6.beta.el7.noarch [root@cloud-qe-15 ~]# rpm -qa pulp-selinux pulp-selinux-2.5.0-0.6.beta.el7.noarch [root@cloud-qe-15 ~]# on rhel7 [root@cloud-qe-15 ~]# pulp-admin rpm repo create --repo-id fedora --feed http://download.devel.redhat.com/released/F-19/GOLD/Fedora/x86_64/os/ --generate-sqlite true --validate true Successfully created repository [fedora] [root@cloud-qe-15 ~]# pulp-admin rpm repo sync run --repo-id fedora +----------------------------------------------------------------------+ Synchronizing Repository [fedora] +----------------------------------------------------------------------+ This command may be exited via ctrl+c without affecting the request. Downloading metadata... [|] ... completed Downloading repository content... [==================================================] 100% RPMs: 3949/3949 items Delta RPMs: 0/0 items ... completed Downloading distribution files... [==================================================] 100% Distributions: 7/7 items ... completed Importing errata... [-] ... completed Importing package groups/categories... [\] ... completed Task Succeeded Initializing repo metadata [-] ... completed Publishing Distribution files [-] ... completed Publishing RPMs [==================================================] 100% 3949 of 3949 items ... completed Publishing Delta RPMs ... skipped Publishing Errata [-] ... completed Publishing Comps file [==================================================] 100% 124 of 124 items ... completed Publishing Metadata. [-] ... completed Closing repo metadata [-] ... completed Generating sqlite files [-] ... completed Publishing files to web [-] ... completed Writing Listings File [-] ... completed Task Succeeded [root@cloud-qe-15 ~]# On rhel6 [root@mgmt4 ~]# rpm -qa pulp-server pulp-server-2.5.0-0.6.beta.el6.noarch [root@mgmt4 ~]# rpm -qa pulp-selinux pulp-selinux-2.5.0-0.6.beta.el6.noarch [root@mgmt4 ~]# [root@mgmt4 ~]# pulp-admin rpm repo create --repo-id fedora --feed http://download.devel.redhat.com/released/F-19/GOLD/Fedora/x86_64/os/ --generate-sqlite true Successfully created repository [fedora] [root@mgmt4 ~]# pulp-admin rpm repo sync run --repo-id fedora +----------------------------------------------------------------------+ Synchronizing Repository [fedora] +----------------------------------------------------------------------+ This command may be exited via ctrl+c without affecting the request. Downloading metadata... [-] ... completed Downloading repository content... [==================================================] 100% RPMs: 3949/3949 items Delta RPMs: 0/0 items ... completed Downloading distribution files... [==================================================] 100% Distributions: 7/7 items ... completed Importing errata... [-] ... completed Importing package groups/categories... [\] ... completed Task Succeeded Initializing repo metadata [-] ... completed Publishing Distribution files [-] ... completed Publishing RPMs [==================================================] 100% 3949 of 3949 items ... completed Publishing Delta RPMs ... skipped Publishing Errata [-] ... completed Publishing Comps file [==================================================] 100% 124 of 124 items ... completed Publishing Metadata. [-] ... completed Closing repo metadata [-] ... completed Generating sqlite files [/] ... completed Publishing files to web [\] ... completed Writing Listings File [-] ... completed Task Succeeded