1) Set up a custom repo with the following details Type -> Docker Registry Url -> https://registry.hub.docker.com Upstream Name -> busybox 2) Try to sync that repo. Expected: Repo syncing with the upstream repo Actual: Fails with the following trace Apr 30 10:50:27 sat-perf-04 pulp: celery.worker.strategy:INFO: Received task: pulp.server.async.tasks._queue_reserved_task[393abf83-3e70-4073-8660-6ead272fd765] Apr 30 10:50:27 sat-perf-04 pulp: celery.worker.strategy:INFO: Received task: pulp.server.managers.repo.sync.sync[f51df3da-2690-4632-b48e-d8c8cb3f6c38] Apr 30 10:50:27 sat-perf-04 pulp: celery.worker.strategy:INFO: Received task: pulp.server.async.tasks._release_resource[c9d9a918-7460-4da3-afff-95a18b54e4b9] Apr 30 10:50:27 sat-perf-04 pulp: requests.packages.urllib3.connectionpool:INFO: Starting new HTTP connection (1): registry.hub.docker.com Apr 30 10:50:27 sat-perf-04 pulp: celery.worker.job:INFO: Task pulp.server.async.tasks._queue_reserved_task[393abf83-3e70-4073-8660-6ead272fd765] succeeded in 0.0348546532914s: None Apr 30 10:50:27 sat-perf-04 pulp: requests.packages.urllib3.connectionpool:INFO: Starting new HTTP connection (1): registry.hub.docker.com Apr 30 10:50:27 sat-perf-04 pulp: requests.packages.urllib3.connectionpool:INFO: Starting new HTTP connection (1): registry-1.docker.io Apr 30 10:50:27 sat-perf-04 pulp: requests.packages.urllib3.connectionpool:INFO: Starting new HTTP connection (1): registry-1.docker.io Apr 30 10:50:27 sat-perf-04 pulp: requests.packages.urllib3.connectionpool:INFO: Starting new HTTP connection (1): registry-1.docker.io Apr 30 10:50:27 sat-perf-04 pulp: requests.packages.urllib3.connectionpool:INFO: Starting new HTTP connection (1): registry-1.docker.io Apr 30 10:50:27 sat-perf-04 pulp: requests.packages.urllib3.connectionpool:INFO: Starting new HTTP connection (1): registry-1.docker.io Apr 30 10:50:28 sat-perf-04 pulp: pulp.server.managers.repo.sync:ERROR: (12312-85888) Exception caught from plugin during sync for repo [new-demo-docker-repos-busybox] Apr 30 10:50:28 sat-perf-04 pulp: pulp.server.managers.repo.sync:ERROR: (12312-85888) Traceback (most recent call last): Apr 30 10:50:28 sat-perf-04 pulp: pulp.server.managers.repo.sync:ERROR: (12312-85888) File "/usr/lib/python2.6/site-packages/pulp/server/managers/repo/sync.py", line 164, in _do_sync Apr 30 10:50:28 sat-perf-04 pulp: pulp.server.managers.repo.sync:ERROR: (12312-85888) sync_report = sync_repo(transfer_repo, conduit, call_config) Apr 30 10:50:28 sat-perf-04 pulp: pulp.server.managers.repo.sync:ERROR: (12312-85888) File "/usr/lib/python2.6/site-packages/pulp/server/async/tasks.py", line 483, in wrap_f Apr 30 10:50:28 sat-perf-04 pulp: pulp.server.managers.repo.sync:ERROR: (12312-85888) return f(*args, **kwargs) Apr 30 10:50:28 sat-perf-04 pulp: pulp.server.managers.repo.sync:ERROR: (12312-85888) File "/usr/lib/python2.6/site-packages/pulp_docker/plugins/importers/importer.py", line 85, in sync_repo Apr 30 10:50:28 sat-perf-04 pulp: pulp.server.managers.repo.sync:ERROR: (12312-85888) return self.sync_step.sync() Apr 30 10:50:28 sat-perf-04 pulp: pulp.server.managers.repo.sync:ERROR: (12312-85888) File "/usr/lib/python2.6/site-packages/pulp_docker/plugins/importers/sync.py", line 99, in sync Apr 30 10:50:28 sat-perf-04 pulp: pulp.server.managers.repo.sync:ERROR: (12312-85888) self.process_lifecycle() Apr 30 10:50:28 sat-perf-04 pulp: pulp.server.managers.repo.sync:ERROR: (12312-85888) File "/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", line 503, in process_lifecycle Apr 30 10:50:28 sat-perf-04 pulp: pulp.server.managers.repo.sync:ERROR: (12312-85888) super(PluginStep, self).process_lifecycle() Apr 30 10:50:28 sat-perf-04 pulp: pulp.server.managers.repo.sync:ERROR: (12312-85888) File "/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", line 127, in process_lifecycle Apr 30 10:50:28 sat-perf-04 pulp: pulp.server.managers.repo.sync:ERROR: (12312-85888) step.process() Apr 30 10:50:28 sat-perf-04 pulp: pulp.server.managers.repo.sync:ERROR: (12312-85888) File "/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", line 204, in process Apr 30 10:50:28 sat-perf-04 pulp: pulp.server.managers.repo.sync:ERROR: (12312-85888) self._process_block() Apr 30 10:50:28 sat-perf-04 pulp: pulp.server.managers.repo.sync:ERROR: (12312-85888) File "/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", line 246, in _process_block Apr 30 10:50:28 sat-perf-04 pulp: pulp.server.managers.repo.sync:ERROR: (12312-85888) self.process_main() Apr 30 10:50:28 sat-perf-04 pulp: pulp.server.managers.repo.sync:ERROR: (12312-85888) File "/usr/lib/python2.6/site-packages/pulp_docker/plugins/importers/sync.py", line 142, in process_main Apr 30 10:50:28 sat-perf-04 pulp: pulp.server.managers.repo.sync:ERROR: (12312-85888) self.parent.index_repository.get_ancestry(tagged_image_ids) Apr 30 10:50:28 sat-perf-04 pulp: pulp.server.managers.repo.sync:ERROR: (12312-85888) File "/usr/lib/python2.6/site-packages/pulp_docker/plugins/registry.py", line 155, in get_ancestry Apr 30 10:50:28 sat-perf-04 pulp: pulp.server.managers.repo.sync:ERROR: (12312-85888) raise IOError(self.listener.failed_reports[0].error_msg) Apr 30 10:50:28 sat-perf-04 pulp: pulp.server.managers.repo.sync:ERROR: (12312-85888) IOError: NOT FOUND Apr 30 10:50:28 sat-perf-04 pulp: celery.worker.job:ERROR: (12136-85888) Task pulp.server.managers.repo.sync.sync[f51df3da-2690-4632-b48e-d8c8cb3f6c38] raised unexpected: IOError('NOT FOUND',) Apr 30 10:50:28 sat-perf-04 pulp: celery.worker.job:ERROR: (12136-85888) Traceback (most recent call last): Apr 30 10:50:28 sat-perf-04 pulp: celery.worker.job:ERROR: (12136-85888) File "/usr/lib/python2.6/site-packages/celery/app/trace.py", line 240, in trace_task Apr 30 10:50:28 sat-perf-04 pulp: celery.worker.job:ERROR: (12136-85888) R = retval = fun(*args, **kwargs) Apr 30 10:50:28 sat-perf-04 pulp: celery.worker.job:ERROR: (12136-85888) File "/usr/lib/python2.6/site-packages/pulp/server/async/tasks.py", line 328, in __call__ Apr 30 10:50:28 sat-perf-04 pulp: celery.worker.job:ERROR: (12136-85888) return super(Task, self).__call__(*args, **kwargs) Apr 30 10:50:28 sat-perf-04 pulp: celery.worker.job:ERROR: (12136-85888) File "/usr/lib/python2.6/site-packages/celery/app/trace.py", line 437, in __protected_call__ Apr 30 10:50:28 sat-perf-04 pulp: celery.worker.job:ERROR: (12136-85888) return self.run(*args, **kwargs) Apr 30 10:50:28 sat-perf-04 pulp: celery.worker.job:ERROR: (12136-85888) File "/usr/lib/python2.6/site-packages/pulp/server/managers/repo/sync.py", line 110, in sync Apr 30 10:50:28 sat-perf-04 pulp: celery.worker.job:ERROR: (12136-85888) call_config) Apr 30 10:50:28 sat-perf-04 pulp: celery.worker.job:ERROR: (12136-85888) File "/usr/lib/python2.6/site-packages/pulp/server/managers/repo/sync.py", line 164, in _do_sync Apr 30 10:50:28 sat-perf-04 pulp: celery.worker.job:ERROR: (12136-85888) sync_report = sync_repo(transfer_repo, conduit, call_config) Apr 30 10:50:28 sat-perf-04 pulp: celery.worker.job:ERROR: (12136-85888) File "/usr/lib/python2.6/site-packages/pulp/server/async/tasks.py", line 483, in wrap_f Apr 30 10:50:28 sat-perf-04 pulp: celery.worker.job:ERROR: (12136-85888) return f(*args, **kwargs) Apr 30 10:50:28 sat-perf-04 pulp: celery.worker.job:ERROR: (12136-85888) File "/usr/lib/python2.6/site-packages/pulp_docker/plugins/importers/importer.py", line 85, in sync_repo Apr 30 10:50:28 sat-perf-04 pulp: celery.worker.job:ERROR: (12136-85888) return self.sync_step.sync() Apr 30 10:50:28 sat-perf-04 pulp: celery.worker.job:ERROR: (12136-85888) File "/usr/lib/python2.6/site-packages/pulp_docker/plugins/importers/sync.py", line 99, in sync Apr 30 10:50:28 sat-perf-04 pulp: celery.worker.job:ERROR: (12136-85888) self.process_lifecycle() Apr 30 10:50:28 sat-perf-04 pulp: celery.worker.job:ERROR: (12136-85888) File "/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", line 503, in process_lifecycle Apr 30 10:50:28 sat-perf-04 pulp: celery.worker.job:ERROR: (12136-85888) super(PluginStep, self).process_lifecycle() Apr 30 10:50:28 sat-perf-04 pulp: celery.worker.job:ERROR: (12136-85888) File "/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", line 127, in process_lifecycle Apr 30 10:50:28 sat-perf-04 pulp: celery.worker.job:ERROR: (12136-85888) step.process() Apr 30 10:50:28 sat-perf-04 pulp: celery.worker.job:ERROR: (12136-85888) File "/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", line 204, in process Apr 30 10:50:28 sat-perf-04 pulp: celery.worker.job:ERROR: (12136-85888) self._process_block() Apr 30 10:50:28 sat-perf-04 pulp: celery.worker.job:ERROR: (12136-85888) File "/usr/lib/python2.6/site-packages/pulp/plugins/util/publish_step.py", line 246, in _process_block Apr 30 10:50:28 sat-perf-04 pulp: celery.worker.job:ERROR: (12136-85888) self.process_main() Apr 30 10:50:28 sat-perf-04 pulp: celery.worker.job:ERROR: (12136-85888) File "/usr/lib/python2.6/site-packages/pulp_docker/plugins/importers/sync.py", line 142, in process_main Apr 30 10:50:28 sat-perf-04 pulp: celery.worker.job:ERROR: (12136-85888) self.parent.index_repository.get_ancestry(tagged_image_ids) Apr 30 10:50:28 sat-perf-04 pulp: celery.worker.job:ERROR: (12136-85888) File "/usr/lib/python2.6/site-packages/pulp_docker/plugins/registry.py", line 155, in get_ancestry Apr 30 10:50:28 sat-perf-04 pulp: celery.worker.job:ERROR: (12136-85888) raise IOError(self.listener.failed_reports[0].error_msg) Apr 30 10:50:28 sat-perf-04 pulp: celery.worker.job:ERROR: (12136-85888) IOError: NOT FOUND Apr 30 10:50:28 sat-perf-04 pulp: celery.worker.job:INFO: Task pulp.server.async.tasks._release_resource[c9d9a918-7460-4da3-afff-95a18b54e4b9] succeeded in 0.00729730492458s: None Apr 30 10:50:31 sat-perf-04 pulp: celery.worker.strategy:INFO: Received task: pulp.server.async.tasks._queue_reserved_task[337f083a-d6a2-4ad4-8089-5708a071c7b6] Apr 30 10:50:31 sat-perf-04 pulp: celery.worker.strategy:INFO: Received task: pulp.server.managers.consumer.applicability.regenerate_applicability_for_repos[7a012076-2a5c-426a-a5b7-10ce9671ab44] Apr 30 10:50:31 sat-perf-04 pulp: celery.worker.strategy:INFO: Received task: pulp.server.async.tasks._release_resource[222126f8-2d88-4219-b7a3-352ccfad3379] Apr 30 10:50:31 sat-perf-04 pulp: celery.worker.job:INFO: Task pulp.server.async.tasks._queue_reserved_task[337f083a-d6a2-4ad4-8089-5708a071c7b6] succeeded in 0.0360281718895s: None Apr 30 10:50:31 sat-perf-04 pulp: celery.worker.job:INFO: Task pulp.server.managers.consumer.applicability.regenerate_applicability_for_repos[7a012076-2a5c-426a-a5b7-10ce9671ab44] succeeded in 0.0439289999194s: None Apr 30 10:50:31 sat-perf-04 pulp: celery.worker.job:INFO: Task pulp.server.async.tasks._release_resource[222126f8-2d88-4219-b7a3-352ccfad3379] succeeded in 0.0075990492478s: None
Being tracked on -> https://pulp.plan.io/issues/914
[sat6] name=Satellite 6 baseurl=http://satellite6.lab.eng.rdu2.redhat.com/devel/candidate-trees/Satellite/Satellite-6.1.0-RHEL-7-20150429.2/compose/Satellite/x86_64/os/ enabled=1 gpgcheck=0
The Pulp upstream bug status is at ASSIGNED. Updating the external tracker on this bug.
The Pulp upstream bug priority is at High. Updating the external tracker on this bug.
The Pulp upstream bug status is at POST. Updating the external tracker on this bug.
The Pulp upstream bug status is at MODIFIED. Updating the external tracker on this bug.
commit 81882b375c7adc69f25beac6da45c8301dc72b12 Author: Michael Hrivnak <mhrivnak> Date: Fri May 1 10:44:40 2015 -0400 The API for fetching tags from a remote registry or index changed. This uses the new API. closes #914 (cherry picked from commit 8081b301305a7f12fb412fd5819e46dff239dce5)
Failed QA in Sat 6.1 Snap 3 during repository sync RuntimeError: A sub task failed /opt/rh/ruby193/root/usr/share/gems/gems/foreman-tasks-0.6.12.4/app/lib/actions/bulk_action.rb:162:in `check_for_errors!' /opt/rh/ruby193/root/usr/share/gems/gems/foreman-tasks-0.6.12.4/app/lib/actions/bulk_action.rb:58:in `run' /opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/action.rb:443:in `block (3 levels) in execute_run' /opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/middleware/stack.rb:26:in `call' /opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/middleware/stack.rb:26:in `pass' /opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/middleware.rb:16:in `pass' /opt/rh/ruby193/root/usr/share/gems/gems/foreman-tasks-0.6.12.4/app/lib/actions/middleware/keep_current_user.rb:23:in `block in run' /opt/rh/ruby193/root/usr/share/gems/gems/foreman-tasks-0.6.12.4/app/lib/actions/middleware/keep_current_user.rb:34:in `restore_curent_user' /opt/rh/ruby193/root/usr/share/gems/gems/foreman-tasks-0.6.12.4/app/lib/actions/middleware/keep_current_user.rb:23:in `run' /opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/middleware/stack.rb:22:in `call' /opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/middleware/stack.rb:26:in `pass' /opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/middleware.rb:16:in `pass' /opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/action/progress.rb:30:in `with_progress_calculation' /opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/action/progress.rb:16:in `run' /opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/middleware/stack.rb:22:in `call' /opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/middleware/stack.rb:26:in `pass' /opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/middleware.rb:16:in `pass' /opt/rh/ruby193/root/usr/share/gems/gems/katello-2.2.0.38/app/lib/actions/middleware/keep_locale.rb:23:in `block in run' /opt/rh/ruby193/root/usr/share/gems/gems/katello-2.2.0.38/app/lib/actions/middleware/keep_locale.rb:34:in `with_locale' /opt/rh/ruby193/root/usr/share/gems/gems/katello-2.2.0.38/app/lib/actions/middleware/keep_locale.rb:23:in `run' /opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/middleware/stack.rb:22:in `call' /opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/middleware/world.rb:30:in `execute' /opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/action.rb:442:in `block (2 levels) in execute_run' /opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/action.rb:441:in `catch' /opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/action.rb:441:in `block in execute_run' /opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/action.rb:365:in `call' /opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/action.rb:365:in `block in with_error_handling' /opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/action.rb:365:in `catch' /opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/action.rb:365:in `with_error_handling' /opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/action.rb:436:in `execute_run' /opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/action.rb:230:in `execute' /opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:9:in `block (2 levels) in execute' /opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/execution_plan/steps/abstract.rb:152:in `call' /opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/execution_plan/steps/abstract.rb:152:in `with_meta_calculation' /opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:8:in `block in execute' /opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:22:in `open_action' /opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/execution_plan/steps/abstract_flow_step.rb:7:in `execute' /opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/executors/parallel/worker.rb:20:in `block in on_message' /opt/rh/ruby193/root/usr/share/gems/gems/algebrick-0.4.0/lib/algebrick.rb:859:in `block in assigns' /opt/rh/ruby193/root/usr/share/gems/gems/algebrick-0.4.0/lib/algebrick.rb:858:in `tap' /opt/rh/ruby193/root/usr/share/gems/gems/algebrick-0.4.0/lib/algebrick.rb:858:in `assigns' /opt/rh/ruby193/root/usr/share/gems/gems/algebrick-0.4.0/lib/algebrick.rb:138:in `match_value' /opt/rh/ruby193/root/usr/share/gems/gems/algebrick-0.4.0/lib/algebrick.rb:116:in `block in match' /opt/rh/ruby193/root/usr/share/gems/gems/algebrick-0.4.0/lib/algebrick.rb:115:in `each' /opt/rh/ruby193/root/usr/share/gems/gems/algebrick-0.4.0/lib/algebrick.rb:115:in `match' /opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/executors/parallel/worker.rb:17:in `on_message' /opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/micro_actor.rb:82:in `on_envelope' /opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/micro_actor.rb:72:in `receive' /opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/micro_actor.rb:99:in `block (2 levels) in run' /opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/micro_actor.rb:99:in `loop' /opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/micro_actor.rb:99:in `block in run' /opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/micro_actor.rb:99:in `catch' /opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/micro_actor.rb:99:in `run' /opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/micro_actor.rb:13:in `block in initialize' /opt/rh/ruby193/root/usr/share/gems/gems/logging-1.8.1/lib/logging/diagnostic_context.rb:323:in `call' /opt/rh/ruby193/root/usr/share/gems/gems/logging-1.8.1/lib/logging/diagnostic_context.rb:323:in `block in create_with_logging_context'
*** Bug 1167837 has been marked as a duplicate of this bug. ***
Verified on: Satellite-6.1.0-RHEL-7-20150513.0 Steps to verify: 1) Created a custom docker product 2) Created busybox, centos and fedora docker repos for the product created on 1. 3) Synced all of the repositories one at a time 4) Create two more repos mongo and wordpress and synced both at the same time 5) All syncs completed without any issue
The Pulp upstream bug status is at ON_QA. Updating the external tracker on this bug.
The Pulp upstream bug status is at VERIFIED. Updating the external tracker on this bug.
This bug is slated to be released with Satellite 6.1.
This bug was fixed in version 6.1.1 of Satellite which was released on 12 August, 2015.
The Pulp upstream bug status is at CLOSED - CURRENTRELEASE. Updating the external tracker on this bug.