Note: This bug is displayed in read-only format because
the product is no longer active in Red Hat Bugzilla.
Red Hat Satellite engineering is moving the tracking of its product development work on Satellite to Red Hat Jira (issues.redhat.com). If you're a Red Hat customer, please continue to file support cases via the Red Hat customer portal. If you're not, please head to the "Satellite project" in Red Hat Jira and file new tickets here. Individual Bugzilla bugs will be migrated starting at the end of May. If you cannot log in to RH Jira, please consult article #7032570. That failing, please send an e-mail to the RH Jira admins at rh-issues@redhat.com to troubleshoot your issue as a user management inquiry. The email creates a ServiceNow ticket with Red Hat. Individual Bugzilla bugs that are migrated will be moved to status "CLOSED", resolution "MIGRATED", and set with "MigratedToJIRA" in "Keywords". The link to the successor Jira issue will be found under "Links", have a little "two-footprint" icon next to it, and direct you to the "Satellite project" in Red Hat Jira (issue links are of type "https://issues.redhat.com/browse/SAT-XXXX", where "X" is a digit). This same link will be available in a blue banner at the top of the page informing you that that bug has been migrated.
Description of problem:
As $summary, migration docker repos failed with:
error:
traceback: |2
File "/usr/lib/python3.6/site-packages/rq/worker.py", line 936, in perform_job
rv = job.perform()
File "/usr/lib/python3.6/site-packages/rq/job.py", line 684, in perform
self._result = self._execute()
File "/usr/lib/python3.6/site-packages/rq/job.py", line 690, in _execute
return self.func(*self.args, **self.kwargs)
File "/usr/lib/python3.6/site-packages/pulp_2to3_migration/app/tasks/migrate.py", line 81, in migrate_from_pulp2
migrate_content(plan, skip_corrupted=skip_corrupted)
File "/usr/lib/python3.6/site-packages/pulp_2to3_migration/app/migration.py", line 55, in migrate_content
plugin.migrator.migrate_content_to_pulp3(skip_corrupted=skip_corrupted)
File "/usr/lib/python3.6/site-packages/pulp_2to3_migration/app/plugin/docker/migrator.py", line 106, in migrate_content_to_pulp3
loop.run_until_complete(dm.create())
File "/usr/lib64/python3.6/asyncio/base_events.py", line 484, in run_until_complete
return future.result()
File "/usr/lib/python3.6/site-packages/pulp_2to3_migration/app/plugin/content.py", line 89, in create
await pipeline
File "/usr/lib/python3.6/site-packages/pulpcore/plugin/stages/api.py", line 225, in create_pipeline
await asyncio.gather(*futures)
File "/usr/lib/python3.6/site-packages/pulpcore/plugin/stages/api.py", line 43, in __call__
await self.run()
File "/usr/lib/python3.6/site-packages/pulp_2to3_migration/app/plugin/docker/migrator.py", line 154, in run
thru = self.relate_manifest_to_list(dc)
File "/usr/lib/python3.6/site-packages/pulp_2to3_migration/app/plugin/docker/migrator.py", line 234, in relate_manifest_to_list
thru = ManifestListManifest(manifest_list=item, image_manifest=dc.content,
description: local variable 'item' referenced before assignment
Version-Release number of selected component (if applicable):
6.9
How reproducible:
on customer site
Steps to Reproduce:
1. satellite-maintain content prepare
Actual results:
Migration failed with above error.
Expected results:
Migration should complete without error.
Additional info:
A) This seems to have been or are being addressed in upstream
migration docker repos failed with "local variable 'item' referenced before assignment" · Issue #497 · pulp/pulp-2to3-migration · GitHub
https://github.com/pulp/pulp-2to3-migration/issues/497
Fixes #497 - local variable 'item' referenced before assignment · pulp/pulp-2to3-migration@72a6325 · GitHub
https://github.com/pulp/pulp-2to3-migration/commit/72a632553cf131b5aa20f40aefb2eefdee2cff21
B) every time this traceback has come, just before that pulp complained about missing or corrupted blobs. Further investigation of those blobs revealed, That they are part of the same repo and they are indeed missing from filesystem.
I also had dig into docker manifests and found many of them corrupted as well. Not sure if they are related to the same blobs or not but there is a good possibility they are. Further information will be added in the later comments.
Hello Lai,
I doubt if I know of a sample repo but maybe Matt ( reporter ) does.
Can you check with him once if he were able to reproduce this issue via any specific repo initially ?
-- Sayan
Steps to retest:
1. Sync some docker files: small, medium, and large docker files
2. Perform migration
3. check results
2nd set of test:
1. sync some docker files: small, medium, and large docker files
2. delete some docker blobs in /var/lib/pulp/content/units/ <either docker_manifest or docker_blob>
3. perform migration
Expected results:
Migration should complete successfully
Actual:
Migration does complete successfully
I also checked the dynflow and the results on UI. It seems to work fine.
Verified on 6.9.9 snap 2
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.
For information on the advisory (Important: Satellite 6.9.9 Async Bug Fix Update), and where to find the updated
files, follow the link below.
If the solution does not work for you, open a new bug report.
https://access.redhat.com/errata/RHSA-2022:1478
Description of problem: As $summary, migration docker repos failed with: error: traceback: |2 File "/usr/lib/python3.6/site-packages/rq/worker.py", line 936, in perform_job rv = job.perform() File "/usr/lib/python3.6/site-packages/rq/job.py", line 684, in perform self._result = self._execute() File "/usr/lib/python3.6/site-packages/rq/job.py", line 690, in _execute return self.func(*self.args, **self.kwargs) File "/usr/lib/python3.6/site-packages/pulp_2to3_migration/app/tasks/migrate.py", line 81, in migrate_from_pulp2 migrate_content(plan, skip_corrupted=skip_corrupted) File "/usr/lib/python3.6/site-packages/pulp_2to3_migration/app/migration.py", line 55, in migrate_content plugin.migrator.migrate_content_to_pulp3(skip_corrupted=skip_corrupted) File "/usr/lib/python3.6/site-packages/pulp_2to3_migration/app/plugin/docker/migrator.py", line 106, in migrate_content_to_pulp3 loop.run_until_complete(dm.create()) File "/usr/lib64/python3.6/asyncio/base_events.py", line 484, in run_until_complete return future.result() File "/usr/lib/python3.6/site-packages/pulp_2to3_migration/app/plugin/content.py", line 89, in create await pipeline File "/usr/lib/python3.6/site-packages/pulpcore/plugin/stages/api.py", line 225, in create_pipeline await asyncio.gather(*futures) File "/usr/lib/python3.6/site-packages/pulpcore/plugin/stages/api.py", line 43, in __call__ await self.run() File "/usr/lib/python3.6/site-packages/pulp_2to3_migration/app/plugin/docker/migrator.py", line 154, in run thru = self.relate_manifest_to_list(dc) File "/usr/lib/python3.6/site-packages/pulp_2to3_migration/app/plugin/docker/migrator.py", line 234, in relate_manifest_to_list thru = ManifestListManifest(manifest_list=item, image_manifest=dc.content, description: local variable 'item' referenced before assignment Version-Release number of selected component (if applicable): 6.9 How reproducible: on customer site Steps to Reproduce: 1. satellite-maintain content prepare Actual results: Migration failed with above error. Expected results: Migration should complete without error. Additional info: