Bug 2219823

Summary: Image Builder can fail with custom repos returning sha1 checksums [RHEL8]
Product: Red Hat Enterprise Linux 8 Reporter: mkenjale
Component: osbuild-composerAssignee: Achilleas Koutsou <akoutsou>
Status: CLOSED ERRATA QA Contact: Release Test Team <release-test-team-automation>
Severity: high Docs Contact:
Priority: high    
Version: 8.8CC: atodorov, mrajasekhar, mschibli, obudai, sbarcomb, thozza
Target Milestone: rcKeywords: Triaged
Target Release: ---Flags: pm-rhel: mirror+
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: osbuild-composer-85-1.el8 Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2023-11-14 15:25:24 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description mkenjale 2023-07-05 14:37:42 UTC
Description of problem:
sha256 string is apparently prepended to sha1 checksums, leading to a "Unknown source reference(s)" error message from the osbuild-worker logs.

Version-Release number of selected component (if applicable):
osbuild-81-1.el8.noarch                                  
osbuild-composer-75-1.el8.x86_64 

How reproducible:
Always for the customer, not tested internally.

Steps to Reproduce:
Customer uses custom repos. Build works with Red Hat repos.

Actual results:
Jun 22 07:05:22 engage osbuild-worker[3678]: time="2023-06-22T07:05:22-04:00" level=info msg="Running job 'fe91b48e-4d60-4dfb-a814-3488c7311d9b' (osbuild)\n"
Jun 22 07:05:23 engage osbuild-worker[3720]: Traceback (most recent call last):
Jun 22 07:05:23 engage osbuild-worker[3720]:   File "/usr/bin/osbuild", line 11, in <module>
Jun 22 07:05:23 engage osbuild-worker[3720]:     load_entry_point('osbuild==81', 'console_scripts', 'osbuild')()
Jun 22 07:05:23 engage osbuild-worker[3720]:   File "/usr/lib/python3.6/site-packages/osbuild/main_cli.py", line 119, in osbuild_cli
Jun 22 07:05:23 engage osbuild-worker[3720]:     manifest = fmt.load(desc, index)
Jun 22 07:05:23 engage osbuild-worker[3720]:   File "/usr/lib/python3.6/site-packages/osbuild/formats/v2.py", line 369, in load
Jun 22 07:05:23 engage osbuild-worker[3720]:     load_pipeline(desc, index, manifest, source_refs)
Jun 22 07:05:23 engage osbuild-worker[3720]:   File "/usr/lib/python3.6/site-packages/osbuild/formats/v2.py", line 348, in load_pipeline
Jun 22 07:05:23 engage osbuild-worker[3720]:     load_stage(desc, index, pl, manifest, source_refs)
Jun 22 07:05:23 engage osbuild-worker[3720]:   File "/usr/lib/python3.6/site-packages/osbuild/formats/v2.py", line 317, in load_stage
Jun 22 07:05:23 engage osbuild-worker[3720]:     load_input(name, desc, index, stage, manifest, source_refs)
Jun 22 07:05:23 engage osbuild-worker[3720]:   File "/usr/lib/python3.6/site-packages/osbuild/formats/v2.py", line 273, in load_input
Jun 22 07:05:23 engage osbuild-worker[3720]:     raise ValueError(f"Unknown source reference(s) {unknown_refs}")
Jun 22 07:05:23 engage osbuild-worker[3720]: ValueError: Unknown source reference(s) {'sha256:sha1:8690e1630d166993982f2f70357f1a94b863a487', 'sha256:sha1:42affa70485aa6eff462c6bd0894f83b25380062', 'sha256:sha1:2442288093424d972f6034d27bae90da7eaf4c91', 'sha256:sha1:40778aac9da5bc14acad5f142cc5ab153e29f1c0', 'sha256:sha1:c828b451023a1adfc47b43337175509c6285a78d',

Comment 1 Ondřej Budai 2023-07-07 19:57:34 UTC
Same issue as https://bugzilla.redhat.com/show_bug.cgi?id=2215043 but tracked for RHEL 8. This will get fixed in 8.9.

Comment 14 errata-xmlrpc 2023-11-14 15:25:24 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (osbuild, osbuild-composer, and cockpit-composer bug fix and enhancement update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHEA-2023:6906