Bug 2231397

Summary:	If manual_byte_compilation* tests fail, rpmlint_clamp_mtime* tests pass even though they shouldn't
Product:	[Fedora] Fedora	Reporter:	Karolina Surma <ksurma>
Component:	python-rpm-macros	Assignee:	Python Maintainers <python-maint>
Status:	NEW ---	QA Contact:	Fedora Extras Quality Assurance <extras-qa>
Severity:	medium	Docs Contact:
Priority:	unspecified
Version:	39	CC:	cstratak, j, maxwell, mhroncok, python-maint, python-packagers-sig
Target Milestone:	---
Target Release:	---
Hardware:	Unspecified
OS:	Linux
Whiteboard:
Fixed In Version:		Doc Type:	If docs needed, set a value
Doc Text:		Story Points:	---
Clone Of:		Environment:
Last Closed:		Type:	---
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:

Description Karolina Surma 2023-08-11 13:38:41 UTC

In https://src.fedoraproject.org/rpms/python-rpm-macros/blob/rawhide/f/tests/tests.yml

When the tests 
- manual_byte_compilation_clamp_mtime_off
- manual_byte_compilation_clamp_mtime_on
fail to produce RPMs and so are reported as failures,
I expect these tests which rely on the produced RPMs to fail as well:
- rpmlint_clamp_mtime_off
- rpmlint_clamp_mtime_on

Instead, the tests are reported by the CI as PASSes.
The test log says:
`(none): E: no installed packages by name /root/rpmbuild/RPMS/x86_64/pythontest-0-0.clamp0.x86_64.rpm` and `clamp1.` respectively

This was uncovered during test backport to CentOS 8 Stream: https://gitlab.com/redhat/centos-stream/rpms/python3.11/-/merge_requests/12
Whole test run results: https://artifacts.dev.testing-farm.io/621a4bc8-7803-4968-a451-cf520dab900a/work-tests.ymlc4u8w3sf/tests-cqwrwog8/
I suspect the behavior would be the same in Fedora's CI.


Reproducible: Always

Comment 1 Fedora Release Engineering 2023-08-16 08:14:15 UTC

This bug appears to have been reported against 'rawhide' during the Fedora Linux 39 development cycle.
Changing version to 39.