Bug 2382962

Summary: llvm-test-suite: STI tests will no longer be run in F43
Product: [Fedora] Fedora Reporter: Cristian Le <fedora>
Component: llvm-test-suiteAssignee: Tulio Magno Quites Machado Filho <tuliom>
Status: CLOSED RAWHIDE QA Contact: Fedora Extras Quality Assurance <extras-qa>
Severity: unspecified Docs Contact:
Priority: unspecified    
Version: rawhideCC: fedora-llvm-team, npopov, sergesanspaille, tstellar, tuliom
Target Milestone: ---   
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: ---
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2025-08-07 15:44:07 UTC Type: ---
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 2346261    

Description Cristian Le 2025-07-23 13:48:12 UTC
Dear package maintainer,

This is an automated bug created due to the announced change proposal Disablement of STI tests.

Your project still has STI tests under `tests/tests*.yml`, which will no longer be run soon. We suggest you
migrate these tests to TMT format instead.

In the simplest case when the STI tests is a simple wrapper around a `tests/run_tests.sh`, the migration would
look like this:
```
$ tmt init
$ rm tests/tests.yml
$ cat <<EOF > ./plans.fmf
summary: Run all smoke tests
discover:
  how: fmf
execute:
  how: tmt
EOF
$ cat <<EOF > ./tests/main.fmf
summary: Smoke test
test: ./run_tests.sh
EOF
```

See https://fedoraproject.org/wiki/Changes/DisableSTI for more information, including a link to a migration
guide.

Feel free to reach out to us here or in #fedora-ci or #tmt matrix rooms if you need any help.

Comment 1 Tulio Magno Quites Machado Filho 2025-08-04 17:08:52 UTC
> Your project still has STI tests under `tests/tests*.yml`, which will no longer be run soon. We suggest you migrate these tests to TMT format instead.

AFAICS, all our tests are already following the TMT/FMF format. I do not see any files matching this glob here: https://src.fedoraproject.org/rpms/llvm/blob/rawhide/f/tests

@fedora , any chance this bug report was created by mistake?
Or should I be looking at a different place?

Comment 2 Tulio Magno Quites Machado Filho 2025-08-04 17:10:29 UTC
Sorry, after submitting my previous comment I realized this was reported against llvm-test-suite.

Comment 3 Tulio Magno Quites Machado Filho 2025-08-06 20:52:59 UTC
I proposed a patch fixing this here: https://src.fedoraproject.org/rpms/llvm-test-suite/pull-request/55