Description of problem: In https://bodhi.fedoraproject.org/updates/FEDORA-2023-b5fb7bba8c, the exit code apparently differs from what the tests are expecting, causing the CI gating tests to fail: Version-Release number of selected component (if applicable): frr-8.5.2-4.fc39 How reproducible: Steps to Reproduce: 1. Create a Bodhi update containing frr. Actual results: :: [ 02:33:42 ] :: [ BEGIN ] :: Insufficient rights, restarting service under nonprivileged user must fail :: actually running 'su testuserqa -c 'systemctl restart frr'' Failed to restart frr.service: Access denied See system logs and 'systemctl status frr.service' for details. :: [ 02:33:42 ] :: [ FAIL ] :: Insufficient rights, restarting service under nonprivileged user must fail (Expected 1, got 4) Expected results: Tests pass. Additional info: I am inclined to waive the failing test, as the details look harmless and unrelated to the abseil-cpp update, but I am waiting to see what happens in F40/Rawhide (https://bodhi.fedoraproject.org/updates/FEDORA-2023-48a12fa02e). I think this test timed out the first time in F40, but there were so many OpenQA failures (again, I think unrelated to the update) that I have re-triggered the tests.
(In reply to Ben Beasley from comment #0) > I am inclined to waive the failing test, as the details look harmless and > unrelated to the abseil-cpp update, but I am waiting to see what happens in > F40/Rawhide > (https://bodhi.fedoraproject.org/updates/FEDORA-2023-48a12fa02e). I think > this test timed out the first time in F40, but there were so many OpenQA > failures (again, I think unrelated to the update) that I have re-triggered > the tests. Follow-up: the test failed in F40 the same way it did in F39. I’m waiving the test in F39 and referencing this bug report; if the OpenQA tests pass in F40, I’ll do the same there. Let me know if there is anything else I should do.
Waived in F40/Rawhide too.
Hi Ben, sorry about that, I would have answered sooner but I was out for a couple of days. You did good to waive these, I need to fix them asap. Regards, Michal
No more failures of this kind in the latest FRR in Rawhide nor in F38 and F39. I am closing this now, make sure to re-open should the problem appear again.