Bug 1918210

Summary: [network-role] Test tests_bond_initscripts.yml failed to create interface
Product: Red Hat Enterprise Linux 8 Reporter: Zhiqian Guan <zhguan>
Component: rhel-system-rolesAssignee: Wen Liang <wenliang>
Status: CLOSED ERRATA QA Contact: Zhiqian Guan <zhguan>
Severity: unspecified Docs Contact:
Priority: unspecified    
Version: 8.4CC: djez, fge, pcahyna, rmeggins, till, wenliang
Target Milestone: rcKeywords: Triaged
Target Release: 8.5   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard: role:network
Fixed In Version: rhel-system-roles-1.5.1-1.el8 Doc Type: No Doc Update
Doc Text:
Story Points: ---
Clone Of:
: 1980870 (view as bug list) Environment:
Last Closed: 2021-11-09 17:44:47 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 1980870    

Description Zhiqian Guan 2021-01-20 09:53:22 UTC
Description of problem:
The test playbook tests_bond_initscripts.yml failed the task:
rhel-system-roles.network : Configure networking connection profiles

Error msg is: "error: call 'ifup bond0' failed with exit status 1"

Detail log link: https://beaker-archive.host.prod.eng.bos.redhat.com/beaker-logs/2021/01/49970/4997086/9411618/120450241/SYSTEM-ROLE-network_tests_bond_initscripts.yml-ANSIBLE-2.8-RHEL_8_4_0_BETA.log

Version-Release number of selected component (if applicable):
Ansible 2.8/2.9 on RHEL 8.4

How reproducible:
Always

Steps to Reproduce:
1.Run the test playbook tests_bond_initscripts.yml against 8.4

Actual results:
Get failed result

Expected results:
Test pass, and interface are successfully created

Additional info:

Comment 3 Pavel Cahyna 2021-02-08 15:52:22 UTC
Most likely the problem is related to this error message:

"Determining IP information for nm-bond... failed."

Comment 5 Rich Megginson 2021-05-18 20:46:39 UTC
I have narrowed it down to two tests and a simple dev reproducer:

TEST_SUBJECTS=/path/to/centos-8.qcow2 ANSIBLE_STDOUT_CALLBACK=debug ansible-playbook -i /usr/share/ansible/inventory/standard-inventory-qcow2 \
  -vv tests_bond_deprecated_initscripts.yml tests_bond_initscripts.yml 2>&1 | tee test.log

The tests_bond_deprecated_initscripts.yml leaves the system in a "bad" state such that the tests_bond_initscripts.yml test will fail in the task

TASK [linux-system-roles.network : Configure networking connection profiles] ***

will fail with the "Determining IP information for nm-bond...failed." message in the output.

Steps:

git clone https://github.com/linux-system-roles/network
cd network/tests
curl -o centos-8.qcow2 https://cloud.centos.org/centos/8/x86_64/images/CentOS-8-GenericCloud-8.3.2011-20201204.2.x86_64.qcow2
TEST_SUBJECTS=centos-8.qcow2 ANSIBLE_STDOUT_CALLBACK=debug ansible-playbook -i /usr/share/ansible/inventory/standard-inventory-qcow2 -vv tests_bond_deprecated_initscripts.yml tests_bond_initscripts.yml 2>&1 | tee test.log

If you look in test.log you will see the output 

@fge @wenliang @till not sure what else to do here - where else should I look for clues?  journalctl?  some other log file?

This doesn't appear to be related to https://bugzilla.redhat.com/show_bug.cgi?id=1915017 - I get the same error if I save and restore /etc/resolv.conf

Comment 6 Wen Liang 2021-05-24 20:09:43 UTC
The error was raised when we called `ifup bond0`, not sure if this was related to the deprecation in `network-scripts`. And I got the similar error when I tested ethtool coalesce setting with initscripts provider, https://github.com/linux-system-roles/network/pull/386#issuecomment-827934774

Comment 7 Gris Ge 2021-07-05 13:52:24 UTC
Upstream patch merged.

Comment 10 Zhiqian Guan 2021-07-15 10:48:20 UTC
[root@netqe1 Upstream-testsuite]# rpm -q rhel-system-roles
rhel-system-roles-1.2.3-1.el8.noarch
[root@netqe1 Upstream-testsuite]#
:: [ 06:44:35 ] :: [   FAIL   ] :: Test network/tests_bond_initscripts.yml (roles/rhel-system-roles.network/tests/tests_bond_initscripts.yml) with ANSIBLE-2.8 against RHEL_8_4_0_GA (Expected 0, got 2)

Test playbook is still failing.

Will not set Verified:tested.

I uploaded the logging, please check the attachment.

Comment 24 Zhiqian Guan 2021-08-04 08:56:09 UTC
1.7.1 build pre-verify looks good.

Hi Rich, 
do you want to move this back to MODIFIED? or keep this in ON_QA?

Comment 25 Rich Megginson 2021-08-04 14:51:24 UTC
(In reply to Zhiqian Guan from comment #24)
> 1.7.1 build pre-verify looks good.
> 
> Hi Rich, 
> do you want to move this back to MODIFIED? or keep this in ON_QA?

I don't know what the procedure is - it is already attached to an errata - so is the procedure to
* remove from errata
* mark as MODIFIED
* add back to the errata
* mark as ON_QA
?

Comment 26 Gris Ge 2021-08-05 01:48:21 UTC
If 1.7.1 is added to errata build page, simply change the `fixed in version` of this bug is enough.

Comment 27 Zhiqian Guan 2021-08-05 06:18:48 UTC
Hi Rich,
When will 1.7.1 build add to the current errata? do you think we need to postpone the ITM?

Comment 28 Rich Megginson 2021-08-05 13:34:07 UTC
(In reply to Zhiqian Guan from comment #27)
> Hi Rich,
> When will 1.7.1 build add to the current errata? do you think we need to
> postpone the ITM?

There is a bit of confusion about the version numbers in the scratch builds used for pre-verify and the versions in the official build.  They are not the same.  So the same fix that you pre-verfied in the scratch build with version 1.7.1 is in the official build with version 1.5.1, which is attached to the errata.

I'm not sure how other groups do this - because system roles use semantic versioning, and because bug fixes are not merged in the same order that they are built for pre-verify, the version of the scratch build used for pre-verify does not usually match the version in the final build.

So the ITM is correct

Comment 29 Zhiqian Guan 2021-08-09 11:06:46 UTC
[root@netqe2 Upstream-testsuite]# rpm -q rhel-system-roles
rhel-system-roles-1.6.6-1.el8.noarch
[root@netqe2 Upstream-testsuite]#

CASE1, run tests_bond_initscripts.yml 10 times:
:: [ 01:36:21 ] :: [   PASS   ] :: Test network/tests_bond_initscripts.yml (roles/rhel-system-roles.network/tests/tests_bond_initscripts.yml) with ANSIBLE-2.9 against RHEL_6_10_GA (Expected 0, got 0)
:: [ 01:37:45 ] :: [   PASS   ] :: Test network/tests_bond_initscripts.yml (roles/rhel-system-roles.network/tests/tests_bond_initscripts.yml) with ANSIBLE-2.9 against RHEL_6_10_GA (Expected 0, got 0)
:: [ 01:39:01 ] :: [   PASS   ] :: Test network/tests_bond_initscripts.yml (roles/rhel-system-roles.network/tests/tests_bond_initscripts.yml) with ANSIBLE-2.9 against RHEL_6_10_GA (Expected 0, got 0)
:: [ 01:40:13 ] :: [   PASS   ] :: Test network/tests_bond_initscripts.yml (roles/rhel-system-roles.network/tests/tests_bond_initscripts.yml) with ANSIBLE-2.9 against RHEL_6_10_GA (Expected 0, got 0)
:: [ 01:41:34 ] :: [   PASS   ] :: Test network/tests_bond_initscripts.yml (roles/rhel-system-roles.network/tests/tests_bond_initscripts.yml) with ANSIBLE-2.9 against RHEL_6_10_GA (Expected 0, got 0)
:: [ 01:42:49 ] :: [   PASS   ] :: Test network/tests_bond_initscripts.yml (roles/rhel-system-roles.network/tests/tests_bond_initscripts.yml) with ANSIBLE-2.9 against RHEL_6_10_GA (Expected 0, got 0)
:: [ 01:44:06 ] :: [   PASS   ] :: Test network/tests_bond_initscripts.yml (roles/rhel-system-roles.network/tests/tests_bond_initscripts.yml) with ANSIBLE-2.9 against RHEL_6_10_GA (Expected 0, got 0)
:: [ 01:45:17 ] :: [   PASS   ] :: Test network/tests_bond_initscripts.yml (roles/rhel-system-roles.network/tests/tests_bond_initscripts.yml) with ANSIBLE-2.9 against RHEL_6_10_GA (Expected 0, got 0)
:: [ 01:46:32 ] :: [   PASS   ] :: Test network/tests_bond_initscripts.yml (roles/rhel-system-roles.network/tests/tests_bond_initscripts.yml) with ANSIBLE-2.9 against RHEL_6_10_GA (Expected 0, got 0)
:: [ 01:47:43 ] :: [   PASS   ] :: Test network/tests_bond_initscripts.yml (roles/rhel-system-roles.network/tests/tests_bond_initscripts.yml) with ANSIBLE-2.9 against RHEL_6_10_GA (Expected 0, got 0)
:: [ 02:07:57 ] :: [   PASS   ] :: Test network/tests_bond_initscripts.yml (roles/rhel-system-roles.network/tests/tests_bond_initscripts.yml) with ANSIBLE-2.9 against RHEL_7_9_GA (Expected 0, got 0)
:: [ 02:28:17 ] :: [   PASS   ] :: Test network/tests_bond_initscripts.yml (roles/rhel-system-roles.network/tests/tests_bond_initscripts.yml) with ANSIBLE-2.9 against RHEL_7_9_GA (Expected 0, got 0)
:: [ 02:48:38 ] :: [   PASS   ] :: Test network/tests_bond_initscripts.yml (roles/rhel-system-roles.network/tests/tests_bond_initscripts.yml) with ANSIBLE-2.9 against RHEL_7_9_GA (Expected 0, got 0)
:: [ 03:08:55 ] :: [   PASS   ] :: Test network/tests_bond_initscripts.yml (roles/rhel-system-roles.network/tests/tests_bond_initscripts.yml) with ANSIBLE-2.9 against RHEL_7_9_GA (Expected 0, got 0)
:: [ 03:29:09 ] :: [   PASS   ] :: Test network/tests_bond_initscripts.yml (roles/rhel-system-roles.network/tests/tests_bond_initscripts.yml) with ANSIBLE-2.9 against RHEL_7_9_GA (Expected 0, got 0)
:: [ 03:49:23 ] :: [   PASS   ] :: Test network/tests_bond_initscripts.yml (roles/rhel-system-roles.network/tests/tests_bond_initscripts.yml) with ANSIBLE-2.9 against RHEL_7_9_GA (Expected 0, got 0)
:: [ 04:09:41 ] :: [   PASS   ] :: Test network/tests_bond_initscripts.yml (roles/rhel-system-roles.network/tests/tests_bond_initscripts.yml) with ANSIBLE-2.9 against RHEL_7_9_GA (Expected 0, got 0)
:: [ 04:29:56 ] :: [   PASS   ] :: Test network/tests_bond_initscripts.yml (roles/rhel-system-roles.network/tests/tests_bond_initscripts.yml) with ANSIBLE-2.9 against RHEL_7_9_GA (Expected 0, got 0)
:: [ 04:50:13 ] :: [   PASS   ] :: Test network/tests_bond_initscripts.yml (roles/rhel-system-roles.network/tests/tests_bond_initscripts.yml) with ANSIBLE-2.9 against RHEL_7_9_GA (Expected 0, got 0)
:: [ 05:10:26 ] :: [   PASS   ] :: Test network/tests_bond_initscripts.yml (roles/rhel-system-roles.network/tests/tests_bond_initscripts.yml) with ANSIBLE-2.9 against RHEL_7_9_GA (Expected 0, got 0)
:: [ 05:12:32 ] :: [   PASS   ] :: Test network/tests_bond_initscripts.yml (roles/rhel-system-roles.network/tests/tests_bond_initscripts.yml) with ANSIBLE-2.9 against RHEL_8_4_0_GA (Expected 0, got 0)
:: [ 05:14:37 ] :: [   PASS   ] :: Test network/tests_bond_initscripts.yml (roles/rhel-system-roles.network/tests/tests_bond_initscripts.yml) with ANSIBLE-2.9 against RHEL_8_4_0_GA (Expected 0, got 0)
:: [ 05:16:43 ] :: [   PASS   ] :: Test network/tests_bond_initscripts.yml (roles/rhel-system-roles.network/tests/tests_bond_initscripts.yml) with ANSIBLE-2.9 against RHEL_8_4_0_GA (Expected 0, got 0)
:: [ 05:18:48 ] :: [   PASS   ] :: Test network/tests_bond_initscripts.yml (roles/rhel-system-roles.network/tests/tests_bond_initscripts.yml) with ANSIBLE-2.9 against RHEL_8_4_0_GA (Expected 0, got 0)
:: [ 05:20:56 ] :: [   PASS   ] :: Test network/tests_bond_initscripts.yml (roles/rhel-system-roles.network/tests/tests_bond_initscripts.yml) with ANSIBLE-2.9 against RHEL_8_4_0_GA (Expected 0, got 0)
:: [ 05:22:58 ] :: [   PASS   ] :: Test network/tests_bond_initscripts.yml (roles/rhel-system-roles.network/tests/tests_bond_initscripts.yml) with ANSIBLE-2.9 against RHEL_8_4_0_GA (Expected 0, got 0)
:: [ 05:25:07 ] :: [   PASS   ] :: Test network/tests_bond_initscripts.yml (roles/rhel-system-roles.network/tests/tests_bond_initscripts.yml) with ANSIBLE-2.9 against RHEL_8_4_0_GA (Expected 0, got 0)
:: [ 05:27:15 ] :: [   PASS   ] :: Test network/tests_bond_initscripts.yml (roles/rhel-system-roles.network/tests/tests_bond_initscripts.yml) with ANSIBLE-2.9 against RHEL_8_4_0_GA (Expected 0, got 0)
:: [ 05:29:18 ] :: [   PASS   ] :: Test network/tests_bond_initscripts.yml (roles/rhel-system-roles.network/tests/tests_bond_initscripts.yml) with ANSIBLE-2.9 against RHEL_8_4_0_GA (Expected 0, got 0)
:: [ 05:31:22 ] :: [   PASS   ] :: Test network/tests_bond_initscripts.yml (roles/rhel-system-roles.network/tests/tests_bond_initscripts.yml) with ANSIBLE-2.9 against RHEL_8_4_0_GA (Expected 0, got 0)
:: [ 05:32:47 ] :: [   PASS   ] :: Test network/tests_bond_initscripts.yml (roles/rhel-system-roles.network/tests/tests_bond_initscripts.yml) with ANSIBLE-2.9 against RHEL_8_5_0_TESTING (Expected 0, got 0)
:: [ 05:34:08 ] :: [   PASS   ] :: Test network/tests_bond_initscripts.yml (roles/rhel-system-roles.network/tests/tests_bond_initscripts.yml) with ANSIBLE-2.9 against RHEL_8_5_0_TESTING (Expected 0, got 0)
:: [ 05:35:38 ] :: [   PASS   ] :: Test network/tests_bond_initscripts.yml (roles/rhel-system-roles.network/tests/tests_bond_initscripts.yml) with ANSIBLE-2.9 against RHEL_8_5_0_TESTING (Expected 0, got 0)
:: [ 05:36:58 ] :: [   PASS   ] :: Test network/tests_bond_initscripts.yml (roles/rhel-system-roles.network/tests/tests_bond_initscripts.yml) with ANSIBLE-2.9 against RHEL_8_5_0_TESTING (Expected 0, got 0)
:: [ 05:38:19 ] :: [   PASS   ] :: Test network/tests_bond_initscripts.yml (roles/rhel-system-roles.network/tests/tests_bond_initscripts.yml) with ANSIBLE-2.9 against RHEL_8_5_0_TESTING (Expected 0, got 0)
:: [ 05:39:41 ] :: [   PASS   ] :: Test network/tests_bond_initscripts.yml (roles/rhel-system-roles.network/tests/tests_bond_initscripts.yml) with ANSIBLE-2.9 against RHEL_8_5_0_TESTING (Expected 0, got 0)
:: [ 05:41:03 ] :: [   PASS   ] :: Test network/tests_bond_initscripts.yml (roles/rhel-system-roles.network/tests/tests_bond_initscripts.yml) with ANSIBLE-2.9 against RHEL_8_5_0_TESTING (Expected 0, got 0)
:: [ 05:42:28 ] :: [   PASS   ] :: Test network/tests_bond_initscripts.yml (roles/rhel-system-roles.network/tests/tests_bond_initscripts.yml) with ANSIBLE-2.9 against RHEL_8_5_0_TESTING (Expected 0, got 0)
:: [ 05:43:51 ] :: [   PASS   ] :: Test network/tests_bond_initscripts.yml (roles/rhel-system-roles.network/tests/tests_bond_initscripts.yml) with ANSIBLE-2.9 against RHEL_8_5_0_TESTING (Expected 0, got 0)
:: [ 05:45:17 ] :: [   PASS   ] :: Test network/tests_bond_initscripts.yml (roles/rhel-system-roles.network/tests/tests_bond_initscripts.yml) with ANSIBLE-2.9 against RHEL_8_5_0_TESTING (Expected 0, got 0)
:: [ 05:45:53 ] :: [   PASS   ] :: Test network/tests_bond_initscripts.yml (roles/rhel-system-roles.network/tests/tests_bond_initscripts.yml) with ANSIBLE-2.9 against RHEL_9_TESTING (Expected 0, got 0)
:: [ 05:46:29 ] :: [   PASS   ] :: Test network/tests_bond_initscripts.yml (roles/rhel-system-roles.network/tests/tests_bond_initscripts.yml) with ANSIBLE-2.9 against RHEL_9_TESTING (Expected 0, got 0)
:: [ 05:47:05 ] :: [   PASS   ] :: Test network/tests_bond_initscripts.yml (roles/rhel-system-roles.network/tests/tests_bond_initscripts.yml) with ANSIBLE-2.9 against RHEL_9_TESTING (Expected 0, got 0)
:: [ 05:47:40 ] :: [   PASS   ] :: Test network/tests_bond_initscripts.yml (roles/rhel-system-roles.network/tests/tests_bond_initscripts.yml) with ANSIBLE-2.9 against RHEL_9_TESTING (Expected 0, got 0)
:: [ 05:48:17 ] :: [   PASS   ] :: Test network/tests_bond_initscripts.yml (roles/rhel-system-roles.network/tests/tests_bond_initscripts.yml) with ANSIBLE-2.9 against RHEL_9_TESTING (Expected 0, got 0)
:: [ 05:48:52 ] :: [   PASS   ] :: Test network/tests_bond_initscripts.yml (roles/rhel-system-roles.network/tests/tests_bond_initscripts.yml) with ANSIBLE-2.9 against RHEL_9_TESTING (Expected 0, got 0)
:: [ 05:49:28 ] :: [   PASS   ] :: Test network/tests_bond_initscripts.yml (roles/rhel-system-roles.network/tests/tests_bond_initscripts.yml) with ANSIBLE-2.9 against RHEL_9_TESTING (Expected 0, got 0)
:: [ 05:50:03 ] :: [   PASS   ] :: Test network/tests_bond_initscripts.yml (roles/rhel-system-roles.network/tests/tests_bond_initscripts.yml) with ANSIBLE-2.9 against RHEL_9_TESTING (Expected 0, got 0)
:: [ 05:50:40 ] :: [   PASS   ] :: Test network/tests_bond_initscripts.yml (roles/rhel-system-roles.network/tests/tests_bond_initscripts.yml) with ANSIBLE-2.9 against RHEL_9_TESTING (Expected 0, got 0)
:: [ 05:51:16 ] :: [   PASS   ] :: Test network/tests_bond_initscripts.yml (roles/rhel-system-roles.network/tests/tests_bond_initscripts.yml) with ANSIBLE-2.9 against RHEL_9_TESTING (Expected 0, got 0)

CASE2, run tests_bond_deprecated_initscripts.yml and tests_bond_initscripts.yml at the same time:
:: [ 05:56:44 ] :: [   PASS   ] :: Test network/tests_bond_deprecated_initscripts.yml (roles/rhel-system-roles.network/tests/tests_bond_deprecated_initscripts.yml) with ANSIBLE-2.9 against RHEL_6_10_GA (Expected 0, got 0)
:: [ 05:57:39 ] :: [   PASS   ] :: Test network/tests_bond_initscripts.yml (roles/rhel-system-roles.network/tests/tests_bond_initscripts.yml) with ANSIBLE-2.9 against RHEL_6_10_GA (Expected 0, got 0)
:: [ 06:09:23 ] :: [   PASS   ] :: Test network/tests_bond_deprecated_initscripts.yml (roles/rhel-system-roles.network/tests/tests_bond_deprecated_initscripts.yml) with ANSIBLE-2.9 against RHEL_7_9_GA (Expected 0, got 0)
:: [ 06:29:14 ] :: [   PASS   ] :: Test network/tests_bond_initscripts.yml (roles/rhel-system-roles.network/tests/tests_bond_initscripts.yml) with ANSIBLE-2.9 against RHEL_7_9_GA (Expected 0, got 0)
:: [ 06:31:18 ] :: [   PASS   ] :: Test network/tests_bond_deprecated_initscripts.yml (roles/rhel-system-roles.network/tests/tests_bond_deprecated_initscripts.yml) with ANSIBLE-2.9 against RHEL_8_4_0_GA (Expected 0, got 0)
:: [ 06:32:58 ] :: [   PASS   ] :: Test network/tests_bond_initscripts.yml (roles/rhel-system-roles.network/tests/tests_bond_initscripts.yml) with ANSIBLE-2.9 against RHEL_8_4_0_GA (Expected 0, got 0)
:: [ 06:34:24 ] :: [   PASS   ] :: Test network/tests_bond_deprecated_initscripts.yml (roles/rhel-system-roles.network/tests/tests_bond_deprecated_initscripts.yml) with ANSIBLE-2.9 against RHEL_8_5_0_TESTING (Expected 0, got 0)
:: [ 06:35:21 ] :: [   PASS   ] :: Test network/tests_bond_initscripts.yml (roles/rhel-system-roles.network/tests/tests_bond_initscripts.yml) with ANSIBLE-2.9 against RHEL_8_5_0_TESTING (Expected 0, got 0)
:: [ 06:35:56 ] :: [   PASS   ] :: Test network/tests_bond_deprecated_initscripts.yml (roles/rhel-system-roles.network/tests/tests_bond_deprecated_initscripts.yml) with ANSIBLE-2.9 against RHEL_9_TESTING (Expected 0, got 0)
:: [ 06:36:12 ] :: [   PASS   ] :: Test network/tests_bond_initscripts.yml (roles/rhel-system-roles.network/tests/tests_bond_initscripts.yml) with ANSIBLE-2.9 against RHEL_9_TESTING (Expected 0, got 0)

Comment 30 Zhiqian Guan 2021-08-09 11:07:53 UTC
Based on Comment29, set this bz to VERIFIED

Comment 32 errata-xmlrpc 2021-11-09 17:44:47 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (rhel-system-roles bug fix and enhancement update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2021:4159