Bug 2129620

Summary:	Support looking up named route table in routing rule
Product:	Red Hat Enterprise Linux 8	Reporter:	Wen Liang <wenliang>
Component:	rhel-system-roles	Assignee:	Rich Megginson <rmeggins>
Status:	CLOSED ERRATA	QA Contact:	Jon Trossbach <jtrossba>
Severity:	unspecified	Docs Contact:	Mayur Patil <maypatil>
Priority:	unspecified
Version:	8.8	CC:	djez, jtrossba, maypatil, nm-team, rmeggins, spetrosi, till
Target Milestone:	rc	Keywords:	Triaged
Target Release:	---	Flags:	pm-rhel: mirror+
Hardware:	Unspecified
OS:	Unspecified
Whiteboard:	role:network
Fixed In Version:	rhel-system-roles-1.21.0-0.2.network.el8	Doc Type:	Enhancement
Doc Text:	.Routing rule is able to look up a route table by its name With this update, the `rhel-system-roles.network` RHEL System Role supports looking up a route table by its name when you define a routing rule. This feature provides quick navigation for complex network configurations where you need to have different routing rules for different network segments.	Story Points:	---
Clone Of:
Clones:	2131293 (view as bug list)		Environment:
Last Closed:	2023-05-16 08:31:12 UTC	Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:
Bug Depends On:
Bug Blocks:	2131293

Description Wen Liang 2022-09-25 14:46:38 UTC

Description of problem:


Per discussion in this issue, https://github.com/linux-system-roles/network/issues/506.Currently, the network role only supports adding the 
static routes to the named route table but not supporting looking up the named
route table in routing rule.


Expected results:

The user can define the named route table in the routing rule.

Comment 3 Jon Trossbach 2022-12-08 23:10:51 UTC

Please confirm this was meant to be run against tests_route_table_nm.yml

[root@netqe16 Upstream-testsuite]# rpm -q rhel-system-roles
rhel-system-roles-1.21.0-0.9.el8.noarch

Ansible 2.9:
:: [ 16:55:47 ] :: [   PASS   ] :: Test network with ANSIBLE-2.9 against RHEL_6_10_GA (Expected 0, got 0)
:: [ 16:55:47 ] :: [   LOG    ] :: Beakerlib env exported
:: [ 16:55:47 ] :: [   INFO   ] :: Sending SYSTEM-ROLE-network_tests_route_table_nm.yml-legacy-ANSIBLE-2.9-RHEL_6_10_GA.log as SYSTEM-ROLE-network_tests_route_table_nm.yml-legacy-ANSIBLE-2.9-RHEL_6_10_GA.log
:: [ 16:55:47 ] :: [   LOG    ] :: File '/tmp/tmp.7oJ1xFCcdh/SYSTEM-ROLE-network_tests_route_table_nm.yml-legacy-ANSIBLE-2.9-RHEL_6_10_GA.log' stored here: /var/tmp/BEAKERLIB_STORED_SYSTEM-ROLE-network_tests_route_table_nm.yml-legacy-ANSIBLE-2.9-RHEL_6_10_GA.log
:: [ 16:55:46 ] :: [   PASS   ] :: Test tests_route_table_nm.yml (Assert: expected 0, got 0)

:: [ 17:01:13 ] :: [   PASS   ] :: Test network with ANSIBLE-2.9 against RHEL_7_9_GA (Expected 0, got 0)
:: [ 17:01:12 ] :: [   PASS   ] :: Test tests_route_table_nm.yml (Assert: expected 0, got 0)

:: [ 17:05:55 ] :: [   PASS   ] :: Test network with ANSIBLE-2.9 against RHEL_8_6_0_GA (Expected 0, got 0)
:: [ 17:05:54 ] :: [   PASS   ] :: Test tests_route_table_nm.yml (Assert: expected 0, got 0)

:: [ 17:13:46 ] :: [   PASS   ] :: Test network with ANSIBLE-2.9 against RHEL_8_7_TESTING (Expected 0, got 0)
:: [ 17:13:45 ] :: [   PASS   ] :: Test tests_route_table_nm.yml (Assert: expected 0, got 0)

:: [ 17:17:38 ] :: [   PASS   ] :: Test network with ANSIBLE-2.9 against RHEL_9_0_0_GA (Expected 0, got 0)
:: [ 17:17:37 ] :: [   PASS   ] :: Test tests_route_table_nm.yml (Assert: expected 0, got 0)

:: [ 17:21:43 ] :: [   PASS   ] :: Test network with ANSIBLE-2.9 against RHEL_9_1_TESTING (Expected 0, got 0)
:: [ 17:21:42 ] :: [   PASS   ] :: Test tests_route_table_nm.yml (Assert: expected 0, got 0)


Ansible 2.14:
[root@netqe16 Upstream-testsuite]# ansible --version
ansible [core 2.14.0]
  config file = /etc/ansible/ansible.cfg
  configured module search path = ['/root/.ansible/plugins/modules', '/usr/share/ansible/plugins/modules']
  ansible python module location = /usr/lib/python3.9/site-packages/ansible
  ansible collection location = /root/.ansible/collections:/usr/share/ansible/collections
  executable location = /usr/bin/ansible
  python version = 3.9.14 (main, Nov  9 2022, 13:02:35) [GCC 8.5.0 20210514 (Red Hat 8.5.0-17)] (/usr/bin/python3.9)
  jinja version = 3.1.2
  libyaml = True

As expected fails on unsupported RHEL 6
:: [ 17:40:54 ] :: [   FAIL   ] :: Test network with ANSIBLE-2.13 against RHEL_6_10_GA (Expected 0, got 1)
:: [ 17:40:54 ] :: [   LOG    ] :: Beakerlib env exported
:: [ 17:40:54 ] :: [   INFO   ] :: Sending SYSTEM-ROLE-network_tests_route_table_nm.yml-legacy-ANSIBLE-2.13-RHEL_6_10_GA.log as SYSTEM-ROLE-network_tests_route_table_nm.yml-legacy-ANSIBLE-2.13-RHEL_6_10_GA.log
:: [ 17:40:54 ] :: [   LOG    ] :: File '/tmp/tmp.4g1cCwSMuu/SYSTEM-ROLE-network_tests_route_table_nm.yml-legacy-ANSIBLE-2.13-RHEL_6_10_GA.log' stored here: /var/tmp/BEAKERLIB_STORED_SYSTEM-ROLE-network_tests_route_table_nm.yml-legacy-ANSIBLE-2.13-RHEL_6_10_GA.log
:: [ 17:40:53 ] :: [   FAIL   ] :: Test tests_route_table_nm.yml (Assert: expected 0, got 2)

:: [ 17:48:01 ] :: [   PASS   ] :: Test network with ANSIBLE-2.13 against RHEL_7_9_GA (Expected 0, got 0)
:: [ 17:48:00 ] :: [   PASS   ] :: Test tests_route_table_nm.yml (Assert: expected 0, got 0)

:: [ 18:00:21 ] :: [   PASS   ] :: Test network with ANSIBLE-2.13 against RHEL_8_6_0_GA (Expected 0, got 0)
:: [ 18:00:20 ] :: [   PASS   ] :: Test tests_route_table_nm.yml (Assert: expected 0, got 0)

:: [ 17:57:56 ] :: [   PASS   ] :: Test network with ANSIBLE-2.13 against RHEL_8_7_TESTING (Expected 0, got 0)
:: [ 17:57:55 ] :: [   PASS   ] :: Test tests_route_table_nm.yml (Assert: expected 0, got 0)

:: [ 18:06:17 ] :: [   PASS   ] :: Test network with ANSIBLE-2.13 against RHEL_9_0_0_GA (Expected 0, got 0)
:: [ 18:06:16 ] :: [   PASS   ] :: Test tests_route_table_nm.yml (Assert: expected 0, got 0)

:: [ 18:08:47 ] :: [   PASS   ] :: Test network with ANSIBLE-2.13 against RHEL_9_1_TESTING (Expected 0, got 0)
:: [ 18:08:46 ] :: [   PASS   ] :: Test tests_route_table_nm.yml (Assert: expected 0, got 0)

Comment 4 Rich Megginson 2022-12-09 00:20:44 UTC

Looking at the PR for this BZ - https://github.com/linux-system-roles/network/pull/526/files

The test is tests/tests_routing_rules_nm.yml

@nm-team please confirm

Comment 5 Wen Liang 2022-12-13 19:03:22 UTC

(In reply to Rich Megginson from comment #4)
> Looking at the PR for this BZ -
> https://github.com/linux-system-roles/network/pull/526/files
> 
> The test is tests/tests_routing_rules_nm.yml
> 
> @nm-team please confirm

I confirm, the test is `tests/tests_routing_rules_nm.yml`.

Comment 6 Jon Trossbach 2022-12-19 05:37:38 UTC

This test does not appear to be acting as expected reporting PASS but not appearing to run anything:

[root@sweetpig-20 Upstream-testsuite]# rpm -q rhel-system-roles
rhel-system-roles-1.21.0-0.13.el8.noarch
[root@sweetpig-20 Upstream-testsuite]# uname -r
4.18.0-442.el8.v2.x86_64


::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
::   Test
::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::

:: [ 00:30:21 ] :: [   PASS   ] :: Using image URL http://download.eng.bos.redhat.com/released/rhel-9/RHEL-9/9.0.0/BaseOS/x86_64/images/rhel-guest-image-9.0-20220420.0.x86_64.qcow2 
:: [ 00:30:27 ] :: [   PASS   ] :: Downloading image RHEL_9_0_0_GA 
:: [ 00:30:27 ] :: [   PASS   ] :: Command 'sed "s#<setup>#echo -e '[rhel]\\nname=rhel\\nbaseurl=http://download.eng.bos.redhat.com/released/rhel-9/RHEL-9/9.0.0/BaseOS/x86_64/os/\\nenabled=1\\ngpgcheck=0\\n[rhel-AppStream]\\nname=rhel-AppStream\\nbaseurl=http://download.eng.bos.redhat.com/released/rhel-9/RHEL-9/9.0.0/AppStream/x86_64/os/\\nenabled=1\\ngpgcheck=0\\n[rhel-HighAvailability]\\nname=rhel-HighAvailability\\nbaseurl=http://download.eng.bos.redhat.com/released/rhel-9/RHEL-9/9.0.0/HighAvailability/x86_64/os/\\nenabled=1\\ngpgcheck=0\\n' | sudo tee /etc/yum.repos.d/rhel.repo#" setup.yml > _setup.yml' (Expected 0, got 0)
:: [ 00:30:27 ] :: [   LOG    ] :: Running against image: RHEL_9_0_0_GA
:: [ 00:30:27 ] :: [   LOG    ] :: Using Ansible-2.9
:: [ 00:30:27 ] :: [   LOG    ] ::   guessed distribution version: 9
:: [ 00:30:27 ] :: [   LOG    ] :: Checking if 'roles/rhel-system-roles.podman' supports rhel version: 9
:: [ 00:30:27 ] :: [   LOG    ] ::   supported rhel versions: ['8', '9']
:: [ 00:30:27 ] :: [   LOG    ] :: Test playbook roles/rhel-system-roles.podman/tests/usr does not exist, probably podman has no tests
:: [ 00:30:27 ] :: [   LOG    ] ::   guessed distribution version: 9
:: [ 00:30:27 ] :: [   LOG    ] :: Checking if 'roles/rhel-system-roles.crypto_policies' supports rhel version: 9
:: [ 00:30:27 ] :: [   LOG    ] ::   supported rhel versions: [8, 9]
:: [ 00:30:28 ] :: [   LOG    ] :: Test playbook roles/rhel-system-roles.crypto_policies/tests/usr does not exist, probably crypto_policies has no tests
:: [ 00:30:28 ] :: [   LOG    ] ::   guessed distribution version: 9
:: [ 00:30:28 ] :: [   LOG    ] :: Checking if 'roles/rhel-system-roles.timesync' supports rhel version: 9
:: [ 00:30:28 ] :: [   LOG    ] ::   supported rhel versions: [6, 7, 8, 9]
:: [ 00:30:28 ] :: [   LOG    ] :: Test playbook roles/rhel-system-roles.timesync/tests/usr does not exist, probably timesync has no tests
:: [ 00:30:28 ] :: [   LOG    ] ::   guessed distribution version: 9
:: [ 00:30:28 ] :: [   LOG    ] :: Checking if 'roles/rhel-system-roles.network' supports rhel version: 9
:: [ 00:30:28 ] :: [   LOG    ] ::   supported rhel versions: ['6', '7', '8', '9']
:: [ 00:30:28 ] :: [   LOG    ] :: Test playbook roles/rhel-system-roles.network/tests/usr does not exist, probably network has no tests
:: [ 00:30:28 ] :: [   LOG    ] ::   guessed distribution version: 9
:: [ 00:30:28 ] :: [   LOG    ] :: Checking if 'roles/rhel-system-roles.logging' supports rhel version: 9
:: [ 00:30:28 ] :: [   LOG    ] ::   supported rhel versions: ['7', '8', '9']
:: [ 00:30:29 ] :: [   LOG    ] :: Test playbook roles/rhel-system-roles.logging/tests/usr does not exist, probably logging has no tests
:: [ 00:30:29 ] :: [   LOG    ] ::   guessed distribution version: 9
:: [ 00:30:29 ] :: [   LOG    ] :: Checking if 'roles/rhel-system-roles.kdump' supports rhel version: 9
:: [ 00:30:29 ] :: [   LOG    ] ::   supported rhel versions: [6, 7, 8, 9]
:: [ 00:30:29 ] :: [   LOG    ] :: Test playbook roles/rhel-system-roles.kdump/tests/usr does not exist, probably kdump has no tests
:: [ 00:30:29 ] :: [   LOG    ] ::   guessed distribution version: 9
:: [ 00:30:29 ] :: [   LOG    ] :: Checking if 'roles/rhel-system-roles.firewall' supports rhel version: 9
:: [ 00:30:29 ] :: [   LOG    ] ::   supported rhel versions: [7, 8, 9]
:: [ 00:30:29 ] :: [   LOG    ] :: Test playbook roles/rhel-system-roles.firewall/tests/usr does not exist, probably firewall has no tests
:: [ 00:30:29 ] :: [   LOG    ] ::   guessed distribution version: 9
:: [ 00:30:29 ] :: [   LOG    ] :: Checking if 'roles/rhel-system-roles.metrics' supports rhel version: 9
:: [ 00:30:29 ] :: [   LOG    ] ::   supported rhel versions: [6, 7, 8, 9]
:: [ 00:30:29 ] :: [   LOG    ] :: Test playbook roles/rhel-system-roles.metrics/tests/usr does not exist, probably metrics has no tests
:: [ 00:30:29 ] :: [   LOG    ] ::   guessed distribution version: 9
:: [ 00:30:29 ] :: [   LOG    ] :: Checking if 'roles/rhel-system-roles.kernel_settings' supports rhel version: 9
:: [ 00:30:30 ] :: [   LOG    ] ::   supported rhel versions: [7, 8, 9]
:: [ 00:30:30 ] :: [   LOG    ] :: Test playbook roles/rhel-system-roles.kernel_settings/tests/usr does not exist, probably kernel_settings has no tests
:: [ 00:30:30 ] :: [   LOG    ] ::   guessed distribution version: 9
:: [ 00:30:30 ] :: [   LOG    ] :: Checking if 'roles/rhel-system-roles.storage' supports rhel version: 9
:: [ 00:30:30 ] :: [   LOG    ] ::   supported rhel versions: [7, 8, 9]
:: [ 00:30:30 ] :: [   LOG    ] :: Test playbook roles/rhel-system-roles.storage/tests/usr does not exist, probably storage has no tests
:: [ 00:30:30 ] :: [   LOG    ] ::   guessed distribution version: 9
:: [ 00:30:30 ] :: [   LOG    ] :: Checking if 'roles/rhel-system-roles.selinux' supports rhel version: 9
:: [ 00:30:30 ] :: [   LOG    ] ::   supported rhel versions: [6, 7, 8, 9]
:: [ 00:30:30 ] :: [   LOG    ] :: Test playbook roles/rhel-system-roles.selinux/tests/usr does not exist, probably selinux has no tests
:: [ 00:30:30 ] :: [   LOG    ] ::   guessed distribution version: 9
:: [ 00:30:30 ] :: [   LOG    ] :: Checking if 'roles/rhel-system-roles.ad_integration' supports rhel version: 9
:: [ 00:30:31 ] :: [   LOG    ] ::   supported rhel versions: [7, 8, 9]
:: [ 00:30:31 ] :: [   LOG    ] :: Test playbook roles/rhel-system-roles.ad_integration/tests/usr does not exist, probably ad_integration has no tests
:: [ 00:30:31 ] :: [   LOG    ] ::   guessed distribution version: 9
:: [ 00:30:31 ] :: [   LOG    ] :: Checking if 'roles/rhel-system-roles.ha_cluster' supports rhel version: 9
:: [ 00:30:31 ] :: [   LOG    ] ::   supported rhel versions: [8, 9]
:: [ 00:30:31 ] :: [   LOG    ] :: Test playbook roles/rhel-system-roles.ha_cluster/tests/usr does not exist, probably ha_cluster has no tests
:: [ 00:30:31 ] :: [   LOG    ] ::   guessed distribution version: 9
:: [ 00:30:31 ] :: [   LOG    ] :: Checking if 'roles/rhel-system-roles.tlog' supports rhel version: 9
:: [ 00:30:31 ] :: [   LOG    ] ::   supported rhel versions: [8, 9]
:: [ 00:30:31 ] :: [   LOG    ] :: Test playbook roles/rhel-system-roles.tlog/tests/usr does not exist, probably tlog has no tests
:: [ 00:30:31 ] :: [   LOG    ] ::   guessed distribution version: 9
:: [ 00:30:31 ] :: [   LOG    ] :: Checking if 'roles/rhel-system-roles.nbde_server' supports rhel version: 9
:: [ 00:30:31 ] :: [   LOG    ] ::   supported rhel versions: ['7', '8', '9']
:: [ 00:30:32 ] :: [   LOG    ] :: Test playbook roles/rhel-system-roles.nbde_server/tests/usr does not exist, probably nbde_server has no tests
:: [ 00:30:32 ] :: [   LOG    ] ::   guessed distribution version: 9
:: [ 00:30:32 ] :: [   LOG    ] :: Checking if 'roles/rhel-system-roles.nbde_client' supports rhel version: 9
:: [ 00:30:32 ] :: [   LOG    ] ::   supported rhel versions: [7, 8, 9]
:: [ 00:30:32 ] :: [   LOG    ] :: Test playbook roles/rhel-system-roles.nbde_client/tests/usr does not exist, probably nbde_client has no tests
:: [ 00:30:32 ] :: [   LOG    ] ::   guessed distribution version: 9
:: [ 00:30:32 ] :: [   LOG    ] :: Checking if 'roles/rhel-system-roles.vpn' supports rhel version: 9
:: [ 00:30:32 ] :: [   LOG    ] ::   supported rhel versions: [7, 8, 9]
:: [ 00:30:32 ] :: [   LOG    ] :: Test playbook roles/rhel-system-roles.vpn/tests/usr does not exist, probably vpn has no tests
:: [ 00:30:32 ] :: [   LOG    ] ::   guessed distribution version: 9
:: [ 00:30:32 ] :: [   LOG    ] :: Checking if 'roles/rhel-system-roles.ssh' supports rhel version: 9
:: [ 00:30:32 ] :: [   LOG    ] ::   supported rhel versions: [6, 7, 8, 9]
:: [ 00:30:33 ] :: [   LOG    ] :: Test playbook roles/rhel-system-roles.ssh/tests/usr does not exist, probably ssh has no tests
:: [ 00:30:33 ] :: [   LOG    ] ::   guessed distribution version: 9
:: [ 00:30:33 ] :: [   LOG    ] :: Checking if 'roles/rhel-system-roles.cockpit' supports rhel version: 9
:: [ 00:30:33 ] :: [   LOG    ] ::   supported rhel versions: ['7', '8', '9']
:: [ 00:30:33 ] :: [   LOG    ] :: Test playbook roles/rhel-system-roles.cockpit/tests/usr does not exist, probably cockpit has no tests
:: [ 00:30:33 ] :: [   LOG    ] ::   guessed distribution version: 9
:: [ 00:30:33 ] :: [   LOG    ] :: Checking if 'roles/rhel-system-roles.certificate' supports rhel version: 9
:: [ 00:30:33 ] :: [   LOG    ] ::   supported rhel versions: [7, 8, 9]
:: [ 00:30:33 ] :: [   LOG    ] :: Test playbook roles/rhel-system-roles.certificate/tests/usr does not exist, probably certificate has no tests
:: [ 00:30:33 ] :: [   LOG    ] ::   guessed distribution version: 9
:: [ 00:30:33 ] :: [   LOG    ] :: Checking if 'roles/rhel-system-roles.postfix' supports rhel version: 9
:: [ 00:30:33 ] :: [   LOG    ] ::   supported rhel versions: ['6', '7', '8', '9']
:: [ 00:30:34 ] :: [   LOG    ] :: Test playbook roles/rhel-system-roles.postfix/tests/usr does not exist, probably postfix has no tests
:: [ 00:30:34 ] :: [   LOG    ] ::   guessed distribution version: 9
:: [ 00:30:34 ] :: [   LOG    ] :: Checking if 'roles/rhel-system-roles.sshd' supports rhel version: 9
:: [ 00:30:34 ] :: [   LOG    ] ::   supported rhel versions: ['6', '7', '8', '9']
:: [ 00:30:34 ] :: [   LOG    ] :: Test playbook roles/rhel-system-roles.sshd/tests/usr does not exist, probably sshd has no tests
:: [ 00:30:34 ] :: [   PASS   ] :: Command 'rm -f image.qcow2 _setup.yml' (Expected 0, got 0)
::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::::
::   Duration: 14s
::   Assertions: 4 good, 0 bad
::   RESULT: PASS (Test)

@djez 
@rmeggins

Comment 8 Jon Trossbach 2023-01-13 13:45:10 UTC

This is failing for RHEL 7.9, 8.7, and 9.2 VMs with Ansible 2.14 and is also failing for RHEL 7.9, 8.7, 8.8, and 9.2 VMs with Ansible 2.9  

[root@netqe3 Upstream-testsuite]# uname -r
4.18.0-447.el8.x86_64
[root@netqe3 Upstream-testsuite]# rpm -q rhel-system-roles
rhel-system-roles-1.21.0-0.13.el9.noarch

:: [ 18:44:15 ] :: [   PASS   ] :: Test network with ANSIBLE-2.9 against RHEL_6_10_GA (Expected 0, got 0)
:: [ 18:44:14 ] :: [   PASS   ] :: Test tests_routing_rules_nm.yml (Assert: expected 0, got 0)
:: [ 18:44:06 ] :: [   PASS   ] :: Test network with ANSIBLE-2 against RHEL_6_10_GA (Expected 0, got 0)
:: [ 18:44:05 ] :: [   PASS   ] :: Test tests_routing_rules_nm.yml (Assert: expected 0, got 0)
:: [ 18:44:28 ] :: [   FAIL   ] :: Test network with ANSIBLE-2.9 against RHEL_7_9_GA (Expected 0, got 1)
:: [ 18:44:27 ] :: [   FAIL   ] :: Test tests_routing_rules_nm.yml (Assert: expected 0, got 2)
:: [ 18:44:28 ] :: [   FAIL   ] :: Test network with ANSIBLE-2 against RHEL_7_9_GA (Expected 0, got 1)
:: [ 18:44:27 ] :: [   FAIL   ] :: Test tests_routing_rules_nm.yml (Assert: expected 0, got 2)
:: [ 18:44:28 ] :: [   FAIL   ] :: Test network with ANSIBLE-2.9 against RHEL_8_7_0_GA (Expected 0, got 1)
:: [ 18:44:26 ] :: [   FAIL   ] :: Test tests_routing_rules_nm.yml (Assert: expected 0, got 2)
:: [ 18:44:28 ] :: [   FAIL   ] :: Test network with ANSIBLE-2 against RHEL_8_7_0_GA (Expected 0, got 1)
:: [ 18:44:27 ] :: [   FAIL   ] :: Test tests_routing_rules_nm.yml (Assert: expected 0, got 2)
:: [ 18:44:27 ] :: [   FAIL   ] :: Test network with ANSIBLE-2.9 against RHEL_8_8_TESTING (Expected 0, got 1)
:: [ 18:44:26 ] :: [   FAIL   ] :: Test tests_routing_rules_nm.yml (Assert: expected 0, got 2)
:: [ 18:44:12 ] :: [   PASS   ] :: Test network with ANSIBLE-2 against RHEL_8_8_TESTING (Expected 0, got 0)
:: [ 18:44:11 ] :: [   PASS   ] :: Test tests_routing_rules_nm.yml (Assert: expected 0, got 0)
:: [ 18:44:24 ] :: [   PASS   ] :: Test network with ANSIBLE-2.9 against RHEL_9_1_0_GA (Expected 0, got 0)
:: [ 18:44:23 ] :: [   PASS   ] :: Test tests_routing_rules_nm.yml (Assert: expected 0, got 0)
:: [ 18:43:55 ] :: [   PASS   ] :: Test network with ANSIBLE-2 against RHEL_9_1_0_GA (Expected 0, got 0)
:: [ 18:43:54 ] :: [   PASS   ] :: Test tests_routing_rules_nm.yml (Assert: expected 0, got 0)
:: [ 18:44:26 ] :: [   PASS   ] :: Test network with ANSIBLE-2.9 against RHEL_9_2_TESTING (Expected 0, got 0)
:: [ 18:44:25 ] :: [   PASS   ] :: Test tests_routing_rules_nm.yml (Assert: expected 0, got 0)
:: [ 18:42:49 ] :: [   FAIL   ] :: Test network with ANSIBLE-2 against RHEL_9_2_TESTING (Expected 0, got 1)
:: [ 18:42:49 ] :: [   FAIL   ] :: Test tests_routing_rules_nm.yml (Assert: expected 0, got 1)

Comment 9 Rich Megginson 2023-01-13 15:44:03 UTC

(In reply to Jon Trossbach from comment #8)
> This is failing for RHEL 7.9, 8.7, and 9.2 VMs with Ansible 2.14 and is also
> failing for RHEL 7.9, 8.7, 8.8, and 9.2 VMs with Ansible 2.9  
> 

I believe this is failing due to running the tests in parallel.

Comment 10 Jon Trossbach 2023-01-13 16:58:57 UTC

After serializing my tests instead of running them simultaneously they pass except RHEL 6.10 with Ansible 2.14, which is expected.

[root@netqe41 Upstream-testsuite]# uname -r
4.18.0-447.el8.x86_64
[root@netqe41 Upstream-testsuite]# rpm -q rhel-system-roles
rhel-system-roles-1.21.0-0.13.el9.noarch

:: [ 11:44:50 ] :: [   PASS   ] :: Test network with ANSIBLE-2.9 against RHEL_6_10_GA (Expected 0, got 0)
:: [ 11:44:49 ] :: [   PASS   ] :: Test tests_routing_rules_nm.yml (Assert: expected 0, got 0)
:: [ 11:28:56 ] :: [   FAIL   ] :: Test network with ANSIBLE-2 against RHEL_6_10_GA (Expected 0, got 1)
:: [ 11:28:55 ] :: [   FAIL   ] :: Test tests_routing_rules_nm.yml (Assert: expected 0, got 2)
:: [ 11:45:56 ] :: [   PASS   ] :: Test network with ANSIBLE-2.9 against RHEL_7_9_GA (Expected 0, got 0)
:: [ 11:45:55 ] :: [   PASS   ] :: Test tests_routing_rules_nm.yml (Assert: expected 0, got 0)
:: [ 11:29:58 ] :: [   PASS   ] :: Test network with ANSIBLE-2 against RHEL_7_9_GA (Expected 0, got 0)
:: [ 11:29:57 ] :: [   PASS   ] :: Test tests_routing_rules_nm.yml (Assert: expected 0, got 0)
:: [ 11:47:18 ] :: [   PASS   ] :: Test network with ANSIBLE-2.9 against RHEL_8_7_0_GA (Expected 0, got 0)
:: [ 11:47:17 ] :: [   PASS   ] :: Test tests_routing_rules_nm.yml (Assert: expected 0, got 0)
:: [ 11:31:34 ] :: [   PASS   ] :: Test network with ANSIBLE-2 against RHEL_8_7_0_GA (Expected 0, got 0)
:: [ 11:31:33 ] :: [   PASS   ] :: Test tests_routing_rules_nm.yml (Assert: expected 0, got 0)
:: [ 11:48:34 ] :: [   PASS   ] :: Test network with ANSIBLE-2.9 against RHEL_8_8_TESTING (Expected 0, got 0)
:: [ 11:48:33 ] :: [   PASS   ] :: Test tests_routing_rules_nm.yml (Assert: expected 0, got 0)
:: [ 11:32:46 ] :: [   PASS   ] :: Test network with ANSIBLE-2 against RHEL_8_8_TESTING (Expected 0, got 0)
:: [ 11:32:45 ] :: [   PASS   ] :: Test tests_routing_rules_nm.yml (Assert: expected 0, got 0)
:: [ 11:49:41 ] :: [   PASS   ] :: Test network with ANSIBLE-2.9 against RHEL_9_1_0_GA (Expected 0, got 0)
:: [ 11:49:40 ] :: [   PASS   ] :: Test tests_routing_rules_nm.yml (Assert: expected 0, got 0)
:: [ 11:33:48 ] :: [   PASS   ] :: Test network with ANSIBLE-2 against RHEL_9_1_0_GA (Expected 0, got 0)
:: [ 11:33:47 ] :: [   PASS   ] :: Test tests_routing_rules_nm.yml (Assert: expected 0, got 0)
:: [ 11:50:59 ] :: [   PASS   ] :: Test network with ANSIBLE-2.9 against RHEL_9_2_TESTING (Expected 0, got 0)
:: [ 11:50:58 ] :: [   PASS   ] :: Test tests_routing_rules_nm.yml (Assert: expected 0, got 0)
:: [ 11:34:55 ] :: [   PASS   ] :: Test network with ANSIBLE-2 against RHEL_9_2_TESTING (Expected 0, got 0)
:: [ 11:34:54 ] :: [   PASS   ] :: Test tests_routing_rules_nm.yml (Assert: expected 0, got 0)

Comment 11 Jon Trossbach 2023-01-13 17:34:18 UTC

The rpm -q should read:

[root@netqe41 Upstream-testsuite]# rpm -q rhel-system-roles
rhel-system-roles-1.21.0-0.13.el8.noarch

Comment 16 errata-xmlrpc 2023-05-16 08:31:12 UTC

Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (rhel-system-roles bug fix and enhancement update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHEA-2023:2804