Bug 1965950

Summary: fail to create many veth interfaces
Product: Red Hat Enterprise Linux 8 Reporter: Mingyu Shi <mshi>
Component: nmstateAssignee: Gris Ge <fge>
Status: CLOSED ERRATA QA Contact: Mingyu Shi <mshi>
Severity: medium Docs Contact:
Priority: medium    
Version: 8.5CC: ferferna, jiji, jishi, network-qe, sfaye, till
Target Milestone: betaKeywords: Triaged, ZStream
Target Release: 8.6   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: nmstate-1.4.0-0.alpha.20221201.el8 Doc Type: No Doc Update
Doc Text:
Story Points: ---
Clone Of:
: 2150705 2150706 (view as bug list) Environment:
Last Closed: 2023-05-16 08:26:38 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 2150705, 2150706    
Attachments:
Description Flags
34veths.yaml
none
error.log
none
NetworkManager trace log none

Description Mingyu Shi 2021-05-31 08:26:43 UTC 
Created attachment 1788158 [details]
34veths.yaml

Description of problem:
Fail to create many veth interfaces(type: veth)

Version-Release number of selected component (if applicable):
nmstate-1.1.0-0.1.el8.noarch
nispor-1.1.0-1.el8.x86_64
NetworkManager-1.32.0-0.4.el8.x86_64
Linux dell-per740-80.rhts.eng.pek2.redhat.com 4.18.0-305.7.el8.kpq1.x86_64 #1 SMP Mon May 17 13:36:02 EDT 2021 x86_64 x86_64 x86_64 GNU/Linux

How reproducible:
100%

Steps to Reproduce:
Use the attachment 34 [details]veths.yaml:
nmstatectl apply 34veths.yaml

Actual results:
Failed

Expected results:
No failure

Additional info:
Comment 1 Mingyu Shi 2021-05-31 08:30:25 UTC 
Created attachment 1788159 [details]
error.log
Comment 3 Gris Ge 2022-07-20 07:22:42 UTC 
Reproduced this problem on NetworkManager-1.39.10-30694.copr.78dfc56a74.el9.x86_64 and also NetworkManager-1.39.7-2.el8.x86_64.

Got error: 
Connection 'veth7_ep' is not available on device veth7_ep because device is strictly unmanaged

Still investigating.
Comment 4 Gris Ge 2022-07-20 07:23:49 UTC 
Created attachment 1898253 [details]
NetworkManager trace log
Comment 5 Gris Ge 2022-07-27 07:16:05 UTC 
Hi Fernando,

Could you take a look on the NM logs when you have time?
Comment 7 Gris Ge 2022-11-28 13:21:00 UTC 
Patch send to upstream: https://github.com/nmstate/nmstate/pull/2121


This bug reveal a sever problem in RHEL 8.6, will request zstream without customer report.
Comment 8 Gris Ge 2022-11-28 13:23:11 UTC 
The problem is at nmstate side which does not iterate the glib mainloop during sleep for activation retry.

This will impact RHEL 8.6 customer on slow server or bulk change(e.g. create 32 veth in single transaction).
Comment 14 Mingyu Shi 2022-12-22 14:22:05 UTC 
Verified with:
nmstate-1.3.3-4.el8_7.x86_64
nispor-1.2.7-1.el8.x86_64
NetworkManager-1.40.0-5.el8_7.x86_64
DISTRO=RHEL-8.7.0-updates-20221221.0
Comment 15 Mingyu Shi 2022-12-22 14:43:17 UTC 
Verified with:
nmstate-1.4.0-1.el8.x86_64
nispor-1.2.7-1.el8.x86_64
NetworkManager-1.40.6-1.el8.x86_64
DISTRO=RHEL-8.8.0-20221213.0
Comment 17 errata-xmlrpc 2023-05-16 08:26:38 UTC 
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (nmstate bug fix and enhancement update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2023:2772