Bug 2221590

Summary: [FFU] os-net-config failure on RHEL9 compute
Product: Red Hat OpenStack Reporter: Ricardo Diaz <rdiazcam>
Component: os-net-configAssignee: RHOSP:NFV_Eng <rhosp-nfv-int>
Status: CLOSED NOTABUG QA Contact: Eran Kuris <ekuris>
Severity: medium Docs Contact:
Priority: medium    
Version: 17.1 (Wallaby)CC: bfournie, hbrock, jbadiapa, jpretori, jslagle, mburns, mnietoji, rhosp-nfv-int
Target Milestone: ---Keywords: TestOnly, Triaged
Target Release: ---Flags: ifrangs: needinfo? (rhosp-nfv-int)
Hardware: x86_64   
OS: Linux   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2023-07-18 09:17:54 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Ricardo Diaz 2023-07-10 08:29:37 UTC
Description of problem:

After running Overcloud Compute System Upgrade FFU OSP17 for OVS SR-IOV+DPDK the RHEL9 compute got stack because a problem configuring the network. We need to perform a cold reboot from iDRAC to get the compute alive again. After the reboot we can observe this:

~~~
[root@computedpdksriov-0 ~]# os-net-config -c /etc/os-net-config/config.json.orig
2023-07-07 15:02:11.032 WARNING os_net_config.main Config file failed schema validation at network_config/1:
    {'addresses': [{'ip_netmask': '192.0.70.9/24'}], 'name': 'nic2', 'routes': [{'ip_netmask': '169.254.169.254/32', 'next_hop': ''}, {'default': True, 'next_hop': '192.0.70.1'}], 'type': 'interface', 'use_dhcp': False, 'nic_mapping': {'nic1': 'eno1', 'nic10': 'enp5s0f3', 'nic2': 'eno2', 'nic3': 'enp130s0f0', 'nic4': 'enp130s0f1', 'nic5': 'enp130s0f2', 'nic6': 'enp130s0f3', 'nic7': 'enp5s0f0', 'nic8': 'enp5s0f1', 'nic9': 'enp5s0f2'}, 'persist_mapping': False} is not valid under any of the given schemas
  Sub-schemas tested and not matching:
  - items/oneOf/interface/routes/items/oneOf: {'ip_netmask': '169.254.169.254/32', 'next_hop': ''} is not valid under any of the given schemas
  -- items/oneOf/interface/routes/items/oneOf/0/next_hop/oneOf: '' is not valid under any of the given schemas
  --- items/oneOf/interface/routes/items/oneOf/0/next_hop/oneOf/ip_address_string/oneOf: '' is not valid under any of the given schemas
  ---- items/oneOf/interface/routes/items/oneOf/0/next_hop/oneOf/ip_address_string/oneOf/ipv4_address_string/pattern: '' does not match '^((25[0-5]|2[0-4][0-9]|[01]?[0-9][0-9]?).){3}(25[0-5]|2[0-4][0-9]|[01]?[0-9][0-9]?)$'
  ---- items/oneOf/interface/routes/items/oneOf/0/next_hop/oneOf/ip_address_string/oneOf/ipv6_address_string/pattern: '' does not match '^(([0-9a-fA-F]{1,4}:){7,7}[0-9a-fA-F]{1,4}|([0-9a-fA-F]{1,4}:){1,7}:|([0-9a-fA-F]{1,4}:){1,6}:[0-9a-fA-F]{1,4}|([0-9a-fA-F]{1,4}:){1,5}(:[0-9a-fA-F]{1,4}){1,2}|([0-9a-fA-F]{1,4}:){1,4}(:[0-9a-fA-F]{1,4}){1,3}|([0-9a-fA-F]{1,4}:){1,3}(:[0-9a-fA-F]{1,4}){1,4}|([0-9a-fA-F]{1,4}:){1,2}(:[0-9a-fA-F]{1,4}){1,5}|[0-9a-fA-F]{1,4}:((:[0-9a-fA-F]{1,4}){1,6})|:((:[0-9a-fA-F]{1,4}){1,7}|:))$'
  --- items/oneOf/interface/routes/items/oneOf/0/next_hop/oneOf/param/oneOf: '' is not valid under any of the given schemas
  ---- items/oneOf/interface/routes/items/oneOf/0/next_hop/oneOf/param/oneOf/0/type: '' is not of type 'object'
  ---- items/oneOf/interface/routes/items/oneOf/0/next_hop/oneOf/param/oneOf/1/type: '' is not of type 'object'
  -- items/oneOf/interface/routes/items/oneOf/1/additionalProperties: Additional properties are not allowed ('next_hop', 'ip_netmask' were unexpected)
Config file failed schema validation at network_config/6:
    {'members': [{'members': [{'name': 'nic5', 'type': 'interface'}], 'name': 'dpdk2', 'type': 'ovs_dpdk_port'}], 'mtu': 9000, 'name': 'br-dpdk0', 'rx_queue': 1, 'type': 'ovs_user_bridge', 'use_dhcp': False, 'nic_mapping': {'nic1': 'eno1', 'nic10': 'enp5s0f3', 'nic2': 'eno2', 'nic3': 'enp130s0f0', 'nic4': 'enp130s0f1', 'nic5': 'enp130s0f2', 'nic6': 'enp130s0f3', 'nic7': 'enp5s0f0', 'nic8': 'enp5s0f1', 'nic9': 'enp5s0f2'}, 'persist_mapping': False} is not valid under any of the given schemas
  Sub-schemas tested and not matching:
  - items/oneOf/ovs_user_bridge/additionalProperties: Additional properties are not allowed ('rx_queue' was unexpected)
Config file failed schema validation at network_config/7:
    {'members': [{'members': [{'name': 'nic6', 'type': 'interface'}], 'name': 'dpdk3', 'type': 'ovs_dpdk_port'}], 'mtu': 9000, 'name': 'br-dpdk1', 'rx_queue': 1, 'type': 'ovs_user_bridge', 'use_dhcp': False, 'nic_mapping': {'nic1': 'eno1', 'nic10': 'enp5s0f3', 'nic2': 'eno2', 'nic3': 'enp130s0f0', 'nic4': 'enp130s0f1', 'nic5': 'enp130s0f2', 'nic6': 'enp130s0f3', 'nic7': 'enp5s0f0', 'nic8': 'enp5s0f1', 'nic9': 'enp5s0f2'}, 'persist_mapping': False} is not valid under any of the given schemas
  Sub-schemas tested and not matching:
  - items/oneOf/ovs_user_bridge/additionalProperties: Additional properties are not allowed ('rx_queue' was unexpected)
~~~

This problem does not happen for the HW Offload scenario (it has different network configuration).

Version-Release number of selected component (if applicable):
17.1 FFU

How reproducible:
100%


Steps to Reproduce:
1. Run Overcloud Compute System Upgrade FFU OSP17
2.
3.

Actual results:


Expected results:


Additional info: