Bug 2034307 - Allow to set smfs/dmfs modes for mellanox nic in os-net-config
Summary: Allow to set smfs/dmfs modes for mellanox nic in os-net-config
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat OpenStack
Classification: Red Hat
Component: os-net-config
Version: 16.2 (Train)
Hardware: Unspecified
OS: Linux
high
high
Target Milestone: z2
: 16.2 (Train on RHEL 8.4)
Assignee: Haresh Khandelwal
QA Contact: Miguel Angel Nieto
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2021-12-20 16:09 UTC by Jacob Ansari
Modified: 2023-09-15 01:18 UTC (History)
26 users (show)

Fixed In Version: os-net-config-11.5.1-2.20211207004923.el8ost
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2022-03-23 22:12:27 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
OpenStack gerrit 825224 0 None MERGED Adding steering_mode config to sriov_pf object 2022-01-27 12:25:32 UTC
Red Hat Issue Tracker NFV-2385 0 None None None 2022-01-10 14:24:45 UTC
Red Hat Issue Tracker OSP-11896 0 None None None 2021-12-20 16:16:49 UTC
Red Hat Product Errata RHBA-2022:1001 0 None None None 2022-03-23 22:12:53 UTC

Description Jacob Ansari 2021-12-20 16:09:33 UTC
Description of problem:
Allow to set smfs/dmfs modes for mellanox nic in os-net-config .

~~~
devlink dev param set pci/<pci-address> flow_steering_mode value smfs cmode runtime
devlink dev eswitch set pci/<pci-address> mode switchdev
~~~
or this:
~~~
devlink dev param set pci/<pci-address> flow_steering_mode value dmfs cmode runtime
devlink dev eswitch set pci/<pci-address> mode switchdev
~~~

(above is lifted from BZ 1882480 )


As mentioned in case asked in case 03106576 : 
"In troubleshooting this feature with RH and Nvidia engineering team, the customer has had to change from SMFS to DMFS steering mode. This change was accomplished manually, but the customer requires a way to override this mode and update it during deployments so the best steering mode may be utilized."

In the previous BZ on this matter (  https://bugzilla.redhat.com/show_bug.cgi?id=1882480#c6 ), setting to smfs if switchdev and dmfs otherwise was decided upon . However, this does not address customer's actual need to selectively override SMFS or DMFS defaults for optimum performance .


Version-Release number of selected component (if applicable):


How reproducible:


Steps to Reproduce:
1.
2.
3.

Actual results:


Expected results:


Additional info:

Comment 2 Steve Baker 2022-01-04 21:01:07 UTC
Assigning to networking for dsneddon triage

Comment 9 Marcelo Ricardo Leitner 2022-01-20 13:37:40 UTC
From Ariel:
https://review.opendev.org/c/openstack/os-net-config/+/824971

Comment 22 Miguel Angel Nieto 2022-03-09 08:24:35 UTC
Verified in RHOS-16.2-RHEL-8-20220301.n.3

Without configuring steering mode in templates (default behaviour)
lspci | grep Mella | grep -v Virtual
04:00.0 Ethernet controller: Mellanox Technologies MT27800 Family [ConnectX-5]
04:00.1 Ethernet controller: Mellanox Technologies MT27800 Family [ConnectX-5]

devlink dev param show pci/0000:04:00.0 name flow_steering_mode
pci/0000:04:00.0:
  name flow_steering_mode type driver-specific
    values:
      cmode runtime value smfs
devlink dev param show pci/0000:04:00.1 name flow_steering_mode
pci/0000:04:00.1:
  name flow_steering_mode type driver-specific
    values:
      cmode runtime value smfs

devlink dev eswitch show pci/0000:04:00.1
pci/0000:04:00.1: mode switchdev inline-mode none encap-mode basic
devlink dev eswitch show pci/0000:04:00.0
pci/0000:04:00.0: mode switchdev inline-mode none encap-mode basic

Configuring in steering_mode in templates in the following way:
              - type: ovs_bridge
                name: br-link0
                mtu: 9000
                use_dhcp: false
                members:
                - type: linux_bond
                  name: mx-bond
                  mtu: 9000
                  bonding_options: "mode=active-backup"
                  members:
                  - type: sriov_pf
                    name: nic11
                    numvfs: 10
                    primary: true
                    promisc: true
                    use_dhcp: false
                    defroute: false
                    link_mode: switchdev
                    steering_mode: dmfs

                  - type: sriov_pf
                    name: nic12
                    numvfs: 10
                    promisc: true
                    use_dhcp: false
                    defroute: false
                    link_mode: switchdev
                    steering_mode: dmfs


lspci | grep Mella | grep -v Virtual
04:00.0 Ethernet controller: Mellanox Technologies MT27800 Family [ConnectX-5]
04:00.1 Ethernet controller: Mellanox Technologies MT27800 Family [ConnectX-5]

devlink dev param show pci/0000:04:00.0 name flow_steering_mode
pci/0000:04:00.0:
  name flow_steering_mode type driver-specific
    values:
      cmode runtime value dmfs
devlink dev param show pci/0000:04:00.1 name flow_steering_mode
pci/0000:04:00.1:
  name flow_steering_mode type driver-specific
    values:
      cmode runtime value dmfs

sudo devlink dev eswitch show pci/0000:04:00.1
pci/0000:04:00.1: mode switchdev inline-mode none encap-mode basic
sudo devlink dev eswitch show pci/0000:04:00.0
pci/0000:04:00.0: mode switchdev inline-mode none encap-mode basic

Comment 30 errata-xmlrpc 2022-03-23 22:12:27 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Release of components for Red Hat OpenStack Platform 16.2.2), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2022:1001

Comment 31 Red Hat Bugzilla 2023-09-15 01:18:18 UTC
The needinfo request[s] on this closed bug have been removed as they have been unresolved for 500 days


Note You need to log in before you can comment on or make changes to this bug.