+++ This bug was initially created as a clone of Bug #1937432 +++

Description of problem:
We are testing min BW placement enforcement on a setup with Intel NICs that don't support min BW dataplane enforcement.

When the sriov agent's qos extension is enabled, the sriov agent tries to apply QoS dataplane enforcements.

Due to this, when a server is created using a direct/VF port that has a qos-policy with a minimum bw rule, the following errors are shown by the sriov agent logs:
2021-03-10 14:52:31.065 111774 DEBUG neutron.plugins.ml2.drivers.mech_sriov.agent.eswitch_manager [req-e3eeb9fe-ed86-450a-85c9-9279a452cb18 - - - - -] Setting 1000 Mbps limit for port 2 set_device_rate /usr/lib/python3.6/site-packages/neutron/plugins/ml2/drivers/mech_sriov/agent/eswitch_manager.py:240
2021-03-10 14:52:31.187 114571 DEBUG oslo.privsep.daemon [-] privsep: Exception during request[140011213354704]: Invalid parameter/value used on interface enp5s0f0, namespace None. _process_cmd /usr/lib/python3.6/site-packages/oslo_privsep/daemon.py:490
Traceback (most recent call last):
  File "/usr/lib/python3.6/site-packages/neutron/privileged/agent/linux/ip_lib.py", line 299, in _run_iproute_link
    return ip.link(command, index=idx, **kwargs)
  File "/usr/lib/python3.6/site-packages/pyroute2/iproute/linux.py", line 1163, in link
    msg_flags=msg_flags)
  File "/usr/lib/python3.6/site-packages/pyroute2/netlink/nlsocket.py", line 373, in nlm_request
    return tuple(self._genlm_request(*argv, **kwarg))
  File "/usr/lib/python3.6/site-packages/pyroute2/netlink/nlsocket.py", line 864, in nlm_request
    callback=callback):
  File "/usr/lib/python3.6/site-packages/pyroute2/netlink/nlsocket.py", line 376, in get
    return tuple(self._genlm_get(*argv, **kwarg))
  File "/usr/lib/python3.6/site-packages/pyroute2/netlink/nlsocket.py", line 701, in get
    raise msg['header']['error']
pyroute2.netlink.exceptions.NetlinkError: (22, 'Invalid argument')

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/lib/python3.6/site-packages/oslo_privsep/daemon.py", line 485, in _process_cmd
    ret = func(*f_args, **f_kwargs)
  File "/usr/lib/python3.6/site-packages/neutron/privileged/agent/linux/ip_lib.py", line 73, in sync_inner
    return input_func(*args, **kwargs)
  File "/usr/lib/python3.6/site-packages/oslo_privsep/priv_context.py", line 247, in _wrap
    return func(*args, **kwargs)
  File "/usr/lib/python3.6/site-packages/neutron/privileged/agent/linux/ip_lib.py", line 448, in set_link_vf_feature
    return _run_iproute_link("set", device, namespace=namespace, vf=vf_config)
  File "/usr/lib/python3.6/site-packages/neutron/privileged/agent/linux/ip_lib.py", line 301, in _run_iproute_link
    _translate_ip_device_exception(e, device, namespace)
  File "/usr/lib/python3.6/site-packages/neutron/privileged/agent/linux/ip_lib.py", line 279, in _translate_ip_device_exception
    raise InvalidArgument(device=device, namespace=namespace)
neutron.privileged.agent.linux.ip_lib.InvalidArgument: Invalid parameter/value used on interface enp5s0f0, namespace None.



There is a workaround for this: disabling qos extension from the sriov agent, but then, no BW limit dataplane enforcement can be done (and this is supported by our Intel NICs).



Version-Release number of selected component (if applicable):
RHOS-16.2-RHEL-8-20210525.n.0


How reproducible:
100%


Steps to Reproduce:
1. create qos policy and qos rule
  openstack network qos policy create guaranteed_min_bw
  openstack network qos rule create --type minimum-bandwidth --min-kbps 1000000 --egress guaranteed_min_bw

2. create a direct port associated to the previous qos policy
  openstack port create --qos-policy guaranteed_min_bw --vnic-type direct --network nova port-direct-0


3. create a server with that port
  openstack server create --port port-direct-0 --image tempest_image --flavor 200 vm-0