Bug 2080414

Summary: ethtool not reporting DDM/DOM data from ethtool-5.13-1.el8.x86_64
Product: Red Hat Enterprise Linux 8 Reporter: Daniel Juarez <djuarezg>
Component: ethtoolAssignee: Ivan Vecera <ivecera>
Status: CLOSED ERRATA QA Contact: Tianhao <tizhao>
Severity: urgent Docs Contact:
Priority: urgent    
Version: CentOS StreamCC: bstinson, georg.sauthoff, hroussea, hwkernel-mgr, ivecera, jwboyer, mtesar, tizhao
Target Milestone: rcKeywords: Regression, Triaged
Target Release: ---   
Hardware: Unspecified   
OS: Linux   
Whiteboard:
Fixed In Version: ethtool-5.13-2.el8 Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2022-11-08 10:53:39 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Attachments:
Description Flags
Package with proposed fixes none

Description Daniel Juarez 2022-04-29 15:28:24 UTC 
Description of problem:

We have noticed a regression when comparing the ethtool output of the following command between RHEL8.5 and CentOS Stream 8 (4.18.0-365.el8.x86_64),

On nodes equipped with Mellanox ConnectX-4 NICs (using mlx5_core module), the EEPROM displaying feature of ethtool was working fine with RHEL8.5. On the other hand it stopped reporting the DDM/DOM data of the optical module when running CentOS8 Stream (with 4.18.0-365.el8.x86_64)

Please see the following differences between RH8.5 and CS8, as output of ethtool -m" on CS8 is not reporting all data.

RHEL 8.5:

```
# ethtool -i enp34s0f0
driver: mlx5_core
version: 4.18.0-348.23.1.el8_5.x86_64
firmware-version: 14.29.1016 (SM_2111000001034)
expansion-rom-version:
bus-info: 0000:22:00.0
supports-statistics: yes
supports-test: yes
supports-eeprom-access: no
supports-register-dump: no
supports-priv-flags: yes
# rpm -q ethtool
ethtool-5.8-7.el8.x86_64
# uname -r
4.18.0-348.23.1.el8_5.x86_64
# cat /etc/os-release
NAME="Red Hat Enterprise Linux"
VERSION="8.5 (Ootpa)"
ID="rhel"
ID_LIKE="fedora"
VERSION_ID="8.5"
PLATFORM_ID="platform:el8"
PRETTY_NAME="Red Hat Enterprise Linux 8.5 (Ootpa)"
ANSI_COLOR="0;31"
CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos"
HOME_URL="https://www.redhat.com/"
DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/"
BUG_REPORT_URL="https://bugzilla.redhat.com/"

REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8"
REDHAT_BUGZILLA_PRODUCT_VERSION=8.5
REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux"
REDHAT_SUPPORT_PRODUCT_VERSION="8.5"



# ethtool -m enp34s0f0                                                                                                                                                                                                                                                            [4/485]
        Identifier                                : 0x03 (SFP)
        Extended identifier                       : 0x04 (GBIC/SFP defined by 2-wire interface ID)
        Connector                                 : 0x07 (LC)
        Transceiver codes                         : 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x02
        Transceiver type                          : Extended: 100G Base-SR4 or 25GBase-SR
        Encoding                                  : 0x06 (64B/66B)
        BR, Nominal                               : 25750MBd
        Rate identifier                           : 0x00 (unspecified)
        Length (SMF,km)                           : 0km
        Length (SMF)                              : 0m
        Length (50um)                             : 0m
        Length (62.5um)                           : 0m
        Length (Copper)                           : 10m
        Length (OM3)                              : 70m
        Laser wavelength                          : 850nm
        Vendor name                               : Mellanox
        Vendor OUI                                : 00:02:c9
        Vendor PN                                 : MMA2P00-AS
        Vendor rev                                : A5
        Option values                             : 0x18 0x3a
        Option                                    : RX_LOS implemented
        Option                                    : TX_FAULT implemented
        Option                                    : TX_DISABLE implemented
        Option                                    : RATE_SELECT implemented
        Option                                    : Retimer or CDR implemented
        Option                                    : Paging implemented
        BR margin, max                            : 0%
        BR margin, min                            : 0%
        Vendor SN                                 : MT2133FT01654
        Date code                                 : 210809
        Optical diagnostics support               : Yes
        Laser bias current                        : 6.750 mA
        Laser output power                        : 0.7766 mW / -1.10 dBm
        Receiver signal average optical power     : 0.8142 mW / -0.89 dBm
        Module temperature                        : 58.56 degrees C / 137.41 degrees F
        Module voltage                            : 3.2923 V
        Alarm/warning flags implemented           : Yes
        Laser bias current high alarm             : Off
        Laser bias current low alarm              : Off
        Laser bias current high warning           : Off
        Laser bias current low warning            : Off
        Laser output power high alarm             : Off
        Laser output power low alarm              : Off
        Laser output power high warning           : Off
        Laser output power low warning            : Off
        Module temperature high alarm             : Off
        Module temperature low alarm              : Off
        Module temperature high warning           : Off
        Module temperature low warning            : Off
        Module voltage high alarm                 : Off
        Module voltage low alarm                  : Off
        Module voltage high warning               : Off
        Module voltage low warning                : Off
        Laser rx power high alarm                 : Off
        Laser rx power low alarm                  : Off
        Laser rx power high warning               : Off
        Laser rx power low warning                : Off
        Laser bias current high alarm threshold   : 8.500 mA
        Laser bias current low alarm threshold    : 5.492 mA
        Laser bias current high warning threshold : 8.000 mA
        Laser bias current low warning threshold  : 6.000 mA
        Laser output power high alarm threshold   : 3.4673 mW / 5.40 dBm
        Laser output power low alarm threshold    : 0.0724 mW / -11.40 dBm
        Laser output power high warning threshold : 1.7378 mW / 2.40 dBm
        Laser output power low warning threshold  : 0.1445 mW / -8.40 dBm
        Module temperature high alarm threshold   : 80.00 degrees C / 176.00 degrees F
        Module temperature low alarm threshold    : -10.00 degrees C / 14.00 degrees F
        Module temperature high warning threshold : 70.00 degrees C / 158.00 degrees F
        Module temperature low warning threshold  : 0.00 degrees C / 32.00 degrees F
        Module voltage high alarm threshold       : 3.5000 V
        Module voltage low alarm threshold        : 3.1000 V
        Module voltage high warning threshold     : 3.4650 V
        Module voltage low warning threshold      : 3.1350 V
        Laser rx power high alarm threshold       : 3.4673 mW / 5.40 dBm
        Laser rx power low alarm threshold        : 0.0467 mW / -13.31 dBm
        Laser rx power high warning threshold     : 1.7378 mW / 2.40 dBm
        Laser rx power low warning threshold      : 0.0933 mW / -10.30 dBm
```

CentOS Stream 8:
```
# ethtool -i eth1
driver: mlx5_core
version: 4.18.0-365.el8.x86_64
firmware-version: 14.29.1016 (SM_2111000001034)
expansion-rom-version:
bus-info: 0000:22:00.0
supports-statistics: yes
supports-test: yes
supports-eeprom-access: no
supports-register-dump: no
supports-priv-flags: yes
# rpm -q ethtool
ethtool-5.13-1.el8.x86_64
# uname -r
4.18.0-365.el8.x86_64
# cat /etc/os-release
NAME="CentOS Stream"
VERSION="8"
ID="centos"
ID_LIKE="rhel fedora"
VERSION_ID="8"
PLATFORM_ID="platform:el8"
PRETTY_NAME="CentOS Stream 8"
ANSI_COLOR="0;31"
CPE_NAME="cpe:/o:centos:centos:8"
HOME_URL="https://centos.org/"
BUG_REPORT_URL="https://bugzilla.redhat.com/"
REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8"
REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream"



$ ethtool -m eth1
        Identifier                                : 0x03 (SFP)
        Extended identifier                       : 0x04 (GBIC/SFP defined by 2-wire interface ID)
        Connector                                 : 0x07 (LC)
        Transceiver codes                         : 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x00 0x02
        Transceiver type                          : Extended: 100G Base-SR4 or 25GBase-SR
        Encoding                                  : 0x06 (64B/66B)
        BR, Nominal                               : 25750MBd
        Rate identifier                           : 0x00 (unspecified)
        Length (SMF,km)                           : 0km
        Length (SMF)                              : 0m
        Length (50um)                             : 0m
        Length (62.5um)                           : 0m
        Length (Copper)                           : 10m
        Length (OM3)                              : 70m
        Laser wavelength                          : 850nm
        Vendor name                               : Mellanox
        Vendor OUI                                : 00:02:c9
        Vendor PN                                 : MMA2P00-AS
        Vendor rev                                : A5
        Option values                             : 0x18 0x3a
        Option                                    : RX_LOS implemented
        Option                                    : TX_FAULT implemented
        Option                                    : TX_DISABLE implemented
        Option                                    : RATE_SELECT implemented
        Option                                    : Retimer or CDR implemented
        Option                                    : Paging implemented
        BR margin, max                            : 0%
        BR margin, min                            : 0%
        Vendor SN                                 : MT2133FT01654
        Date code                                 : 210809
```


Additional info:

Could it be related to https://bugzilla.redhat.com/show_bug.cgi?id=2024683 and the referenced private bugzilla https://bugzilla.redhat.com/show_bug.cgi?id=2019090 ? It seems like a good starting point.

For the record, downgrading the ethtool RPM to the previous version it works fine on CentOS Stream 8, so I'd say it is probably self contained on the tool itself and not related to the kernel differences.
Comment 1 Ivan Vecera 2022-06-02 18:28:43 UTC 
Created attachment 1886153 [details]
Package with proposed fixes

Daniel, could you please verify this ethtool package that it fixes the issue?
Comment 2 Daniel Juarez 2022-06-09 07:55:58 UTC 
Sorry for the late response, I am waiting for internal feedback for this new package.
Comment 3 Daniel Juarez 2022-06-14 14:58:08 UTC 
All working as expected with the new provided version, thank you very much.
Comment 15 errata-xmlrpc 2022-11-08 10:53:39 UTC 
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (ethtool bug fix and enhancement update), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHBA-2022:7765