2166805 – [PES] After upgrade system from RHEL8 to RHEL9 with Leapp, NICs of driver nfp disappear

This bug has been migrated to another issue tracking site. It has been closed here and may no longer be being monitored.

If you would like to get updates for this issue, or to participate in it, you may do so at Red Hat Issue Tracker .

RHEL Engineering is moving the tracking of its product development work on RHEL 6 through RHEL 9 to Red Hat Jira (issues.redhat.com). If you're a Red Hat customer, please continue to file support cases via the Red Hat customer portal. If you're not, please head to the "RHEL project" in Red Hat Jira and file new tickets here. Individual Bugzilla bugs in the statuses "NEW", "ASSIGNED", and "POST" are being migrated throughout September 2023. Bugs of Red Hat partners with an assigned Engineering Partner Manager (EPM) are migrated in late September as per pre-agreed dates. Bugs against components "kernel", "kernel-rt", and "kpatch" are only migrated if still in "NEW" or "ASSIGNED". If you cannot log in to RH Jira, please consult article #7032570. That failing, please send an e-mail to the RH Jira admins at rh-issues@redhat.com to troubleshoot your issue as a user management inquiry. The email creates a ServiceNow ticket with Red Hat. Individual Bugzilla bugs that are migrated will be moved to status "CLOSED", resolution "MIGRATED", and set with "MigratedToJIRA" in "Keywords". The link to the successor Jira issue will be found under "Links", have a little "two-footprint" icon next to it, and direct you to the "RHEL project" in Red Hat Jira (issue links are of type "https://issues.redhat.com/browse/RHEL-XXXX", where "X" is a digit). This same link will be available in a blue banner at the top of the page informing you that that bug has been migrated.

Bug 2166805 - [PES] After upgrade system from RHEL8 to RHEL9 with Leapp, NICs of driver nfp disappear

Summary: [PES] After upgrade system from RHEL8 to RHEL9 with Leapp, NICs of driver nfp...

Keywords:
Status:	CLOSED MIGRATED
Alias:	None
Product:	Red Hat Enterprise Linux 8
Classification:	Red Hat
Component:	kernel
Sub Component:
Version:	8.8
Hardware:	x86_64
OS:	Linux
Priority:	unspecified
Severity:	high
Target Milestone:	rc
Target Release:	---
Assignee:	Stefan Assmann
QA Contact:	xudu
Docs Contact:
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+	depends on / blocked

Reported:	2023-02-03 02:32 UTC by xudu
Modified:	2023-09-21 18:12 UTC (History)
CC List:	10 users (show)
Fixed In Version:
Doc Type:	If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed:	2023-09-21 18:12:15 UTC
Type:	Bug
Target Upstream Version:
Embargoed:
Dependent Products:
Flags:	pm-rhel: mirror+

Attachments	(Terms of Use)

Links
System	ID	Private	Priority	Status	Summary	Last Updated
Red Hat Issue Tracker	RHEL-6493	0	None	Migrated	None	2023-09-21 18:12:10 UTC
Red Hat Issue Tracker	RHELPLAN-147526	0	None	None	None	2023-02-03 02:35:23 UTC

Description xudu 2023-02-03 02:32:59 UTC

Description of problem:
After upgrade system from RHEL8 to RHEL9 with Leapp, NICs of driver nfp disappear.

Version-Release number of selected component (if applicable):
kernel: 4.18.0-449.el8.x86_64

driver:
ethtool -i ens2np1
driver: nfp
version: 4.18.0-456.el8.x86_64 SMP mod_u
firmware-version: 0.0.3.5 0.22 sriov-2.1.16.1 nic
expansion-rom-version: 
bus-info: 0000:17:00.0
supports-statistics: yes
supports-test: no
supports-eeprom-access: no
supports-register-dump: yes
supports-priv-flags: no

Beaker Test information:
   HOSTNAME=dell-per750-34.rhts.eng.pek2.redhat.com
   JOBID=7437351
   RECIPEID=13239918
   RESULT_SERVER=
   DISTRO=RHEL-8.8.0-20230114.0
   ARCHITECTURE=x86_64

How reproducible:
always

Steps to Reproduce:
1. Install Distro, collect NICs information

1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever
2: eno8303: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
    link/ether ec:2a:72:19:65:46 brd ff:ff:ff:ff:ff:ff
    altname enp4s0f0
    inet 10.73.89.64/23 brd 10.73.89.255 scope global dynamic noprefixroute eno8303
       valid_lft 43200sec preferred_lft 43200sec
    inet6 2620:52:0:4958:ee2a:72ff:fe19:6546/64 scope global dynamic noprefixroute 
       valid_lft 2591928sec preferred_lft 604728sec
    inet6 fe80::ee2a:72ff:fe19:6546/64 scope link noprefixroute 
       valid_lft forever preferred_lft forever
3: eno8403: <BROADCAST,MULTICAST> mtu 1500 qdisc mq state DOWN group default qlen 1000
    link/ether ec:2a:72:19:65:47 brd ff:ff:ff:ff:ff:ff
    altname enp4s0f1
4: eno12399: <BROADCAST,MULTICAST> mtu 1500 qdisc mq state DOWN group default qlen 1000
    link/ether e4:3d:1a:63:2f:08 brd ff:ff:ff:ff:ff:ff
    altname enp50s0f0
5: eno12409: <BROADCAST,MULTICAST> mtu 1500 qdisc mq state DOWN group default qlen 1000
    link/ether e4:3d:1a:63:2f:09 brd ff:ff:ff:ff:ff:ff
    altname enp50s0f1
6: eno12419: <BROADCAST,MULTICAST> mtu 1500 qdisc mq state DOWN group default qlen 1000
    link/ether e4:3d:1a:63:2f:0a brd ff:ff:ff:ff:ff:ff
    altname enp51s0f0
7: eno12429: <BROADCAST,MULTICAST> mtu 1500 qdisc mq state DOWN group default qlen 1000
    link/ether e4:3d:1a:63:2f:0b brd ff:ff:ff:ff:ff:ff
    altname enp51s0f1
8: ens5f0: <BROADCAST,MULTICAST> mtu 1500 qdisc mq state DOWN group default qlen 1000
    link/ether f4:e9:d4:ed:cf:18 brd ff:ff:ff:ff:ff:ff
    altname enp177s0f0
9: ens5f1: <BROADCAST,MULTICAST> mtu 1500 qdisc mq state DOWN group default qlen 1000
    link/ether f4:e9:d4:ed:cf:19 brd ff:ff:ff:ff:ff:ff
    altname enp177s0f1
12: ens2np0: <BROADCAST,MULTICAST> mtu 1500 qdisc mq state DOWN group default qlen 1000
    link/ether 00:15:4d:13:5f:0c brd ff:ff:ff:ff:ff:ff
    altname enp23s0np0
13: ens2np1: <BROADCAST,MULTICAST> mtu 1500 qdisc mq state DOWN group default qlen 1000
    link/ether 00:15:4d:13:5f:0d brd ff:ff:ff:ff:ff:ff
    altname enp23s0np1

2. Upgrade to RHEL9 with leapp, and kernel has upgraded to 5.14.0-235.el9.x86_64.

3. After upgrading success, collect NICs information.

1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever
2: eno8303: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
    link/ether ec:2a:72:19:65:46 brd ff:ff:ff:ff:ff:ff
    altname enp4s0f0
    inet 10.73.89.64/23 brd 10.73.89.255 scope global dynamic noprefixroute eno8303
       valid_lft 43098sec preferred_lft 43098sec
    inet6 2620:52:0:4958:ee2a:72ff:fe19:6546/64 scope global dynamic noprefixroute 
       valid_lft 2591998sec preferred_lft 604798sec
    inet6 fe80::ee2a:72ff:fe19:6546/64 scope link noprefixroute 
       valid_lft forever preferred_lft forever
3: eno8403: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000
    link/ether ec:2a:72:19:65:47 brd ff:ff:ff:ff:ff:ff
    altname enp4s0f1
4: eno12399: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000
    link/ether e4:3d:1a:63:2f:08 brd ff:ff:ff:ff:ff:ff
    altname enp50s0f0
5: eno12409: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000
    link/ether e4:3d:1a:63:2f:09 brd ff:ff:ff:ff:ff:ff
    altname enp50s0f1
6: eno12419: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000
    link/ether e4:3d:1a:63:2f:0a brd ff:ff:ff:ff:ff:ff
    altname enp51s0f0
7: eno12429: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000
    link/ether e4:3d:1a:63:2f:0b brd ff:ff:ff:ff:ff:ff
    altname enp51s0f1
8: ens5f0: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000
    link/ether f4:e9:d4:ed:cf:18 brd ff:ff:ff:ff:ff:ff
    altname enp177s0f0
9: ens5f1: <BROADCAST,MULTICAST> mtu 1500 qdisc noop state DOWN group default qlen 1000
    link/ether f4:e9:d4:ed:cf:19 brd ff:ff:ff:ff:ff:ff
    altname enp177s0f1


Actual results:
ens2np0/ens2np1 disappear.

Expected results:
All of NICs still exist and name is not changed after upgrading.

Additional info:

Comment 2 Stefan Assmann 2023-02-10 11:50:44 UTC

I don't know what leapp is or where to get it from. Can you please explain?

As a start I'd like to compare full dmesg of RHEL8 against full dmesg of RHEL9.
Please attach both to the BZ.
Thanks!

Comment 3 xudu 2023-02-13 08:15:25 UTC

Leapp is a tool that could upgrade distro one key, after the system upgrade we want to have the same NIC name between two distros.
Firstly, install the system by DISTRO RHEL-8.8.0-20230114.0, 
then execute  "leapp upgrade --debug --no-rhsm --enablerepo AppStream --enablerepo BaseOS --distroenablerepo beaker-harness" to upgrade system, 
lastly, the system has upgraded to RHEL-9.0, and we will check whether NIC information is consistent.
The current issue is that there is ens2np0(nfp driver) in RHEL8, but after updating through leapp, ens2np0 is not present in RHEL9.

Comment 4 Stefan Assmann 2023-02-13 08:37:06 UTC

Please provide the logs.

Comment 5 xudu 2023-02-13 09:25:07 UTC

r750-34 ~]# ls
anaconda-ks.cfg  my-ks-post.log  NETBOOT_METHOD.TXT  original-ks.cfg  RECIPE.TXT  tmp_leapp_py3
[root@dell-per750-34 ~]# dmesg 
[    0.000000] microcode: microcode updated early to revision 0xd000375, date = 2022-04-07
[    0.000000] Linux version 5.14.0-252.el9.x86_64 (mockbuild.eng.bos.redhat.com) (gcc (GCC) 11.3.1 20221121 (Red Hat 11.3.1-4), GNU ld version 2.35.2-35.el9) #1 SMP PREEMPT_DYNAMIC Wed Feb 1 09:46:00 EST 2023
[    0.000000] The list of certified hardware and cloud instances for Red Hat Enterprise Linux 9 can be viewed at the Red Hat Ecosystem Catalog, https://catalog.redhat.com.
[    0.000000] Command line: BOOT_IMAGE=(hd0,msdos1)/vmlinuz-5.14.0-252.el9.x86_64 root=/dev/mapper/rhel_dell--per750--34-root ro intel_iommu=on ksdevice=bootif resume=/dev/mapper/rhel_dell--per750--34-swap rd.lvm.lv=rhel_dell-per750-34/root rd.lvm.lv=rhel_dell-per750-34/swap console=ttyS0,115200n81 rd.plymouth=0 plymouth.enable=0 crashkernel=1G-4G:192M,4G-64G:256M,64G-:512M
[    0.000000] x86/split lock detection: #AC: crashing the kernel on kernel split_locks and warning on user-space split_locks
[    0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'
[    0.000000] x86/fpu: xstate_offset[2]:  576, xstate_sizes[2]:  256
[    0.000000] x86/fpu: xstate_offset[5]:  832, xstate_sizes[5]:   64
[    0.000000] x86/fpu: xstate_offset[6]:  896, xstate_sizes[6]:  512
[    0.000000] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024
[    0.000000] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]:    8
[    0.000000] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.
[    0.000000] signal: max sigframe size: 3632
[    0.000000] BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009bfff] usable
[    0.000000] BIOS-e820: [mem 0x000000000009c000-0x000000000009ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000420f1fff] usable
[    0.000000] BIOS-e820: [mem 0x00000000420f2000-0x000000004a0fafff] reserved
[    0.000000] BIOS-e820: [mem 0x000000004a0fb000-0x000000004a6dbfff] usable
[    0.000000] BIOS-e820: [mem 0x000000004a6dc000-0x000000004b6dbfff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x000000004b6dc000-0x000000004c240fff] usable
[    0.000000] BIOS-e820: [mem 0x000000004c241000-0x000000004c346fff] reserved
[    0.000000] BIOS-e820: [mem 0x000000004c347000-0x000000004d800fff] usable
[    0.000000] BIOS-e820: [mem 0x000000004d801000-0x000000004d804fff] reserved
[    0.000000] BIOS-e820: [mem 0x000000004d805000-0x0000000051afefff] usable
[    0.000000] BIOS-e820: [mem 0x0000000051aff000-0x0000000051b00fff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000051b01000-0x000000005eefdfff] usable
[    0.000000] BIOS-e820: [mem 0x000000005eefe000-0x000000006e3fefff] reserved
[    0.000000] BIOS-e820: [mem 0x000000006e3ff000-0x000000006f3fefff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x000000006f3ff000-0x000000006f7fefff] ACPI data
[    0.000000] BIOS-e820: [mem 0x000000006f7ff000-0x000000006f7fffff] usable
[    0.000000] BIOS-e820: [mem 0x000000006f800000-0x000000008fffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fd000000-0x00000000fe7fffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fec00000-0x00000000fec00fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fec80000-0x00000000fed00fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed40000-0x00000000fed44fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000207fffffff] usable
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] SMBIOS 3.3 present.
[    0.000000] DMI: Dell Inc. PowerEdge R750/0WT8Y6, BIOS 1.5.4 12/17/2021
[    0.000000] tsc: Detected 2900.000 MHz processor
[    0.001004] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved
[    0.001010] e820: remove [mem 0x000a0000-0x000fffff] usable
[    0.001031] last_pfn = 0x2080000 max_arch_pfn = 0x10000000000
[    0.001340] x86/PAT: Configuration [0-7]: WB  WC  UC- UC  WB  WP  UC- WT  
[    0.004385] total RAM covered: 260080M
[    0.004588] Found optimal setting for mtrr clean up
[    0.004589]  gran_size: 64K 	chunk_size: 32M 	num_reg: 8  	lose cover RAM: 0G
[    0.004993] e820: update [mem 0x7f000000-0xffffffff] usable ==> reserved
[    0.004996] x2apic: enabled by BIOS, switching to x2apic ops
[    0.004997] last_pfn = 0x6f800 max_arch_pfn = 0x10000000000
[    0.014162] Using GB pages for direct mapping
[    0.014802] RAMDISK: [mem 0x337b7000-0x35bd3fff]
[    0.014806] ACPI: Early table checksum verification disabled
[    0.014808] ACPI: RSDP 0x00000000000FE320 000024 (v02 DELL  )
[    0.014811] ACPI: XSDT 0x000000006F55C188 0000DC (v01 DELL   PE_SC3   00000000 DELL 01000013)
[    0.014815] ACPI: FACP 0x000000006F7F5000 000114 (v06 DELL   PE_SC3   00000000 DELL 00000001)
[    0.014820] ACPI: DSDT 0x000000006F76F000 07FAD3 (v02 DELL   PE_SC3   00000003 DELL 00000001)
[    0.014822] ACPI: FACS 0x000000006F363000 000040
[    0.014824] ACPI: SSDT 0x000000006F7FB000 001571 (v02 INTEL  RAS_ACPI 00000001 INTL 20210331)
[    0.014827] ACPI: SSDT 0x000000006F7FA000 000745 (v02 INTEL  ADDRXLAT 00000001 INTL 20210331)
[    0.014829] ACPI: MCEJ 0x000000006F7F9000 000130 (v01 INTEL           00000001 INTL 0100000D)
[    0.014832] ACPI: EINJ 0x000000006F7F8000 000150 (v01 DELL   PE_SC3   00000001 INTL 00000001)
[    0.014834] ACPI: BERT 0x000000006F7F7000 000030 (v01 DELL   PE_SC3   00000001 INTL 00000001)
[    0.014836] ACPI: ERST 0x000000006F7F6000 000230 (v01 DELL   PE_SC3   00000001 INTL 00000001)
[    0.014838] ACPI: HMAT 0x000000006F7F4000 000180 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.014841] ACPI: HPET 0x000000006F7F3000 000038 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.014843] ACPI: MCFG 0x000000006F7F2000 00003C (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.014845] ACPI: MIGT 0x000000006F7F1000 000040 (v01 DELL   PE_SC3   00000000 DELL 00000001)
[    0.014847] ACPI: MSCT 0x000000006F7F0000 000090 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.014850] ACPI: WSMT 0x000000006F7EF000 000028 (v01 DELL   PE_SC3   00000000 DELL 00000001)
[    0.014852] ACPI: APIC 0x000000006F76E000 00045E (v04 DELL   PE_SC3   00000000 DELL 00000001)
[    0.014854] ACPI: SLIT 0x000000006F76D000 000030 (v01 DELL   PE_SC3   00000001 DELL 01000013)
[    0.014856] ACPI: SRAT 0x000000006F766000 006430 (v03 DELL   PE_SC3   00000002 DELL 01000013)
[    0.014859] ACPI: OEM4 0x000000006F5DE000 187A61 (v02 INTEL  CPU  CST 00003000 INTL 20210331)
[    0.014861] ACPI: SSDT 0x000000006F567000 0764A5 (v02 INTEL  SSDT  PM 00004000 INTL 20210331)
[    0.014863] ACPI: SSDT 0x000000006F566000 000A1F (v02 DELL   PE_SC3   00000000 DELL 00000001)
[    0.014866] ACPI: HEST 0x000000006F565000 00017C (v01 DELL   PE_SC3   00000001 INTL 00000001)
[    0.014868] ACPI: SSDT 0x000000006F55D000 007299 (v02 INTEL  SpsNm    00000002 INTL 20210331)
[    0.014870] ACPI: SSDT 0x000000006F55A000 00113E (v02 DELL   PE_SC3   00000002 DELL 00000001)
[    0.014872] ACPI: DMAR 0x000000006F7FD000 000272 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.014874] ACPI: Reserving FACP table memory at [mem 0x6f7f5000-0x6f7f5113]
[    0.014875] ACPI: Reserving DSDT table memory at [mem 0x6f76f000-0x6f7eead2]
[    0.014876] ACPI: Reserving FACS table memory at [mem 0x6f363000-0x6f36303f]
[    0.014876] ACPI: Reserving SSDT table memory at [mem 0x6f7fb000-0x6f7fc570]
[    0.014877] ACPI: Reserving SSDT table memory at [mem 0x6f7fa000-0x6f7fa744]
[    0.014877] ACPI: Reserving MCEJ table memory at [mem 0x6f7f9000-0x6f7f912f]
[    0.014878] ACPI: Reserving EINJ table memory at [mem 0x6f7f8000-0x6f7f814f]
[    0.014878] ACPI: Reserving BERT table memory at [mem 0x6f7f7000-0x6f7f702f]
[    0.014879] ACPI: Reserving ERST table memory at [mem 0x6f7f6000-0x6f7f622f]
[    0.014879] ACPI: Reserving HMAT table memory at [mem 0x6f7f4000-0x6f7f417f]
[    0.014880] ACPI: Reserving HPET table memory at [mem 0x6f7f3000-0x6f7f3037]
[    0.014881] ACPI: Reserving MCFG table memory at [mem 0x6f7f2000-0x6f7f203b]
[    0.014881] ACPI: Reserving MIGT table memory at [mem 0x6f7f1000-0x6f7f103f]
[    0.014882] ACPI: Reserving MSCT table memory at [mem 0x6f7f0000-0x6f7f008f]
[    0.014882] ACPI: Reserving WSMT table memory at [mem 0x6f7ef000-0x6f7ef027]
[    0.014883] ACPI: Reserving APIC table memory at [mem 0x6f76e000-0x6f76e45d]
[    0.014883] ACPI: Reserving SLIT table memory at [mem 0x6f76d000-0x6f76d02f]
[    0.014884] ACPI: Reserving SRAT table memory at [mem 0x6f766000-0x6f76c42f]
[    0.014884] ACPI: Reserving OEM4 table memory at [mem 0x6f5de000-0x6f765a60]
[    0.014885] ACPI: Reserving SSDT table memory at [mem 0x6f567000-0x6f5dd4a4]
[    0.014885] ACPI: Reserving SSDT table memory at [mem 0x6f566000-0x6f566a1e]
[    0.014886] ACPI: Reserving HEST table memory at [mem 0x6f565000-0x6f56517b]
[    0.014887] ACPI: Reserving SSDT table memory at [mem 0x6f55d000-0x6f564298]
[    0.014887] ACPI: Reserving SSDT table memory at [mem 0x6f55a000-0x6f55b13d]
[    0.014888] ACPI: Reserving DMAR table memory at [mem 0x6f7fd000-0x6f7fd271]
[    0.014897] Setting APIC routing to cluster x2apic.
[    0.014929] SRAT: PXM 0 -> APIC 0x0000 -> Node 0
[    0.014930] SRAT: PXM 0 -> APIC 0x0001 -> Node 0
[    0.014931] SRAT: PXM 0 -> APIC 0x0002 -> Node 0
[    0.014931] SRAT: PXM 0 -> APIC 0x0003 -> Node 0
[    0.014932] SRAT: PXM 0 -> APIC 0x0004 -> Node 0
[    0.014932] SRAT: PXM 0 -> APIC 0x0005 -> Node 0
[    0.014932] SRAT: PXM 0 -> APIC 0x0006 -> Node 0
[    0.014933] SRAT: PXM 0 -> APIC 0x0007 -> Node 0
[    0.014933] SRAT: PXM 0 -> APIC 0x0008 -> Node 0
[    0.014934] SRAT: PXM 0 -> APIC 0x0009 -> Node 0
[    0.014934] SRAT: PXM 0 -> APIC 0x000a -> Node 0
[    0.014935] SRAT: PXM 0 -> APIC 0x000b -> Node 0
[    0.014935] SRAT: PXM 0 -> APIC 0x000c -> Node 0
[    0.014936] SRAT: PXM 0 -> APIC 0x000d -> Node 0
[    0.014936] SRAT: PXM 0 -> APIC 0x000e -> Node 0
[    0.014936] SRAT: PXM 0 -> APIC 0x000f -> Node 0
[    0.014937] SRAT: PXM 0 -> APIC 0x0010 -> Node 0
[    0.014937] SRAT: PXM 0 -> APIC 0x0011 -> Node 0
[    0.014938] SRAT: PXM 0 -> APIC 0x0012 -> Node 0
[    0.014938] SRAT: PXM 0 -> APIC 0x0013 -> Node 0
[    0.014939] SRAT: PXM 0 -> APIC 0x0014 -> Node 0
[    0.014939] SRAT: PXM 0 -> APIC 0x0015 -> Node 0
[    0.014940] SRAT: PXM 0 -> APIC 0x0016 -> Node 0
[    0.014940] SRAT: PXM 0 -> APIC 0x0017 -> Node 0
[    0.014940] SRAT: PXM 0 -> APIC 0x0018 -> Node 0
[    0.014941] SRAT: PXM 0 -> APIC 0x0019 -> Node 0
[    0.014941] SRAT: PXM 0 -> APIC 0x001a -> Node 0
[    0.014942] SRAT: PXM 0 -> APIC 0x001b -> Node 0
[    0.014942] SRAT: PXM 0 -> APIC 0x001c -> Node 0
[    0.014943] SRAT: PXM 0 -> APIC 0x001d -> Node 0
[    0.014943] SRAT: PXM 0 -> APIC 0x001e -> Node 0
[    0.014943] SRAT: PXM 0 -> APIC 0x001f -> Node 0
[    0.014944] SRAT: PXM 1 -> APIC 0x0040 -> Node 1
[    0.014944] SRAT: PXM 1 -> APIC 0x0041 -> Node 1
[    0.014945] SRAT: PXM 1 -> APIC 0x0042 -> Node 1
[    0.014945] SRAT: PXM 1 -> APIC 0x0043 -> Node 1
[    0.014946] SRAT: PXM 1 -> APIC 0x0044 -> Node 1
[    0.014946] SRAT: PXM 1 -> APIC 0x0045 -> Node 1
[    0.014947] SRAT: PXM 1 -> APIC 0x0046 -> Node 1
[    0.014947] SRAT: PXM 1 -> APIC 0x0047 -> Node 1
[    0.014947] SRAT: PXM 1 -> APIC 0x0048 -> Node 1
[    0.014948] SRAT: PXM 1 -> APIC 0x0049 -> Node 1
[    0.014948] SRAT: PXM 1 -> APIC 0x004a -> Node 1
[    0.014949] SRAT: PXM 1 -> APIC 0x004b -> Node 1
[    0.014949] SRAT: PXM 1 -> APIC 0x004c -> Node 1
[    0.014950] SRAT: PXM 1 -> APIC 0x004d -> Node 1
[    0.014950] SRAT: PXM 1 -> APIC 0x004e -> Node 1
[    0.014950] SRAT: PXM 1 -> APIC 0x004f -> Node 1
[    0.014951] SRAT: PXM 1 -> APIC 0x0050 -> Node 1
[    0.014951] SRAT: PXM 1 -> APIC 0x0051 -> Node 1
[    0.014952] SRAT: PXM 1 -> APIC 0x0052 -> Node 1
[    0.014952] SRAT: PXM 1 -> APIC 0x0053 -> Node 1
[    0.014953] SRAT: PXM 1 -> APIC 0x0054 -> Node 1
[    0.014953] SRAT: PXM 1 -> APIC 0x0055 -> Node 1
[    0.014953] SRAT: PXM 1 -> APIC 0x0056 -> Node 1
[    0.014954] SRAT: PXM 1 -> APIC 0x0057 -> Node 1
[    0.014954] SRAT: PXM 1 -> APIC 0x0058 -> Node 1
[    0.014955] SRAT: PXM 1 -> APIC 0x0059 -> Node 1
[    0.014955] SRAT: PXM 1 -> APIC 0x005a -> Node 1
[    0.014956] SRAT: PXM 1 -> APIC 0x005b -> Node 1
[    0.014956] SRAT: PXM 1 -> APIC 0x005c -> Node 1
[    0.014957] SRAT: PXM 1 -> APIC 0x005d -> Node 1
[    0.014957] SRAT: PXM 1 -> APIC 0x005e -> Node 1
[    0.014957] SRAT: PXM 1 -> APIC 0x005f -> Node 1
[    0.014974] ACPI: SRAT: Node 0 PXM 0 [mem 0x00000000-0x7fffffff]
[    0.014975] ACPI: SRAT: Node 0 PXM 0 [mem 0x100000000-0x107fffffff]
[    0.014976] ACPI: SRAT: Node 1 PXM 1 [mem 0x1080000000-0x207fffffff]
[    0.014985] NUMA: Initialized distance table, cnt=2
[    0.014988] NUMA: Node 0 [mem 0x00000000-0x7fffffff] + [mem 0x100000000-0x107fffffff] -> [mem 0x00000000-0x107fffffff]
[    0.014996] NODE_DATA(0) allocated [mem 0x107ffd5000-0x107fffffff]
[    0.015009] NODE_DATA(1) allocated [mem 0x207ffd1000-0x207fffbfff]
[    0.015196] Reserving 512MB of memory at 304MB for crashkernel (System RAM: 130397MB)
[    0.015503] Zone ranges:
[    0.015504]   DMA      [mem 0x0000000000001000-0x0000000000ffffff]
[    0.015505]   DMA32    [mem 0x0000000001000000-0x00000000ffffffff]
[    0.015506]   Normal   [mem 0x0000000100000000-0x000000207fffffff]
[    0.015507]   Device   empty
[    0.015508] Movable zone start for each node
[    0.015511] Early memory node ranges
[    0.015511]   node   0: [mem 0x0000000000001000-0x000000000009bfff]
[    0.015512]   node   0: [mem 0x0000000000100000-0x00000000420f1fff]
[    0.015513]   node   0: [mem 0x000000004a0fb000-0x000000004a6dbfff]
[    0.015514]   node   0: [mem 0x000000004b6dc000-0x000000004c240fff]
[    0.015514]   node   0: [mem 0x000000004c347000-0x000000004d800fff]
[    0.015515]   node   0: [mem 0x000000004d805000-0x0000000051afefff]
[    0.015515]   node   0: [mem 0x0000000051b01000-0x000000005eefdfff]
[    0.015516]   node   0: [mem 0x000000006f7ff000-0x000000006f7fffff]
[    0.015516]   node   0: [mem 0x0000000100000000-0x000000107fffffff]
[    0.015520]   node   1: [mem 0x0000001080000000-0x000000207fffffff]
[    0.015525] Initmem setup node 0 [mem 0x0000000000001000-0x000000107fffffff]
[    0.015528] Initmem setup node 1 [mem 0x0000001080000000-0x000000207fffffff]
[    0.015530] On node 0, zone DMA: 1 pages in unavailable ranges
[    0.015555] On node 0, zone DMA: 100 pages in unavailable ranges
[    0.017180] On node 0, zone DMA32: 32777 pages in unavailable ranges
[    0.017232] On node 0, zone DMA32: 4096 pages in unavailable ranges
[    0.017264] On node 0, zone DMA32: 262 pages in unavailable ranges
[    0.017358] On node 0, zone DMA32: 4 pages in unavailable ranges
[    0.017676] On node 0, zone DMA32: 2 pages in unavailable ranges
[    0.017971] On node 0, zone DMA32: 35073 pages in unavailable ranges
[    0.018219] On node 0, zone Normal: 2048 pages in unavailable ranges
[    0.018609] ACPI: PM-Timer IO Port: 0x508
[    0.018620] ACPI: X2APIC_NMI (uid[0xffffffff] high edge lint[0x1])
[    0.018622] ACPI: LAPIC_NMI (acpi_id[0xff] high edge lint[0x1])
[    0.018639] IOAPIC[0]: apic_id 8, version 32, address 0xfec00000, GSI 0-119
[    0.018642] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.018643] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    0.018647] ACPI: Using ACPI (MADT) for SMP configuration information
[    0.018648] ACPI: HPET id: 0x8086a701 base: 0xfed00000
[    0.018651] TSC deadline timer available
[    0.018652] smpboot: Allowing 64 CPUs, 0 hotplug CPUs
[    0.018672] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]
[    0.018674] PM: hibernation: Registered nosave memory: [mem 0x0009c000-0x0009ffff]
[    0.018675] PM: hibernation: Registered nosave memory: [mem 0x000a0000-0x000dffff]
[    0.018675] PM: hibernation: Registered nosave memory: [mem 0x000e0000-0x000fffff]
[    0.018676] PM: hibernation: Registered nosave memory: [mem 0x420f2000-0x4a0fafff]
[    0.018677] PM: hibernation: Registered nosave memory: [mem 0x4a6dc000-0x4b6dbfff]
[    0.018679] PM: hibernation: Registered nosave memory: [mem 0x4c241000-0x4c346fff]
[    0.018680] PM: hibernation: Registered nosave memory: [mem 0x4d801000-0x4d804fff]
[    0.018681] PM: hibernation: Registered nosave memory: [mem 0x51aff000-0x51b00fff]
[    0.018682] PM: hibernation: Registered nosave memory: [mem 0x5eefe000-0x6e3fefff]
[    0.018683] PM: hibernation: Registered nosave memory: [mem 0x6e3ff000-0x6f3fefff]
[    0.018683] PM: hibernation: Registered nosave memory: [mem 0x6f3ff000-0x6f7fefff]
[    0.018684] PM: hibernation: Registered nosave memory: [mem 0x6f800000-0x8fffffff]
[    0.018685] PM: hibernation: Registered nosave memory: [mem 0x90000000-0xfcffffff]
[    0.018685] PM: hibernation: Registered nosave memory: [mem 0xfd000000-0xfe7fffff]
[    0.018686] PM: hibernation: Registered nosave memory: [mem 0xfe800000-0xfebfffff]
[    0.018686] PM: hibernation: Registered nosave memory: [mem 0xfec00000-0xfec00fff]
[    0.018686] PM: hibernation: Registered nosave memory: [mem 0xfec01000-0xfec7ffff]
[    0.018687] PM: hibernation: Registered nosave memory: [mem 0xfec80000-0xfed00fff]
[    0.018687] PM: hibernation: Registered nosave memory: [mem 0xfed01000-0xfed3ffff]
[    0.018688] PM: hibernation: Registered nosave memory: [mem 0xfed40000-0xfed44fff]
[    0.018688] PM: hibernation: Registered nosave memory: [mem 0xfed45000-0xfeffffff]
[    0.018689] PM: hibernation: Registered nosave memory: [mem 0xff000000-0xffffffff]
[    0.018690] [mem 0x90000000-0xfcffffff] available for PCI devices
[    0.018691] Booting paravirtualized kernel on bare hardware
[    0.018692] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns
[    0.022794] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:64 nr_cpu_ids:64 nr_node_ids:2
[    0.025211] percpu: Embedded 55 pages/cpu s188416 r8192 d28672 u262144
[    0.025218] pcpu-alloc: s188416 r8192 d28672 u262144 alloc=1*2097152
[    0.025220] pcpu-alloc: [0] 00 02 04 06 08 10 12 14 [0] 16 18 20 22 24 26 28 30 
[    0.025227] pcpu-alloc: [0] 32 34 36 38 40 42 44 46 [0] 48 50 52 54 56 58 60 62 
[    0.025232] pcpu-alloc: [1] 01 03 05 07 09 11 13 15 [1] 17 19 21 23 25 27 29 31 
[    0.025237] pcpu-alloc: [1] 33 35 37 39 41 43 45 47 [1] 49 51 53 55 57 59 61 63 
[    0.025267] Fallback order for Node 0: 0 1 
[    0.025269] Fallback order for Node 1: 1 0 
[    0.025274] Built 2 zonelists, mobility grouping on.  Total pages: 32860018
[    0.025275] Policy zone: Normal
[    0.025276] Kernel command line: BOOT_IMAGE=(hd0,msdos1)/vmlinuz-5.14.0-252.el9.x86_64 root=/dev/mapper/rhel_dell--per750--34-root ro intel_iommu=on ksdevice=bootif resume=/dev/mapper/rhel_dell--per750--34-swap rd.lvm.lv=rhel_dell-per750-34/root rd.lvm.lv=rhel_dell-per750-34/swap console=ttyS0,115200n81 rd.plymouth=0 plymouth.enable=0 crashkernel=1G-4G:192M,4G-64G:256M,64G-:512M
[    0.025316] DMAR: IOMMU enabled
[    0.025388] Unknown kernel command line parameters "BOOT_IMAGE=(hd0,msdos1)/vmlinuz-5.14.0-252.el9.x86_64 ksdevice=bootif", will be passed to user space.
[    0.026226] mem auto-init: stack:off, heap alloc:off, heap free:off
[    0.026242] software IO TLB: area num 64.
[    0.070665] Memory: 1041000K/133527060K available (14342K kernel code, 5536K rwdata, 10172K rodata, 2784K init, 7536K bss, 2785060K reserved, 0K cma-reserved)
[    0.070671] random: get_random_u64 called from kmem_cache_open+0x1e/0x210 with crng_init=0
[    0.070922] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=64, Nodes=2
[    0.070934] ftrace: allocating 44769 entries in 175 pages
[    0.089463] ftrace: allocated 175 pages with 6 groups
[    0.090207] Dynamic Preempt: voluntary
[    0.090345] rcu: Preemptible hierarchical RCU implementation.
[    0.090346] rcu: 	RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=64.
[    0.090347] 	Trampoline variant of Tasks RCU enabled.
[    0.090348] 	Rude variant of Tasks RCU enabled.
[    0.090348] 	Tracing variant of Tasks RCU enabled.
[    0.090349] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.
[    0.090349] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=64
[    0.093590] NR_IRQS: 524544, nr_irqs: 2568, preallocated irqs: 16
[    0.093794] rcu: srcu_init: Setting srcu_struct sizes based on contention.
[    0.093932] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)
[    0.093938] random: crng init done (trusting CPU's manufacturer)
[    0.098798] Console: colour VGA+ 80x25
[    1.900084] printk: console [ttyS0] enabled
[    1.904323] mempolicy: Enabling automatic NUMA balancing. Configure with numa_balancing= or the kernel.numa_balancing sysctl
[    1.915502] ACPI: Core revision 20211217
[    1.920604] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 79635855245 ns
[    1.929661] APIC: Switch to symmetric I/O mode setup
[    1.934623] DMAR: Host address width 46
[    1.938462] DMAR: DRHD base: 0x000000d0ffc000 flags: 0x0
[    1.943776] DMAR: dmar0: reg_base_addr d0ffc000 ver 4:0 cap 8ed008c40780466 ecap 60000f050df
[    1.952201] DMAR: DRHD base: 0x000000dbbfc000 flags: 0x0
[    1.957514] DMAR: dmar1: reg_base_addr dbbfc000 ver 4:0 cap 8ed008c40780466 ecap 60000f050df
[    1.965939] DMAR: DRHD base: 0x000000e67fc000 flags: 0x0
[    1.971250] DMAR: dmar2: reg_base_addr e67fc000 ver 4:0 cap 8ed008c40780466 ecap 60000f050df
[    1.979670] DMAR: DRHD base: 0x000000f13fc000 flags: 0x0
[    1.984982] DMAR: dmar3: reg_base_addr f13fc000 ver 4:0 cap 8ed008c40780466 ecap 60000f050df
[    1.993408] DMAR: DRHD base: 0x000000fb7fc000 flags: 0x0
[    1.998721] DMAR: dmar4: reg_base_addr fb7fc000 ver 4:0 cap 8ed008c40780466 ecap 60000f050df
[    2.007149] DMAR: DRHD base: 0x000000a63fc000 flags: 0x0
[    2.012459] DMAR: dmar5: reg_base_addr a63fc000 ver 4:0 cap 8ed008c40780466 ecap 60000f050df
[    2.020879] DMAR: DRHD base: 0x000000b0ffc000 flags: 0x0
[    2.026190] DMAR: dmar6: reg_base_addr b0ffc000 ver 4:0 cap 8ed008c40780466 ecap 60000f050df
[    2.034610] DMAR: DRHD base: 0x000000bbbfc000 flags: 0x0
[    2.039920] DMAR: dmar7: reg_base_addr bbbfc000 ver 4:0 cap 8ed008c40780466 ecap 60000f050df
[    2.048338] DMAR: DRHD base: 0x000000c5ffc000 flags: 0x0
[    2.053650] DMAR: dmar8: reg_base_addr c5ffc000 ver 4:0 cap 8ed008c40780466 ecap 60000f050df
[    2.062070] DMAR: DRHD base: 0x0000009b7fc000 flags: 0x1
[    2.067382] DMAR: dmar9: reg_base_addr 9b7fc000 ver 4:0 cap 8ed008c40780466 ecap 60000f050df
[    2.075807] DMAR: RMRR base: 0x000000420f2000 end: 0x0000004a0f9fff
[    2.082069] DMAR: RMRR base: 0x00000069cef000 end: 0x0000006a3eefff
[    2.088327] DMAR: RMRR base: 0x00000069436000 end: 0x00000069438fff
[    2.094589] DMAR: ATSR flags: 0x0
[    2.097908] DMAR: ATSR flags: 0x0
[    2.101230] DMAR-IR: IOAPIC id 8 under DRHD base  0x9b7fc000 IOMMU 9
[    2.107576] DMAR-IR: HPET id 0 under DRHD base 0x9b7fc000
[    2.112972] DMAR-IR: Queued invalidation will be enabled to support x2apic and Intr-remapping.
[    2.124157] DMAR-IR: Enabled IRQ remapping in x2apic mode
[    2.132128] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[    2.142139] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x29cd42e80b2, max_idle_ns: 440795228349 ns
[    2.152632] Calibrating delay loop (skipped), value calculated using timer frequency.. 5800.00 BogoMIPS (lpj=2900000)
[    2.153631] pid_max: default: 65536 minimum: 512
[    2.154709] LSM: Security Framework initializing
[    2.155647] Yama: becoming mindful.
[    2.156640] SELinux:  Initializing.
[    2.157684] LSM support for eBPF active
[    2.166193] Dentry cache hash table entries: 8388608 (order: 14, 67108864 bytes, vmalloc hugepage)
[    2.170859] Inode-cache hash table entries: 4194304 (order: 13, 33554432 bytes, vmalloc hugepage)
[    2.171779] Mount-cache hash table entries: 131072 (order: 8, 1048576 bytes, vmalloc)
[    2.172754] Mountpoint-cache hash table entries: 131072 (order: 8, 1048576 bytes, vmalloc)
[    2.173967] x86/cpu: SGX disabled by BIOS.
[    2.174635] x86/tme: not enabled by BIOS
[    2.175639] CPU0: Thermal monitoring enabled (TM1)
[    2.176633] x86/cpu: User Mode Instruction Prevention (UMIP) activated
[    2.177845] process: using mwait in idle threads
[    2.178632] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0
[    2.179631] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0
[    2.180636] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization
[    2.181633] Spectre V2 : Mitigation: Enhanced IBRS
[    2.182631] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch
[    2.183631] Spectre V2 : Spectre v2 / PBRSB-eIBRS: Retire a single CALL on VMEXIT
[    2.184632] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier
[    2.185632] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl
[    2.186636] MMIO Stale Data: Mitigation: Clear CPU buffers
[    2.200864] Freeing SMP alternatives memory: 36K
[    2.202720] smpboot: Estimated ratio of average max frequency by base frequency (times 1024): 1200
[    2.203641] smpboot: CPU0: Intel(R) Xeon(R) Gold 6326 CPU @ 2.90GHz (family: 0x6, model: 0x6a, stepping: 0x6)
[    2.204785] cblist_init_generic: Setting adjustable number of callback queues.
[    2.205631] cblist_init_generic: Setting shift to 6 and lim to 1.
[    2.206647] cblist_init_generic: Setting shift to 6 and lim to 1.
[    2.207643] cblist_init_generic: Setting shift to 6 and lim to 1.
[    2.208640] Performance Events: PEBS fmt4+-baseline,  AnyThread deprecated, Icelake events, 32-deep LBR, full-width counters, Intel PMU driver.
[    2.209632] ... version:                5
[    2.210631] ... bit width:              48
[    2.211631] ... generic registers:      8
[    2.212631] ... value mask:             0000ffffffffffff
[    2.213631] ... max period:             00007fffffffffff
[    2.214631] ... fixed-purpose events:   4
[    2.215632] ... event mask:             0001000f000000ff
[    2.216728] rcu: Hierarchical SRCU implementation.
[    2.217631] rcu: 	Max phase no-delay instances is 400.
[    2.222143] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter.
[    2.223184] smp: Bringing up secondary CPUs ...
[    2.223709] x86: Booting SMP configuration:
[    2.224632] .... node  #1, CPUs:        #1
[    2.019782] smpboot: CPU 1 Converting physical 0 to logical die 1

[    2.346632] .... node  #0, CPUs:    #2
[    2.355633] .... node  #1, CPUs:    #3
[    2.397633] .... node  #0, CPUs:    #4
[    2.405633] .... node  #1, CPUs:    #5
[    2.447633] .... node  #0, CPUs:    #6
[    2.455633] .... node  #1, CPUs:    #7
[    2.497633] .... node  #0, CPUs:    #8
[    2.506633] .... node  #1, CPUs:    #9
[    2.547633] .... node  #0, CPUs:   #10
[    2.555632] .... node  #1, CPUs:   #11
[    2.563632] .... node  #0, CPUs:   #12
[    2.571632] .... node  #1, CPUs:   #13
[    2.579632] .... node  #0, CPUs:   #14
[    2.587632] .... node  #1, CPUs:   #15
[    2.595632] .... node  #0, CPUs:   #16
[    2.603632] .... node  #1, CPUs:   #17
[    2.611632] .... node  #0, CPUs:   #18
[    2.619633] .... node  #1, CPUs:   #19
[    2.627632] .... node  #0, CPUs:   #20
[    2.636631] .... node  #1, CPUs:   #21
[    2.644634] .... node  #0, CPUs:   #22
[    2.653631] .... node  #1, CPUs:   #23
[    2.661632] .... node  #0, CPUs:   #24
[    2.670632] .... node  #1, CPUs:   #25
[    2.679632] .... node  #0, CPUs:   #26
[    2.687632] .... node  #1, CPUs:   #27
[    2.695632] .... node  #0, CPUs:   #28
[    2.703632] .... node  #1, CPUs:   #29
[    2.711632] .... node  #0, CPUs:   #30
[    2.720632] .... node  #1, CPUs:   #31
[    2.729631] .... node  #0, CPUs:   #32
[    2.730947] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details.

[    2.733631] .... node  #1, CPUs:   #33
[    2.736633] .... node  #0, CPUs:   #34
[    2.739631] .... node  #1, CPUs:   #35
[    2.742633] .... node  #0, CPUs:   #36
[    2.745631] .... node  #1, CPUs:   #37
[    2.748633] .... node  #0, CPUs:   #38
[    2.751631] .... node  #1, CPUs:   #39
[    2.754633] .... node  #0, CPUs:   #40
[    2.757631] .... node  #1, CPUs:   #41
[    2.760632] .... node  #0, CPUs:   #42
[    2.763631] .... node  #1, CPUs:   #43
[    2.766632] .... node  #0, CPUs:   #44
[    2.769631] .... node  #1, CPUs:   #45
[    2.772632] .... node  #0, CPUs:   #46
[    2.775631] .... node  #1, CPUs:   #47
[    2.778632] .... node  #0, CPUs:   #48
[    2.781631] .... node  #1, CPUs:   #49
[    2.784632] .... node  #0, CPUs:   #50
[    2.787631] .... node  #1, CPUs:   #51
[    2.790632] .... node  #0, CPUs:   #52
[    2.793631] .... node  #1, CPUs:   #53
[    2.796632] .... node  #0, CPUs:   #54
[    2.799631] .... node  #1, CPUs:   #55
[    2.802632] .... node  #0, CPUs:   #56
[    2.805631] .... node  #1, CPUs:   #57
[    2.808633] .... node  #0, CPUs:   #58
[    2.811631] .... node  #1, CPUs:   #59
[    2.814632] .... node  #0, CPUs:   #60
[    2.817631] .... node  #1, CPUs:   #61
[    2.820632] .... node  #0, CPUs:   #62
[    2.823631] .... node  #1, CPUs:   #63
[    2.825846] smp: Brought up 2 nodes, 64 CPUs
[    2.827631] smpboot: Max logical packages: 2
[    2.828632] smpboot: Total of 64 processors activated (372184.12 BogoMIPS)
[    2.884678] node 0 deferred pages initialised in 53ms
[    2.886652] node 1 deferred pages initialised in 55ms
[    2.898677] devtmpfs: initialized
[    2.902677] x86/mm: Memory block size: 2048MB
[    2.907664] ACPI: PM: Registering ACPI NVS region [mem 0x4a6dc000-0x4b6dbfff] (16777216 bytes)
[    2.915797] ACPI: PM: Registering ACPI NVS region [mem 0x6e3ff000-0x6f3fefff] (16777216 bytes)
[    2.924864] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns
[    2.934652] futex hash table entries: 16384 (order: 8, 1048576 bytes, vmalloc)
[    2.941876] pinctrl core: initialized pinctrl subsystem
[    2.947433] NET: Registered PF_NETLINK/PF_ROUTE protocol family
[    2.953784] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations
[    2.960644] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations
[    2.968649] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations
[    2.976662] audit: initializing netlink subsys (disabled)
[    2.982643] audit: type=2000 audit(1676262065.870:1): state=initialized audit_enabled=0 res=1
[    2.982772] thermal_sys: Registered thermal governor 'fair_share'
[    2.990632] thermal_sys: Registered thermal governor 'step_wise'
[    2.996631] thermal_sys: Registered thermal governor 'user_space'
[    3.002649] cpuidle: using governor menu
[    3.013681] HugeTLB: can optimize 4095 vmemmap pages for hugepages-1048576kB
[    3.020635] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it
[    3.027632] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[    3.034722] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000)
[    3.043634] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820
[    3.050650] PCI: Using configuration type 1 for base access
[    3.055639] PCI: Dell System detected, enabling pci=bfsort.
[    3.062637] ENERGY_PERF_BIAS: Set to 'normal', was 'performance'
[    3.065667] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.
[    3.074655] HugeTLB: can optimize 7 vmemmap pages for hugepages-2048kB
[    3.080634] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages
[    3.087632] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages
[    3.094678] cryptd: max_cpu_qlen set to 1000
[    3.098712] ACPI: Added _OSI(Module Device)
[    3.102632] ACPI: Added _OSI(Processor Device)
[    3.107631] ACPI: Added _OSI(3.0 _SCP Extensions)
[    3.111631] ACPI: Added _OSI(Processor Aggregator Device)
[    3.117632] ACPI: Added _OSI(Linux-Dell-Video)
[    3.121631] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio)
[    3.126632] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics)
[    3.205472] ACPI: 7 ACPI AML tables successfully acquired and loaded
[    3.215350] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored
[    3.223798] ACPI: Dynamic OEM Table Load:
[    3.379890] ACPI: Interpreter enabled
[    3.383648] ACPI: PM: (supports S0 S5)
[    3.386632] ACPI: Using IOAPIC for interrupt routing
[    3.391679] HEST: Table parsing has been initialized.
[    3.396633] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[    3.405631] PCI: Using E820 reservations for host bridge windows
[    3.422340] ACPI: Enabled 4 GPEs in block 00 to 7F
[    3.475386] ACPI: PCI Root Bridge [PC00] (domain 0000 [bus 00-15])
[    3.481636] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3]
[    3.504293] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC]
[    3.512727] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[    3.520631] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration
[    3.529697] PCI host bridge to bus 0000:00
[    3.533632] pci_bus 0000:00: root bus resource [io  0x0000-0x0cf7 window]
[    3.540632] pci_bus 0000:00: root bus resource [io  0x1000-0x4fff window]
[    3.546633] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[    3.554632] pci_bus 0000:00: root bus resource [mem 0x000c8000-0x000cffff window]
[    3.561631] pci_bus 0000:00: root bus resource [mem 0xfe010000-0xfe010fff window]
[    3.569631] pci_bus 0000:00: root bus resource [mem 0x90000000-0x9b7fffff window]
[    3.576640] pci_bus 0000:00: root bus resource [mem 0x380000000000-0x383fffffffff window]
[    3.584636] pci_bus 0000:00: root bus resource [bus 00-15]
[    3.590674] pci 0000:00:00.0: [8086:09a2] type 00 class 0x088000
[    3.596738] pci 0000:00:00.1: [8086:09a4] type 00 class 0x088000
[    3.602699] pci 0000:00:00.2: [8086:09a3] type 00 class 0x088000
[    3.608697] pci 0000:00:00.4: [8086:0998] type 00 class 0x060000
[    3.614698] pci 0000:00:02.0: [8086:09a6] type 00 class 0x088000
[    3.620639] pci 0000:00:02.0: reg 0x10: [mem 0x92dfc000-0x92dfdfff]
[    3.626700] pci 0000:00:02.1: [8086:09a7] type 00 class 0x088000
[    3.632639] pci 0000:00:02.1: reg 0x10: [mem 0x92d00000-0x92d7ffff]
[    3.639635] pci 0000:00:02.1: reg 0x14: [mem 0x92c80000-0x92cfffff]
[    3.645695] pci 0000:00:02.4: [8086:3456] type 00 class 0x130000
[    3.651640] pci 0000:00:02.4: reg 0x10: [mem 0x92a00000-0x92afffff 64bit]
[    3.658638] pci 0000:00:02.4: reg 0x18: [mem 0x92df0000-0x92df3fff 64bit]
[    3.665637] pci 0000:00:02.4: reg 0x20: [mem 0x92dc0000-0x92ddffff 64bit]
[    3.671721] pci 0000:00:11.0: [8086:a1ec] type 00 class 0xff0000
[    3.677633] pci 0000:00:11.0: device has non-compliant BARs; disabling IO/MEM decoding
[    3.685733] pci 0000:00:11.5: [8086:a1d2] type 00 class 0x010601
[    3.691644] pci 0000:00:11.5: reg 0x10: [mem 0x92dfa000-0x92dfbfff]
[    3.698638] pci 0000:00:11.5: reg 0x14: [mem 0x92e05000-0x92e050ff]
[    3.704638] pci 0000:00:11.5: reg 0x18: [io  0x2068-0x206f]
[    3.709638] pci 0000:00:11.5: reg 0x1c: [io  0x2074-0x2077]
[    3.715638] pci 0000:00:11.5: reg 0x20: [io  0x2040-0x205f]
[    3.720638] pci 0000:00:11.5: reg 0x24: [mem 0x92b80000-0x92bfffff]
[    3.727660] pci 0000:00:11.5: PME# supported from D3hot
[    3.732814] pci 0000:00:14.0: [8086:a1af] type 00 class 0x0c0330
[    3.738649] pci 0000:00:14.0: reg 0x10: [mem 0x92de0000-0x92deffff 64bit]
[    3.745667] pci 0000:00:14.0: PME# supported from D3hot D3cold
[    3.751862] pci 0000:00:14.2: [8086:a1b1] type 00 class 0x118000
[    3.757649] pci 0000:00:14.2: reg 0x10: [mem 0x92e02000-0x92e02fff 64bit]
[    3.764753] pci 0000:00:16.0: [8086:a1ba] type 00 class 0x078000
[    3.770655] pci 0000:00:16.0: reg 0x10: [mem 0x92e01000-0x92e01fff 64bit]
[    3.777714] pci 0000:00:16.0: PME# supported from D3hot
[    3.782691] pci 0000:00:16.1: [8086:a1bb] type 00 class 0x078000
[    3.788655] pci 0000:00:16.1: reg 0x10: [mem 0x92e00000-0x92e00fff 64bit]
[    3.795725] pci 0000:00:16.1: PME# supported from D3hot
[    3.800694] pci 0000:00:16.4: [8086:a1be] type 00 class 0x078000
[    3.806656] pci 0000:00:16.4: reg 0x10: [mem 0x92dff000-0x92dfffff 64bit]
[    3.813681] pci 0000:00:16.4: PME# supported from D3hot
[    3.818710] pci 0000:00:17.0: [8086:a182] type 00 class 0x010601
[    3.824644] pci 0000:00:17.0: reg 0x10: [mem 0x92df8000-0x92df9fff]
[    3.830638] pci 0000:00:17.0: reg 0x14: [mem 0x92e04000-0x92e040ff]
[    3.837638] pci 0000:00:17.0: reg 0x18: [io  0x2060-0x2067]
[    3.842638] pci 0000:00:17.0: reg 0x1c: [io  0x2070-0x2073]
[    3.848638] pci 0000:00:17.0: reg 0x20: [io  0x2020-0x203f]
[    3.853637] pci 0000:00:17.0: reg 0x24: [mem 0x92b00000-0x92b7ffff]
[    3.860667] pci 0000:00:17.0: PME# supported from D3hot
[    3.865791] pci 0000:00:1c.0: [8086:a190] type 01 class 0x060400
[    3.871708] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold
[    3.878747] pci 0000:00:1c.4: [8086:a194] type 01 class 0x060400
[    3.884671] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold
[    3.891051] pci 0000:00:1c.5: [8086:a195] type 01 class 0x060400
[    3.896704] pci 0000:00:1c.5: PME# supported from D0 D3hot D3cold
[    3.904023] pci 0000:00:1f.0: [8086:a1cb] type 00 class 0x060100
[    3.909869] pci 0000:00:1f.2: [8086:a1a1] type 00 class 0x058000
[    3.915647] pci 0000:00:1f.2: reg 0x10: [mem 0x92df4000-0x92df7fff]
[    3.921764] pci 0000:00:1f.4: [8086:a1a3] type 00 class 0x0c0500
[    3.928651] pci 0000:00:1f.4: reg 0x10: [mem 0x92dfe000-0x92dfe0ff 64bit]
[    3.934653] pci 0000:00:1f.4: reg 0x20: [io  0x2000-0x201f]
[    3.940690] pci 0000:00:1f.5: [8086:a1a4] type 00 class 0x0c8000
[    3.946647] pci 0000:00:1f.5: reg 0x10: [mem 0xfe010000-0xfe010fff]
[    3.952744] pci 0000:00:1c.0: PCI bridge to [bus 01]
[    3.957671] pci 0000:02:00.0: [1556:be00] type 01 class 0x060400
[    3.963808] pci 0000:00:1c.4: PCI bridge to [bus 02-03]
[    3.969634] pci 0000:00:1c.4:   bridge window [mem 0x92000000-0x928fffff]
[    3.975634] pci 0000:00:1c.4:   bridge window [mem 0x91000000-0x91ffffff 64bit pref]
[    3.983662] pci_bus 0000:03: extended config space not accessible
[    3.989646] pci 0000:03:00.0: [102b:0536] type 00 class 0x030000
[    3.995651] pci 0000:03:00.0: reg 0x10: [mem 0x91000000-0x91ffffff pref]
[    4.002642] pci 0000:03:00.0: reg 0x14: [mem 0x92808000-0x9280bfff]
[    4.008641] pci 0000:03:00.0: reg 0x18: [mem 0x92000000-0x927fffff]
[    4.014673] pci 0000:03:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]
[    4.023726] pci 0000:02:00.0: PCI bridge to [bus 03]
[    4.028639] pci 0000:02:00.0:   bridge window [mem 0x92000000-0x928fffff]
[    4.035636] pci 0000:02:00.0:   bridge window [mem 0x91000000-0x91ffffff 64bit pref]
[    4.042694] pci 0000:04:00.0: [14e4:165f] type 00 class 0x020000
[    4.048656] pci 0000:04:00.0: reg 0x10: [mem 0x92930000-0x9293ffff 64bit pref]
[    4.056646] pci 0000:04:00.0: reg 0x18: [mem 0x92940000-0x9294ffff 64bit pref]
[    4.063646] pci 0000:04:00.0: reg 0x20: [mem 0x92950000-0x9295ffff 64bit pref]
[    4.070641] pci 0000:04:00.0: reg 0x30: [mem 0xfffc0000-0xffffffff pref]
[    4.077716] pci 0000:04:00.0: PME# supported from D0 D3hot D3cold
[    4.083685] pci 0000:04:00.0: 4.000 Gb/s available PCIe bandwidth, limited by 5.0 GT/s PCIe x1 link at 0000:00:1c.5 (capable of 8.000 Gb/s with 5.0 GT/s PCIe x2 link)
[    4.098963] pci 0000:04:00.1: [14e4:165f] type 00 class 0x020000
[    4.104655] pci 0000:04:00.1: reg 0x10: [mem 0x92900000-0x9290ffff 64bit pref]
[    4.111646] pci 0000:04:00.1: reg 0x18: [mem 0x92910000-0x9291ffff 64bit pref]
[    4.118646] pci 0000:04:00.1: reg 0x20: [mem 0x92920000-0x9292ffff 64bit pref]
[    4.126641] pci 0000:04:00.1: reg 0x30: [mem 0xfffc0000-0xffffffff pref]
[    4.132716] pci 0000:04:00.1: PME# supported from D0 D3hot D3cold
[    4.138974] pci 0000:00:1c.5: PCI bridge to [bus 04]
[    4.144637] pci 0000:00:1c.5:   bridge window [mem 0x92900000-0x929fffff 64bit pref]
[    4.151644] pci_bus 0000:00: on NUMA node 0
[    4.152007] ACPI: PCI Root Bridge [PC01] (domain 0000 [bus 16-2f])
[    4.158633] acpi PNP0A08:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3]
[    4.173049] acpi PNP0A08:01: _OSC: platform does not support [SHPCHotplug AER DPC]
[    4.180723] acpi PNP0A08:01: _OSC: OS now controls [PCIeHotplug PME PCIeCapability LTR]
[    4.188631] acpi PNP0A08:01: FADT indicates ASPM is unsupported, using BIOS configuration
[    4.196701] PCI host bridge to bus 0000:16
[    4.201637] pci_bus 0000:16: root bus resource [io  0x5000-0x6fff window]
[    4.207633] pci_bus 0000:16: root bus resource [mem 0x9b800000-0xa63fffff window]
[    4.215632] pci_bus 0000:16: root bus resource [mem 0x384000000000-0x387fffffffff window]
[    4.223632] pci_bus 0000:16: root bus resource [bus 16-2f]
[    4.228796] pci 0000:16:00.0: [8086:09a2] type 00 class 0x088000
[    4.234704] pci 0000:16:00.1: [8086:09a4] type 00 class 0x088000
[    4.240696] pci 0000:16:00.2: [8086:09a3] type 00 class 0x088000
[    4.247692] pci 0000:16:00.4: [8086:0998] type 00 class 0x060000
[    4.253695] pci 0000:16:02.0: [8086:347a] type 01 class 0x060400
[    4.259641] pci 0000:16:02.0: reg 0x10: [mem 0x387ffd000000-0x387ffd01ffff 64bit]
[    4.266642] pci 0000:16:02.0: enabling Extended Tags
[    4.271662] pci 0000:16:02.0: PME# supported from D0 D3hot D3cold
[    4.278462] pci 0000:17:00.0: [19ee:4000] type 00 class 0x020000
[    4.284645] pci 0000:17:00.0: reg 0x10: [mem 0x387ff0000000-0x387ff7ffffff 64bit pref]
[    4.292640] pci 0000:17:00.0: reg 0x18: [mem 0x387ff8000000-0x387ffbffffff 64bit pref]
[    4.300639] pci 0000:17:00.0: reg 0x20: [mem 0x387ffc000000-0x387ffcffffff 64bit pref]
[    4.308636] pci 0000:17:00.0: reg 0x30: [mem 0xff000000-0xffffffff pref]
[    4.315172] pci 0000:17:00.0: supports D1
[    4.319633] pci 0000:17:00.0: PME# supported from D0 D1 D3hot
[    4.325651] pci 0000:17:00.0: reg 0x224: [mem 0xa1000000-0xa1007fff 64bit]
[    4.331632] pci 0000:17:00.0: VF(n) BAR0 space: [mem 0xa1000000-0xa11fffff 64bit] (contains BAR0 for 64 VFs)
[    4.341637] pci 0000:17:00.0: reg 0x22c: [mem 0x9d000000-0x9d0fffff 64bit]
[    4.348631] pci 0000:17:00.0: VF(n) BAR2 space: [mem 0x9d000000-0xa0ffffff 64bit] (contains BAR2 for 64 VFs)
[    4.358795] pci 0000:16:02.0: PCI bridge to [bus 17-18]
[    4.363633] pci 0000:16:02.0:   bridge window [mem 0x9d000000-0xa11fffff]
[    4.370633] pci 0000:16:02.0:   bridge window [mem 0x387ff0000000-0x387ffcffffff 64bit pref]
[    4.378637] pci_bus 0000:16: on NUMA node 0
[    4.378685] ACPI: PCI Root Bridge [PC02] (domain 0000 [bus 30-49])
[    4.385637] acpi PNP0A08:02: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3]
[    4.400027] acpi PNP0A08:02: _OSC: platform does not support [SHPCHotplug AER DPC]
[    4.407719] acpi PNP0A08:02: _OSC: OS now controls [PCIeHotplug PME PCIeCapability LTR]
[    4.415632] acpi PNP0A08:02: FADT indicates ASPM is unsupported, using BIOS configuration
[    4.423712] PCI host bridge to bus 0000:30
[    4.427633] pci_bus 0000:30: root bus resource [io  0x7000-0x8fff window]
[    4.434632] pci_bus 0000:30: root bus resource [mem 0xa6400000-0xb0ffffff window]
[    4.441631] pci_bus 0000:30: root bus resource [mem 0x388000000000-0x38bfffffffff window]
[    4.450632] pci_bus 0000:30: root bus resource [bus 30-49]
[    4.455641] pci 0000:30:00.0: [8086:09a2] type 00 class 0x088000
[    4.461701] pci 0000:30:00.1: [8086:09a4] type 00 class 0x088000
[    4.467695] pci 0000:30:00.2: [8086:09a3] type 00 class 0x088000
[    4.473693] pci 0000:30:00.4: [8086:0998] type 00 class 0x060000
[    4.479695] pci 0000:30:02.0: [8086:347a] type 01 class 0x060400
[    4.485641] pci 0000:30:02.0: reg 0x10: [mem 0x38bffff40000-0x38bffff5ffff 64bit]
[    4.493662] pci 0000:30:02.0: PME# supported from D0 D3hot D3cold
[    4.500305] pci 0000:30:04.0: [8086:347c] type 01 class 0x060400
[    4.505642] pci 0000:30:04.0: reg 0x10: [mem 0x38bffff20000-0x38bffff3ffff 64bit]
[    4.513642] pci 0000:30:04.0: enabling Extended Tags
[    4.518672] pci 0000:30:04.0: PME# supported from D0 D3hot D3cold
[    4.525211] pci 0000:30:05.0: [8086:347d] type 01 class 0x060400
[    4.530640] pci 0000:30:05.0: reg 0x10: [mem 0x38bffff00000-0x38bffff1ffff 64bit]
[    4.538641] pci 0000:30:05.0: enabling Extended Tags
[    4.543660] pci 0000:30:05.0: PME# supported from D0 D3hot D3cold
[    4.550246] pci 0000:31:00.0: [1000:0015] type 00 class 0x010400
[    4.556644] pci 0000:31:00.0: reg 0x10: [mem 0xa6400000-0xa64fffff 64bit pref]
[    4.563639] pci 0000:31:00.0: reg 0x18: [mem 0xa6500000-0xa65fffff 64bit pref]
[    4.570636] pci 0000:31:00.0: reg 0x20: [mem 0xa6800000-0xa68fffff]
[    4.576637] pci 0000:31:00.0: reg 0x24: [io  0x7000-0x70ff]
[    4.582637] pci 0000:31:00.0: reg 0x30: [mem 0xfff00000-0xffffffff pref]
[    4.589166] pci 0000:31:00.0: supports D1 D2
[    4.593732] pci 0000:30:02.0: PCI bridge to [bus 31]
[    4.598632] pci 0000:30:02.0:   bridge window [io  0x7000-0x7fff]
[    4.604632] pci 0000:30:02.0:   bridge window [mem 0xa6800000-0xa68fffff]
[    4.611633] pci 0000:30:02.0:   bridge window [mem 0xa6400000-0xa65fffff 64bit pref]
[    4.619681] pci 0000:32:00.0: [14e4:165f] type 00 class 0x020000
[    4.625648] pci 0000:32:00.0: reg 0x10: [mem 0xa6630000-0xa663ffff 64bit pref]
[    4.632641] pci 0000:32:00.0: reg 0x18: [mem 0xa6640000-0xa664ffff 64bit pref]
[    4.639641] pci 0000:32:00.0: reg 0x20: [mem 0xa6650000-0xa665ffff 64bit pref]
[    4.646638] pci 0000:32:00.0: reg 0x30: [mem 0xfffc0000-0xffffffff pref]
[    4.653918] pci 0000:32:00.0: PME# supported from D0 D3hot D3cold
[    4.660973] pci 0000:32:00.1: [14e4:165f] type 00 class 0x020000
[    4.666649] pci 0000:32:00.1: reg 0x10: [mem 0xa6600000-0xa660ffff 64bit pref]
[    4.673642] pci 0000:32:00.1: reg 0x18: [mem 0xa6610000-0xa661ffff 64bit pref]
[    4.680641] pci 0000:32:00.1: reg 0x20: [mem 0xa6620000-0xa662ffff 64bit pref]
[    4.688638] pci 0000:32:00.1: reg 0x30: [mem 0xfffc0000-0xffffffff pref]
[    4.695065] pci 0000:32:00.1: PME# supported from D0 D3hot D3cold
[    4.701946] pci 0000:30:04.0: PCI bridge to [bus 32]
[    4.706637] pci 0000:30:04.0:   bridge window [mem 0xa6600000-0xa66fffff 64bit pref]
[    4.714677] pci 0000:33:00.0: [14e4:165f] type 00 class 0x020000
[    4.720649] pci 0000:33:00.0: reg 0x10: [mem 0xa6730000-0xa673ffff 64bit pref]
[    4.727641] pci 0000:33:00.0: reg 0x18: [mem 0xa6740000-0xa674ffff 64bit pref]
[    4.734642] pci 0000:33:00.0: reg 0x20: [mem 0xa6750000-0xa675ffff 64bit pref]
[    4.741638] pci 0000:33:00.0: reg 0x30: [mem 0xfffc0000-0xffffffff pref]
[    4.749246] pci 0000:33:00.0: PME# supported from D0 D3hot D3cold
[    4.755987] pci 0000:33:00.1: [14e4:165f] type 00 class 0x020000
[    4.761648] pci 0000:33:00.1: reg 0x10: [mem 0xa6700000-0xa670ffff 64bit pref]
[    4.768641] pci 0000:33:00.1: reg 0x18: [mem 0xa6710000-0xa671ffff 64bit pref]
[    4.776641] pci 0000:33:00.1: reg 0x20: [mem 0xa6720000-0xa672ffff 64bit pref]
[    4.783638] pci 0000:33:00.1: reg 0x30: [mem 0xfffc0000-0xffffffff pref]
[    4.790063] pci 0000:33:00.1: PME# supported from D0 D3hot D3cold
[    4.796947] pci 0000:30:05.0: PCI bridge to [bus 33]
[    4.801635] pci 0000:30:05.0:   bridge window [mem 0xa6700000-0xa67fffff 64bit pref]
[    4.809643] pci_bus 0000:30: on NUMA node 0
[    4.809708] ACPI: PCI Root Bridge [PC04] (domain 0000 [bus 4a-63])
[    4.815634] acpi PNP0A08:04: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3]
[    4.830620] acpi PNP0A08:04: _OSC: platform does not support [SHPCHotplug AER DPC]
[    4.837727] acpi PNP0A08:04: _OSC: OS now controls [PCIeHotplug PME PCIeCapability LTR]
[    4.845632] acpi PNP0A08:04: FADT indicates ASPM is unsupported, using BIOS configuration
[    4.854704] PCI host bridge to bus 0000:4a
[    4.858632] pci_bus 0000:4a: root bus resource [io  0x9000-0x9fff window]
[    4.865632] pci_bus 0000:4a: root bus resource [mem 0xb1000000-0xbbbfffff window]
[    4.872631] pci_bus 0000:4a: root bus resource [mem 0x38c000000000-0x38ffffffffff window]
[    4.880632] pci_bus 0000:4a: root bus resource [bus 4a-63]
[    4.886642] pci 0000:4a:00.0: [8086:09a2] type 00 class 0x088000
[    4.892700] pci 0000:4a:00.1: [8086:09a4] type 00 class 0x088000
[    4.898676] pci 0000:4a:00.2: [8086:09a3] type 00 class 0x088000
[    4.904696] pci 0000:4a:00.4: [8086:0998] type 00 class 0x060000
[    4.910700] pci_bus 0000:4a: on NUMA node 0
[    4.910748] ACPI: PCI Root Bridge [PC05] (domain 0000 [bus 64-7d])
[    4.916633] acpi PNP0A08:05: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3]
[    4.931057] acpi PNP0A08:05: _OSC: platform does not support [SHPCHotplug AER DPC]
[    4.938720] acpi PNP0A08:05: _OSC: OS now controls [PCIeHotplug PME PCIeCapability LTR]
[    4.946631] acpi PNP0A08:05: FADT indicates ASPM is unsupported, using BIOS configuration
[    4.954695] PCI host bridge to bus 0000:64
[    4.959632] pci_bus 0000:64: root bus resource [io  0xa000-0xafff window]
[    4.965633] pci_bus 0000:64: root bus resource [mem 0xbbc00000-0xc5ffffff window]
[    4.973632] pci_bus 0000:64: root bus resource [mem 0x390000000000-0x393fffffffff window]
[    4.981632] pci_bus 0000:64: root bus resource [bus 64-7d]
[    4.986640] pci 0000:64:00.0: [8086:09a2] type 00 class 0x088000
[    4.992697] pci 0000:64:00.1: [8086:09a4] type 00 class 0x088000
[    4.998693] pci 0000:64:00.2: [8086:09a3] type 00 class 0x088000
[    5.004672] pci 0000:64:00.4: [8086:0998] type 00 class 0x060000
[    5.011714] pci 0000:64:02.0: [8086:347a] type 01 class 0x060400
[    5.017641] pci 0000:64:02.0: reg 0x10: [mem 0x393ffff60000-0x393ffff7ffff 64bit]
[    5.024642] pci 0000:64:02.0: enabling Extended Tags
[    5.029665] pci 0000:64:02.0: PME# supported from D0 D3hot D3cold
[    5.037595] pci 0000:64:03.0: [8086:347b] type 01 class 0x060400
[    5.043642] pci 0000:64:03.0: reg 0x10: [mem 0x393ffff40000-0x393ffff5ffff 64bit]
[    5.050642] pci 0000:64:03.0: enabling Extended Tags
[    5.055666] pci 0000:64:03.0: PME# supported from D0 D3hot D3cold
[    5.063418] pci 0000:64:04.0: [8086:347c] type 01 class 0x060400
[    5.069643] pci 0000:64:04.0: reg 0x10: [mem 0x393ffff20000-0x393ffff3ffff 64bit]
[    5.077642] pci 0000:64:04.0: enabling Extended Tags
[    5.082664] pci 0000:64:04.0: PME# supported from D0 D3hot D3cold
[    5.090464] pci 0000:64:05.0: [8086:347d] type 01 class 0x060400
[    5.096641] pci 0000:64:05.0: reg 0x10: [mem 0x393ffff00000-0x393ffff1ffff 64bit]
[    5.103642] pci 0000:64:05.0: enabling Extended Tags
[    5.108665] pci 0000:64:05.0: PME# supported from D0 D3hot D3cold
[    5.116921] pci 0000:64:02.0: PCI bridge to [bus 65]
[    5.121634] pci 0000:64:02.0:   bridge window [mem 0xbc800000-0xbcbfffff]
[    5.128665] pci 0000:64:03.0: PCI bridge to [bus 66]
[    5.133635] pci 0000:64:03.0:   bridge window [mem 0xbc400000-0xbc7fffff]
[    5.139665] pci 0000:64:04.0: PCI bridge to [bus 67]
[    5.144633] pci 0000:64:04.0:   bridge window [mem 0xbc000000-0xbc3fffff]
[    5.151658] pci 0000:64:05.0: PCI bridge to [bus 68]
[    5.156633] pci 0000:64:05.0:   bridge window [mem 0xbbc00000-0xbbffffff]
[    5.163648] pci_bus 0000:64: on NUMA node 0
[    5.163714] ACPI: PCI Root Bridge [UC06] (domain 0000 [bus 7e])
[    5.169633] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3]
[    5.178681] acpi PNP0A03:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC]
[    5.186705] acpi PNP0A03:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[    5.194632] acpi PNP0A03:00: FADT indicates ASPM is unsupported, using BIOS configuration
[    5.202731] PCI host bridge to bus 0000:7e
[    5.206633] pci_bus 0000:7e: root bus resource [bus 7e]
[    5.211640] pci 0000:7e:00.0: [8086:3450] type 00 class 0x088000
[    5.217703] pci 0000:7e:00.1: [8086:3451] type 00 class 0x088000
[    5.223684] pci 0000:7e:00.2: [8086:3452] type 00 class 0x088000
[    5.229695] pci 0000:7e:00.3: [8086:0998] type 00 class 0x060000
[    5.235686] pci 0000:7e:00.5: [8086:3455] type 00 class 0x088000
[    5.241690] pci 0000:7e:02.0: [8086:3440] type 00 class 0x088000
[    5.247758] pci 0000:7e:02.1: [8086:3441] type 00 class 0x088000
[    5.254741] pci 0000:7e:02.2: [8086:3442] type 00 class 0x088000
[    5.260740] pci 0000:7e:03.0: [8086:3440] type 00 class 0x088000
[    5.266718] pci 0000:7e:03.1: [8086:3441] type 00 class 0x088000
[    5.272703] pci 0000:7e:03.2: [8086:3442] type 00 class 0x088000
[    5.278684] pci 0000:7e:04.0: [8086:3440] type 00 class 0x088000
[    5.284724] pci 0000:7e:04.1: [8086:3441] type 00 class 0x088000
[    5.290756] pci 0000:7e:04.2: [8086:3442] type 00 class 0x088000
[    5.296750] pci 0000:7e:04.3: [8086:3443] type 00 class 0x088000
[    5.302753] pci 0000:7e:05.0: [8086:3445] type 00 class 0x088000
[    5.308766] pci 0000:7e:05.1: [8086:3446] type 00 class 0x088000
[    5.314744] pci 0000:7e:05.2: [8086:3447] type 00 class 0x088000
[    5.321743] pci 0000:7e:06.0: [8086:3445] type 00 class 0x088000
[    5.327718] pci 0000:7e:06.1: [8086:3446] type 00 class 0x088000
[    5.333707] pci 0000:7e:06.2: [8086:3447] type 00 class 0x088000
[    5.339714] pci 0000:7e:07.0: [8086:3445] type 00 class 0x088000
[    5.345775] pci 0000:7e:07.1: [8086:3446] type 00 class 0x088000
[    5.351712] pci 0000:7e:07.2: [8086:3447] type 00 class 0x088000
[    5.357749] pci 0000:7e:0b.0: [8086:3448] type 00 class 0x088000
[    5.363707] pci 0000:7e:0b.1: [8086:3448] type 00 class 0x088000
[    5.369688] pci 0000:7e:0b.2: [8086:344b] type 00 class 0x088000
[    5.375695] pci 0000:7e:0c.0: [8086:344a] type 00 class 0x110100
[    5.381729] pci 0000:7e:0d.0: [8086:344a] type 00 class 0x110100
[    5.387724] pci 0000:7e:0e.0: [8086:344a] type 00 class 0x110100
[    5.394766] pci 0000:7e:0f.0: [8086:344a] type 00 class 0x110100
[    5.400718] pci 0000:7e:1a.0: [8086:2880] type 00 class 0x110100
[    5.406726] pci 0000:7e:1b.0: [8086:2880] type 00 class 0x110100
[    5.412705] pci 0000:7e:1c.0: [8086:2880] type 00 class 0x110100
[    5.418773] pci 0000:7e:1d.0: [8086:2880] type 00 class 0x110100
[    5.424773] pci_bus 0000:7e: on NUMA node 0
[    5.424821] ACPI: PCI Root Bridge [UC07] (domain 0000 [bus 7f])
[    5.430632] acpi PNP0A03:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3]
[    5.439673] acpi PNP0A03:01: _OSC: platform does not support [SHPCHotplug AER LTR DPC]
[    5.447703] acpi PNP0A03:01: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[    5.455631] acpi PNP0A03:01: FADT indicates ASPM is unsupported, using BIOS configuration
[    5.463721] PCI host bridge to bus 0000:7f
[    5.467632] pci_bus 0000:7f: root bus resource [bus 7f]
[    5.473645] pci 0000:7f:00.0: [8086:344c] type 00 class 0x088000
[    5.479703] pci 0000:7f:00.1: [8086:344c] type 00 class 0x088000
[    5.485741] pci 0000:7f:00.2: [8086:344c] type 00 class 0x088000
[    5.491729] pci 0000:7f:00.3: [8086:344c] type 00 class 0x088000
[    5.497748] pci 0000:7f:00.4: [8086:344c] type 00 class 0x088000
[    5.503749] pci 0000:7f:00.5: [8086:344c] type 00 class 0x088000
[    5.509709] pci 0000:7f:00.6: [8086:344c] type 00 class 0x088000
[    5.515708] pci 0000:7f:00.7: [8086:344c] type 00 class 0x088000
[    5.521764] pci 0000:7f:01.0: [8086:344c] type 00 class 0x088000
[    5.527712] pci 0000:7f:01.1: [8086:344c] type 00 class 0x088000
[    5.533755] pci 0000:7f:01.2: [8086:344c] type 00 class 0x088000
[    5.539754] pci 0000:7f:01.3: [8086:344c] type 00 class 0x088000
[    5.546710] pci 0000:7f:01.4: [8086:344c] type 00 class 0x088000
[    5.552770] pci 0000:7f:01.5: [8086:344c] type 00 class 0x088000
[    5.558779] pci 0000:7f:01.6: [8086:344c] type 00 class 0x088000
[    5.564769] pci 0000:7f:01.7: [8086:344c] type 00 class 0x088000
[    5.570770] pci 0000:7f:02.0: [8086:344c] type 00 class 0x088000
[    5.576739] pci 0000:7f:02.1: [8086:344c] type 00 class 0x088000
[    5.582721] pci 0000:7f:02.2: [8086:344c] type 00 class 0x088000
[    5.588714] pci 0000:7f:02.3: [8086:344c] type 00 class 0x088000
[    5.594712] pci 0000:7f:02.4: [8086:344c] type 00 class 0x088000
[    5.600762] pci 0000:7f:02.5: [8086:344c] type 00 class 0x088000
[    5.607742] pci 0000:7f:02.6: [8086:344c] type 00 class 0x088000
[    5.613749] pci 0000:7f:02.7: [8086:344c] type 00 class 0x088000
[    5.619709] pci 0000:7f:03.0: [8086:344c] type 00 class 0x088000
[    5.625777] pci 0000:7f:03.1: [8086:344c] type 00 class 0x088000
[    5.631762] pci 0000:7f:03.2: [8086:344c] type 00 class 0x088000
[    5.637775] pci 0000:7f:03.3: [8086:344c] type 00 class 0x088000
[    5.643783] pci 0000:7f:0a.0: [8086:344d] type 00 class 0x088000
[    5.649741] pci 0000:7f:0a.1: [8086:344d] type 00 class 0x088000
[    5.655740] pci 0000:7f:0a.2: [8086:344d] type 00 class 0x088000
[    5.662734] pci 0000:7f:0a.3: [8086:344d] type 00 class 0x088000
[    5.668749] pci 0000:7f:0a.4: [8086:344d] type 00 class 0x088000
[    5.674749] pci 0000:7f:0a.5: [8086:344d] type 00 class 0x088000
[    5.680706] pci 0000:7f:0a.6: [8086:344d] type 00 class 0x088000
[    5.686692] pci 0000:7f:0a.7: [8086:344d] type 00 class 0x088000
[    5.692765] pci 0000:7f:0b.0: [8086:344d] type 00 class 0x088000
[    5.698767] pci 0000:7f:0b.1: [8086:344d] type 00 class 0x088000
[    5.704755] pci 0000:7f:0b.2: [8086:344d] type 00 class 0x088000
[    5.710752] pci 0000:7f:0b.3: [8086:344d] type 00 class 0x088000
[    5.716760] pci 0000:7f:0b.4: [8086:344d] type 00 class 0x088000
[    5.722770] pci 0000:7f:0b.5: [8086:344d] type 00 class 0x088000
[    5.729711] pci 0000:7f:0b.6: [8086:344d] type 00 class 0x088000
[    5.735767] pci 0000:7f:0b.7: [8086:344d] type 00 class 0x088000
[    5.741712] pci 0000:7f:0c.0: [8086:344d] type 00 class 0x088000
[    5.747745] pci 0000:7f:0c.1: [8086:344d] type 00 class 0x088000
[    5.753722] pci 0000:7f:0c.2: [8086:344d] type 00 class 0x088000
[    5.759717] pci 0000:7f:0c.3: [8086:344d] type 00 class 0x088000
[    5.765722] pci 0000:7f:0c.4: [8086:344d] type 00 class 0x088000
[    5.771759] pci 0000:7f:0c.5: [8086:344d] type 00 class 0x088000
[    5.777744] pci 0000:7f:0c.6: [8086:344d] type 00 class 0x088000
[    5.783749] pci 0000:7f:0c.7: [8086:344d] type 00 class 0x088000
[    5.790751] pci 0000:7f:0d.0: [8086:344d] type 00 class 0x088000
[    5.796769] pci 0000:7f:0d.1: [8086:344d] type 00 class 0x088000
[    5.802763] pci 0000:7f:0d.2: [8086:344d] type 00 class 0x088000
[    5.808714] pci 0000:7f:0d.3: [8086:344d] type 00 class 0x088000
[    5.814794] pci 0000:7f:1d.0: [8086:344f] type 00 class 0x088000
[    5.820748] pci 0000:7f:1d.1: [8086:3457] type 00 class 0x088000
[    5.826735] pci 0000:7f:1e.0: [8086:3458] type 00 class 0x088000
[    5.832701] pci 0000:7f:1e.1: [8086:3459] type 00 class 0x088000
[    5.838690] pci 0000:7f:1e.2: [8086:345a] type 00 class 0x088000
[    5.844667] pci 0000:7f:1e.3: [8086:345b] type 00 class 0x088000
[    5.850690] pci 0000:7f:1e.4: [8086:345c] type 00 class 0x088000
[    5.856692] pci 0000:7f:1e.5: [8086:345d] type 00 class 0x088000
[    5.863690] pci 0000:7f:1e.6: [8086:345e] type 00 class 0x088000
[    5.869697] pci 0000:7f:1e.7: [8086:345f] type 00 class 0x088000
[    5.875687] pci_bus 0000:7f: on NUMA node 0
[    5.875768] ACPI: PCI Root Bridge [PC06] (domain 0000 [bus 80-96])
[    5.881633] acpi PNP0A08:06: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3]
[    5.895972] acpi PNP0A08:06: _OSC: platform does not support [SHPCHotplug AER DPC]
[    5.903721] acpi PNP0A08:06: _OSC: OS now controls [PCIeHotplug PME PCIeCapability LTR]
[    5.911632] acpi PNP0A08:06: FADT indicates ASPM is unsupported, using BIOS configuration
[    5.919733] PCI host bridge to bus 0000:80
[    5.923633] pci_bus 0000:80: root bus resource [io  0xb000-0xbfff window]
[    5.930632] pci_bus 0000:80: root bus resource [mem 0xc6800000-0xd0ffffff window]
[    5.938631] pci_bus 0000:80: root bus resource [mem 0x394000000000-0x397fffffffff window]
[    5.946632] pci_bus 0000:80: root bus resource [bus 80-96]
[    5.951640] pci 0000:80:00.0: [8086:09a2] type 00 class 0x088000
[    5.957692] pci 0000:80:00.1: [8086:09a4] type 00 class 0x088000
[    5.963691] pci 0000:80:00.2: [8086:09a3] type 00 class 0x088000
[    5.969696] pci 0000:80:00.4: [8086:0998] type 00 class 0x060000
[    5.975686] pci 0000:80:02.0: [8086:09a6] type 00 class 0x088000
[    5.981638] pci 0000:80:02.0: reg 0x10: [mem 0xc6aa4000-0xc6aa5fff]
[    5.988678] pci 0000:80:02.1: [8086:09a7] type 00 class 0x088000
[    5.994638] pci 0000:80:02.1: reg 0x10: [mem 0xc6a00000-0xc6a7ffff]
[    6.000635] pci 0000:80:02.1: reg 0x14: [mem 0xc6980000-0xc69fffff]
[    6.006674] pci 0000:80:02.4: [8086:3456] type 00 class 0x130000
[    6.012639] pci 0000:80:02.4: reg 0x10: [mem 0xc6800000-0xc68fffff 64bit]
[    6.019636] pci 0000:80:02.4: reg 0x18: [mem 0xc6aa0000-0xc6aa3fff 64bit]
[    6.026637] pci 0000:80:02.4: reg 0x20: [mem 0xc6a80000-0xc6a9ffff 64bit]
[    6.033689] pci_bus 0000:80: on NUMA node 1
[    6.033735] ACPI: PCI Root Bridge [PC07] (domain 0000 [bus 97-af])
[    6.039633] acpi PNP0A08:07: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3]
[    6.053946] acpi PNP0A08:07: _OSC: platform does not support [SHPCHotplug AER DPC]
[    6.061717] acpi PNP0A08:07: _OSC: OS now controls [PCIeHotplug PME PCIeCapability LTR]
[    6.069631] acpi PNP0A08:07: FADT indicates ASPM is unsupported, using BIOS configuration
[    6.077704] PCI host bridge to bus 0000:97
[    6.081632] pci_bus 0000:97: root bus resource [io  0xc000-0xcfff window]
[    6.088631] pci_bus 0000:97: root bus resource [mem 0xd1000000-0xdbbfffff window]
[    6.096632] pci_bus 0000:97: root bus resource [mem 0x398000000000-0x39bfffffffff window]
[    6.104632] pci_bus 0000:97: root bus resource [bus 97-af]
[    6.109643] pci 0000:97:00.0: [8086:09a2] type 00 class 0x088000
[    6.115670] pci 0000:97:00.1: [8086:09a4] type 00 class 0x088000
[    6.121698] pci 0000:97:00.2: [8086:09a3] type 00 class 0x088000
[    6.127687] pci 0000:97:00.4: [8086:0998] type 00 class 0x060000
[    6.133692] pci_bus 0000:97: on NUMA node 1
[    6.133737] ACPI: PCI Root Bridge [PC08] (domain 0000 [bus b0-c8])
[    6.140633] acpi PNP0A08:08: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3]
[    6.154726] acpi PNP0A08:08: _OSC: platform does not support [SHPCHotplug AER DPC]
[    6.162718] acpi PNP0A08:08: _OSC: OS now controls [PCIeHotplug PME PCIeCapability LTR]
[    6.170631] acpi PNP0A08:08: FADT indicates ASPM is unsupported, using BIOS configuration
[    6.178713] PCI host bridge to bus 0000:b0
[    6.182632] pci_bus 0000:b0: root bus resource [io  0xd000-0xdfff window]
[    6.189633] pci_bus 0000:b0: root bus resource [mem 0xdbc00000-0xe67fffff window]
[    6.196632] pci_bus 0000:b0: root bus resource [mem 0x39c000000000-0x39ffffffffff window]
[    6.204633] pci_bus 0000:b0: root bus resource [bus b0-c8]
[    6.210640] pci 0000:b0:00.0: [8086:09a2] type 00 class 0x088000
[    6.216686] pci 0000:b0:00.1: [8086:09a4] type 00 class 0x088000
[    6.222684] pci 0000:b0:00.2: [8086:09a3] type 00 class 0x088000
[    6.228685] pci 0000:b0:00.4: [8086:0998] type 00 class 0x060000
[    6.234689] pci 0000:b0:02.0: [8086:347a] type 01 class 0x060400
[    6.240639] pci 0000:b0:02.0: reg 0x10: [mem 0x39fffff20000-0x39fffff3ffff 64bit]
[    6.247665] pci 0000:b0:02.0: PME# supported from D0 D3hot D3cold
[    6.255366] pci 0000:b0:04.0: [8086:347c] type 01 class 0x060400
[    6.260640] pci 0000:b0:04.0: reg 0x10: [mem 0x39fffff00000-0x39fffff1ffff 64bit]
[    6.268641] pci 0000:b0:04.0: enabling Extended Tags
[    6.273658] pci 0000:b0:04.0: PME# supported from D0 D3hot D3cold
[    6.280169] pci 0000:b1:00.0: [1077:8070] type 00 class 0x020000
[    6.286644] pci 0000:b1:00.0: reg 0x10: [mem 0xdd020000-0xdd03ffff 64bit pref]
[    6.293639] pci 0000:b1:00.0: reg 0x18: [mem 0xdc800000-0xdcffffff 64bit pref]
[    6.300638] pci 0000:b1:00.0: reg 0x20: [mem 0xdd050000-0xdd05ffff 64bit pref]
[    6.307636] pci 0000:b1:00.0: reg 0x30: [mem 0xfff80000-0xffffffff pref]
[    6.315182] pci 0000:b1:00.0: PME# supported from D0 D3hot
[    6.320652] pci 0000:b1:00.0: reg 0x1dc: [mem 0xdd360000-0xdd367fff 64bit pref]
[    6.327631] pci 0000:b1:00.0: VF(n) BAR0 space: [mem 0xdd360000-0xdd65ffff 64bit pref] (contains BAR0 for 96 VFs)
[

Comment 6 xudu 2023-02-13 09:25:42 UTC

[   13.737059] [drm] Initialized mgag200 1.0.0 20110418 for 0000:03:00.0 on minor 0
[   13.744470] nfp 0000:17:00.0: BSP: 020028.020028.02007d
[   13.744473] nfp 0000:17:00.0: nfp: drivers/net/ethernet/netronome/nfp/nfp_main.c:390: Looking for firmware file in order of priority:
[   13.744497] nfp 0000:17:00.0: nfp: drivers/net/ethernet/netronome/nfp/nfp_main.c:364:   netronome/serial-00-15-4d-13-5f-0b-10-ff.nffw: not found
[   13.744512] nfp 0000:17:00.0: nfp: drivers/net/ethernet/netronome/nfp/nfp_main.c:364:   netronome/pci-0000:17:00.0.nffw: not found
[   13.744528] nfp 0000:17:00.0: nfp: drivers/net/ethernet/netronome/nfp/nfp_main.c:364:   netronome/nic_AMDA0099-0001_2x25.nffw: not found
[   13.744529] nfp 0000:17:00.0: Didn't load firmware, please update flash or reconfigure card
[   13.744875] nfp 0000:17:00.0: nfp: drivers/net/ethernet/netronome/nfp/nfp_net_main.c:459: Failed to find data vNIC memory symbol
[   13.744929] nfp: probe of 0000:17:00.0 failed with error -2
[   13.764849] ata1: SATA link down (SStatus 4 SControl 300)

Comment 7 Stefan Assmann 2023-02-13 10:31:16 UTC

I think I know what's going on.

The firmware for the nfp devices is not present.
In RHEL8 the nfp firmware files are part of the linux-firmware package. In RHEL9 the firmware files were split into a separate package named netronome-firmware. To get the nfp ports working again you will have to install netronome-firmware.

Comment 8 Zhang Kexin 2023-02-13 11:03:55 UTC

(In reply to Stefan Assmann from comment #7)
> I think I know what's going on.
> 
> The firmware for the nfp devices is not present.
> In RHEL8 the nfp firmware files are part of the linux-firmware package. In
> RHEL9 the firmware files were split into a separate package named
> netronome-firmware. To get the nfp ports working again you will have to
> install netronome-firmware.

Thanks for the analysis. Should "install netronome-firmware" be done via LEAPP too?

Comment 9 Petr Stodulka 2023-02-13 11:25:12 UTC

Hi, the bug is caused by invalid PES events, see events:
  # 7864
  # 8024

instead of these two, the one "split" event is expected. In case it should be fixed for the upcoming release, the events should be fixed ideally till the end of this week - before the testing with the new leapp data is started.

Keep the component on kernel as it should be handled by kernel SST and currently the data files are not delivered by any RPM (sigh).
Also, most likely you will have problems to remove those invalid events - in such a case, contact Andrea Waltlova for help.

Comment 10 Petr Stodulka 2023-02-13 11:27:33 UTC

Adding Andrea to Cc.

Comment 12 RHEL Program Management 2023-09-21 18:11:54 UTC

Issue migration from Bugzilla to Jira is in process at this time. This will be the last message in Jira copied from the Bugzilla bug.

Comment 13 RHEL Program Management 2023-09-21 18:12:15 UTC

This BZ has been automatically migrated to the issues.redhat.com Red Hat Issue Tracker. All future work related to this report will be managed there.

Due to differences in account names between systems, some fields were not replicated.  Be sure to add yourself to Jira issue's "Watchers" field to continue receiving updates and add others to the "Need Info From" field to continue requesting information.

To find the migrated issue, look in the "Links" section for a direct link to the new issue location. The issue key will have an icon of 2 footprints next to it, and begin with "RHEL-" followed by an integer.  You can also find this issue by visiting https://issues.redhat.com/issues/?jql= and searching the "Bugzilla Bug" field for this BZ's number, e.g. a search like:

"Bugzilla Bug" = 1234567

In the event you have trouble locating or viewing this issue, you can file an issue by sending mail to rh-issues. You can also visit https://access.redhat.com/articles/7032570 for general account information.

Note You need to log in before you can comment on or make changes to this bug.