2227899 – [RHEL8.9] fabtests result in lots of core files when run in E810 iRDMA IW device

Bug 2227899 - [RHEL8.9] fabtests result in lots of core files when run in E810 iRDMA IW device

Summary: [RHEL8.9] fabtests result in lots of core files when run in E810 iRDMA IW device

Keywords:
Status:	NEW
Alias:	None
Product:	Red Hat Enterprise Linux 8
Classification:	Red Hat
Component:	fabtests
Sub Component:
Version:	8.9
Hardware:	Unspecified
OS:	Unspecified
Priority:	unspecified
Severity:	unspecified
Target Milestone:	rc
Target Release:	---
Assignee:	Kamal Heib
QA Contact:	Brian Chae
Docs Contact:
URL:
Whiteboard:
Depends On:
Blocks:
TreeView+	depends on / blocked

Reported:	2023-07-31 19:23 UTC by Brian Chae
Modified:	2023-07-31 19:43 UTC (History)
CC List:	3 users (show)
Fixed In Version:
Doc Type:	If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed:
Type:	Bug
Target Upstream Version:
Embargoed:
Dependent Products:

Attachments	(Terms of Use)

Links
System	ID	Private	Priority	Status	Summary	Last Updated
Red Hat Issue Tracker	RHELPLAN-163934	0	None	None	None	2023-07-31 19:26:17 UTC

Description Brian Chae 2023-07-31 19:23:57 UTC

Description of problem:

SIGABRT core files were observed during the fabtests on RHEL-8.9.0-20230728.11 compose.

Version-Release number of selected component (if applicable):

Clients: rdma-dev-31
Servers: rdma-dev-30

DISTRO=RHEL-8.9.0-20230728.11

+ [23-07-28 16:14:30] cat /etc/redhat-release
Red Hat Enterprise Linux release 8.9 Beta (Ootpa)

+ [23-07-28 16:14:30] uname -a
Linux rdma-dev-30.rdma.lab.eng.rdu2.redhat.com 4.18.0-505.el8.x86_64 #1 SMP Tue Jul 25 11:48:20 EDT 2023 x86_64 x86_64 x86_64 GNU/Linux

+ [23-07-28 16:14:30] cat /proc/cmdline
BOOT_IMAGE=(hd0,gpt2)/vmlinuz-4.18.0-505.el8.x86_64 root=UUID=0bed7f80-86c2-46ed-a825-fa3b27e8c194 ro crashkernel=auto resume=UUID=3642ab93-41cb-4622-bf66-af00505a317f console=ttyS0,115200n81

+ [23-07-28 16:14:30] rpm -q rdma-core linux-firmware
rdma-core-46.0-1.el8.1.x86_64
linux-firmware-20230711-116.gitd3f66064.el8.noarch

+ [23-07-28 16:14:30] tail /sys/class/infiniband/irdma0/fw_ver /sys/class/infiniband/irdma1/fw_ver
==> /sys/class/infiniband/irdma0/fw_ver <==
1.52

==> /sys/class/infiniband/irdma1/fw_ver <==
1.52
+ [23-07-28 16:14:30] lspci
+ [23-07-28 16:14:30] grep -i -e ethernet -e infiniband -e omni -e ConnectX
04:00.0 Ethernet controller: Broadcom Inc. and subsidiaries NetXtreme BCM5719 Gigabit Ethernet PCIe (rev 01)
04:00.1 Ethernet controller: Broadcom Inc. and subsidiaries NetXtreme BCM5719 Gigabit Ethernet PCIe (rev 01)
04:00.2 Ethernet controller: Broadcom Inc. and subsidiaries NetXtreme BCM5719 Gigabit Ethernet PCIe (rev 01)
04:00.3 Ethernet controller: Broadcom Inc. and subsidiaries NetXtreme BCM5719 Gigabit Ethernet PCIe (rev 01)
44:00.0 Ethernet controller: Intel Corporation Ethernet Controller E810-C for QSFP (rev 02)
44:00.1 Ethernet controller: Intel Corporation Ethernet Controller E810-C for QSFP (rev 02)


How reproducible:


Steps to Reproduce:
1. 1. run the fatests with the above packages on the above E810 iRDMA IW device

2.
3.

Actual results: the following cores found in RDMA server side

TIME                            PID   UID   GID SIG COREFILE  EXE
Fri 2023-07-28 20:11:57 EDT   72674     0     0   6 present   /usr/bin/fi_av_xfer
Fri 2023-07-28 20:12:05 EDT   72769     0     0   6 present   /usr/bin/fi_av_xfer
Fri 2023-07-28 20:12:29 EDT   72872     0     0   6 present   /usr/bin/fi_cq_data
Fri 2023-07-28 20:12:50 EDT   72969     0     0   6 present   /usr/bin/fi_cq_data
Fri 2023-07-28 20:13:10 EDT   73065     0     0   6 present   /usr/bin/fi_cq_data
Fri 2023-07-28 20:13:30 EDT   73162     0     0   6 present   /usr/bin/fi_cq_data
Fri 2023-07-28 20:13:51 EDT   73262     0     0   6 present   /usr/bin/fi_dgram
Fri 2023-07-28 20:14:12 EDT   73357     0     0   6 present   /usr/bin/fi_dgram_waitset
Fri 2023-07-28 20:14:37 EDT   73540     0     0   6 present   /usr/bin/fi_dgram_pingpong
Fri 2023-07-28 20:14:51 EDT   73643     0     0   6 present   /usr/bin/fi_inject_test
Fri 2023-07-28 20:15:12 EDT   73739     0     0   6 present   /usr/bin/fi_inject_test
Fri 2023-07-28 20:15:32 EDT   73836     0     0   6 present   /usr/bin/fi_inject_test
Fri 2023-07-28 20:15:52 EDT   73933     0     0   6 present   /usr/bin/fi_inject_test
Fri 2023-07-28 20:16:18 EDT   74031     0     0   6 present   /usr/bin/fi_multi_mr
Fri 2023-07-28 20:16:48 EDT   74141     0     0   6 present   /usr/bin/fi_multi_recv
Fri 2023-07-28 20:17:10 EDT   74324     0     0   6 present   /usr/bin/fi_poll
Fri 2023-07-28 20:17:30 EDT   74420     0     0   6 present   /usr/bin/fi_poll
Fri 2023-07-28 20:17:52 EDT   74523     0     0   6 present   /usr/bin/fi_rdm
Fri 2023-07-28 20:18:14 EDT   74618     0     0   6 present   /usr/bin/fi_bw
Fri 2023-07-28 20:18:34 EDT   74713     0     0   6 present   /usr/bin/fi_rdm_atomic
Fri 2023-07-28 20:18:56 EDT   74812     0     0   6 present   /usr/bin/fi_rdm_pingpong
Fri 2023-07-28 20:19:16 EDT   74907     0     0   6 present   /usr/bin/fi_rdm_pingpong
Fri 2023-07-28 20:19:37 EDT   75003     0     0   6 present   /usr/bin/fi_rdm_pingpong
Fri 2023-07-28 20:19:58 EDT   75100     0     0   6 present   /usr/bin/fi_rdm_tagged_pingpong
Fri 2023-07-28 20:20:18 EDT   75198     0     0   6 present   /usr/bin/fi_rdm_tagged_bw
Fri 2023-07-28 20:20:40 EDT   75295     0     0   6 present   /usr/bin/fi_rdm_tagged_pingpong
Fri 2023-07-28 20:21:00 EDT   75390     0     0   6 present   /usr/bin/fi_rdm_tagged_bw
Fri 2023-07-28 20:21:21 EDT   75487     0     0   6 present   /usr/bin/fi_rdm_pingpong
Fri 2023-07-28 20:21:41 EDT   75583     0     0   6 present   /usr/bin/fi_rdm_tagged_pingpong
Fri 2023-07-28 20:22:01 EDT   75682     0     0   6 present   /usr/bin/fi_rdm_tagged_bw
Fri 2023-07-28 20:22:20 EDT   75778     0     0   6 present   /usr/bin/fi_rdm
Fri 2023-07-28 20:22:42 EDT   75876     0     0   6 present   /usr/bin/fi_bw
Fri 2023-07-28 20:23:02 EDT   75973     0     0   6 present   /usr/bin/fi_rdm_atomic
Fri 2023-07-28 20:23:22 EDT   76068     0     0   6 present   /usr/bin/fi_rdm_tagged_pingpong
Fri 2023-07-28 20:23:42 EDT   76165     0     0   6 present   /usr/bin/fi_rdm_tagged_bw
Fri 2023-07-28 20:24:01 EDT   76261     0     0   6 present   /usr/bin/fi_rdm_rma_event
Fri 2023-07-28 20:24:22 EDT   76356     0     0   6 present   /usr/bin/fi_rdm_rma_trigger
Fri 2023-07-28 20:24:42 EDT   76453     0     0   6 present   /usr/bin/fi_rdm_tagged_peek
Fri 2023-07-28 20:25:02 EDT   76549     0     0   6 present   /usr/bin/fi_rdm_shared_av
Fri 2023-07-28 20:25:28 EDT   76646     0     0   6 present   /usr/bin/fi_recv_cancel
Fri 2023-07-28 20:25:49 EDT   76743     0     0   6 present   /usr/bin/fi_rma_bw
Fri 2023-07-28 20:26:09 EDT   76837     0     0   6 present   /usr/bin/fi_rma_bw
Fri 2023-07-28 20:26:29 EDT   76932     0     0   6 present   /usr/bin/fi_rma_bw
Fri 2023-07-28 20:26:53 EDT   77030     0     0   6 present   /usr/bin/fi_rma_bw
Fri 2023-07-28 20:27:13 EDT   77126     0     0   6 present   /usr/bin/fi_rma_bw
Fri 2023-07-28 20:27:33 EDT   77224     0     0   6 present   /usr/bin/fi_rma_bw
Fri 2023-07-28 20:28:03 EDT   77408     0     0   6 present   /usr/bin/fi_unexpected_msg
Fri 2023-07-28 21:05:28 EDT  113236     0     0   6 present   /usr/bin/fi_av_xfer
Fri 2023-07-28 21:05:48 EDT  113330     0     0   6 present   /usr/bin/fi_av_xfer
Fri 2023-07-28 21:06:13 EDT  113425     0     0   6 present   /usr/bin/fi_cq_data
Fri 2023-07-28 21:06:33 EDT  113519     0     0   6 present   /usr/bin/fi_cq_data
Fri 2023-07-28 21:06:53 EDT  113612     0     0   6 present   /usr/bin/fi_cq_data
Fri 2023-07-28 21:07:13 EDT  113709     0     0   6 present   /usr/bin/fi_cq_data
Fri 2023-07-28 21:07:35 EDT  113804     0     0   6 present   /usr/bin/fi_dgram
Fri 2023-07-28 21:07:55 EDT  113896     0     0   6 present   /usr/bin/fi_dgram_waitset
Fri 2023-07-28 21:08:21 EDT  114073     0     0   6 present   /usr/bin/fi_dgram_pingpong
Fri 2023-07-28 21:08:35 EDT  114168     0     0   6 present   /usr/bin/fi_inject_test
Fri 2023-07-28 21:08:55 EDT  114262     0     0   6 present   /usr/bin/fi_inject_test
Fri 2023-07-28 21:09:15 EDT  114355     0     0   6 present   /usr/bin/fi_inject_test
Fri 2023-07-28 21:09:36 EDT  114450     0     0   6 present   /usr/bin/fi_inject_test
Fri 2023-07-28 21:10:01 EDT  114543     0     0   6 present   /usr/bin/fi_multi_mr
Fri 2023-07-28 21:10:31 EDT  114639     0     0   6 present   /usr/bin/fi_multi_recv
Fri 2023-07-28 21:10:54 EDT  114819     0     0   6 present   /usr/bin/fi_poll
Fri 2023-07-28 21:11:14 EDT  114912     0     0   6 present   /usr/bin/fi_poll
Fri 2023-07-28 21:11:35 EDT  115005     0     0   6 present   /usr/bin/fi_rdm
Fri 2023-07-28 21:11:57 EDT  115100     0     0   6 present   /usr/bin/fi_bw
Fri 2023-07-28 21:12:18 EDT  115195     0     0   6 present   /usr/bin/fi_rdm_atomic
Fri 2023-07-28 21:12:40 EDT  115289     0     0   6 present   /usr/bin/fi_rdm_pingpong
Fri 2023-07-28 21:13:00 EDT  115381     0     0   6 present   /usr/bin/fi_rdm_pingpong
Fri 2023-07-28 21:13:20 EDT  115476     0     0   6 present   /usr/bin/fi_rdm_pingpong
Fri 2023-07-28 21:13:42 EDT  115571     0     0   6 present   /usr/bin/fi_rdm_tagged_pingpong
Fri 2023-07-28 21:14:02 EDT  115665     0     0   6 present   /usr/bin/fi_rdm_tagged_bw
Fri 2023-07-28 21:14:36 EDT  115759     0     0   6 present   /usr/bin/fi_rdm_tagged_pingpong
Fri 2023-07-28 21:14:44 EDT  115855     0     0   6 present   /usr/bin/fi_rdm_tagged_bw
Fri 2023-07-28 21:15:04 EDT  115948     0     0   6 present   /usr/bin/fi_rdm_pingpong
Fri 2023-07-28 21:15:24 EDT  116042     0     0   6 present   /usr/bin/fi_rdm_tagged_pingpong
Fri 2023-07-28 21:15:45 EDT  116138     0     0   6 present   /usr/bin/fi_rdm_tagged_bw
Fri 2023-07-28 21:16:03 EDT  116230     0     0   6 present   /usr/bin/fi_rdm
Fri 2023-07-28 21:16:25 EDT  116324     0     0   6 present   /usr/bin/fi_bw
Fri 2023-07-28 21:16:46 EDT  116420     0     0   6 present   /usr/bin/fi_rdm_atomic
Fri 2023-07-28 21:17:06 EDT  116512     0     0   6 present   /usr/bin/fi_rdm_tagged_pingpong
Fri 2023-07-28 21:17:26 EDT  116605     0     0   6 present   /usr/bin/fi_rdm_tagged_bw
Fri 2023-07-28 21:17:45 EDT  116702     0     0   6 present   /usr/bin/fi_rdm_rma_event
Fri 2023-07-28 21:18:06 EDT  116795     0     0   6 present   /usr/bin/fi_rdm_rma_trigger
Fri 2023-07-28 21:18:25 EDT  116888     0     0   6 present   /usr/bin/fi_rdm_tagged_peek
Fri 2023-07-28 21:18:46 EDT  116983     0     0   6 present   /usr/bin/fi_rdm_shared_av
Fri 2023-07-28 21:19:08 EDT  117080     0     0   6 present   /usr/bin/fi_recv_cancel
Fri 2023-07-28 21:19:32 EDT  117172     0     0   6 present   /usr/bin/fi_rma_bw
Fri 2023-07-28 21:19:52 EDT  117267     0     0   6 present   /usr/bin/fi_rma_bw
Fri 2023-07-28 21:20:12 EDT  117365     0     0   6 present   /usr/bin/fi_rma_bw
Fri 2023-07-28 21:20:36 EDT  117461     0     0   6 present   /usr/bin/fi_rma_bw
Fri 2023-07-28 21:21:05 EDT  117555     0     0   6 present   /usr/bin/fi_rma_bw
Fri 2023-07-28 21:21:25 EDT  117650     0     0   6 present   /usr/bin/fi_rma_bw
Fri 2023-07-28 21:21:47 EDT  117829     0     0   6 present   /usr/bin/fi_unexpected_msg
total 328992


Expected results:


Additional info:

Note You need to log in before you can comment on or make changes to this bug.