1964108 – Disable sniffing of rdma packets on s390x

RHEL Engineering is moving the tracking of its product development work on RHEL 6 through RHEL 9 to Red Hat Jira (issues.redhat.com). If you're a Red Hat customer, please continue to file support cases via the Red Hat customer portal. If you're not, please head to the "RHEL project" in Red Hat Jira and file new tickets here. Individual Bugzilla bugs in the statuses "NEW", "ASSIGNED", and "POST" are being migrated throughout September 2023. Bugs of Red Hat partners with an assigned Engineering Partner Manager (EPM) are migrated in late September as per pre-agreed dates. Bugs against components "kernel", "kernel-rt", and "kpatch" are only migrated if still in "NEW" or "ASSIGNED". If you cannot log in to RH Jira, please consult article #7032570. That failing, please send an e-mail to the RH Jira admins at rh-issues@redhat.com to troubleshoot your issue as a user management inquiry. The email creates a ServiceNow ticket with Red Hat. Individual Bugzilla bugs that are migrated will be moved to status "CLOSED", resolution "MIGRATED", and set with "MigratedToJIRA" in "Keywords". The link to the successor Jira issue will be found under "Links", have a little "two-footprint" icon next to it, and direct you to the "RHEL project" in Red Hat Jira (issue links are of type "https://issues.redhat.com/browse/RHEL-XXXX", where "X" is a digit). This same link will be available in a blue banner at the top of the page informing you that that bug has been migrated.

Bug 1964108 - Disable sniffing of rdma packets on s390x

Summary: Disable sniffing of rdma packets on s390x

Keywords:
Status:	CLOSED WONTFIX
Alias:	None
Product:	Red Hat Enterprise Linux 8
Classification:	Red Hat
Component:	rdma-core
Sub Component:
Version:	8.4
Hardware:	s390x
OS:	Linux
Priority:	unspecified
Severity:	medium
Target Milestone:	beta
Target Release:	---
Assignee:	Nobody
QA Contact:	Afom T. Michael
Docs Contact:
URL:
Whiteboard:
Depends On:
Blocks:	1782876
TreeView+	depends on / blocked

Reported:	2021-05-24 18:03 UTC by Prashanth Sundararaman
Modified:	2023-03-09 16:40 UTC (History)
CC List:	12 users (show)
Fixed In Version:
Doc Type:	If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed:	2022-11-24 07:27:47 UTC
Type:	Bug
Target Upstream Version:
Embargoed:
Dependent Products:
Flags:	pm-rhel: mirror+

Attachments	(Terms of Use)

Links
System	ID	Private	Priority	Status	Summary	Last Updated
Red Hat Issue Tracker	RHELPLAN-80630	0	None	None	None	2021-05-24 18:04:43 UTC

Description Prashanth Sundararaman 2021-05-24 18:03:50 UTC

There is a BZ: https://bugzilla.redhat.com/show_bug.cgi?id=1782876 which was filed against the RHEL CoreOS operating system related to rdma load module service and the inifiniband service failing on installation with RoCE cards. The s390x kernel for RedHat is compiled without infiniband support.

The latest version of libpcap has support for sniffing rdma packets. But since rdma supoort for infiniband is not present for s390x, the dependency needs to be removed.

Comment 1 Prashanth Sundararaman 2021-05-24 18:08:04 UTC

opened: https://src.osci.redhat.com/rpms/libpcap/pull-request/2

Comment 2 Prashanth Sundararaman 2021-06-07 18:26:16 UTC

@mruprich - does the above proposed solution look good?

Comment 3 Michal Ruprich 2021-06-10 08:28:26 UTC

Hi,

thanks for the PR, I will propose this bug for next RHEL release.

Comment 4 Prashanth Sundararaman 2021-08-12 14:12:50 UTC

Hi Michal,

Any updates on this?

Thanks
Prashanth

Comment 5 Michal Ruprich 2021-09-03 08:15:31 UTC

I am planning to fix this in RHEL-8.6.0.

Comment 6 Dan Horák 2021-09-17 09:02:41 UTC

from /boot/config-4.18.0-343.el8.s390x

CONFIG_INFINIBAND=m
# CONFIG_INFINIBAND_USER_MAD is not set
CONFIG_INFINIBAND_USER_ACCESS=m
CONFIG_INFINIBAND_USER_MEM=y
# CONFIG_INFINIBAND_ON_DEMAND_PAGING is not set
CONFIG_INFINIBAND_ADDR_TRANS=y
CONFIG_INFINIBAND_ADDR_TRANS_CONFIGFS=y
CONFIG_INFINIBAND_VIRT_DMA=y
# CONFIG_INFINIBAND_MTHCA is not set
CONFIG_MLX4_INFINIBAND=m
CONFIG_MLX5_INFINIBAND=m
# CONFIG_INFINIBAND_OCRDMA is not set
CONFIG_RDMA_RXE=m
CONFIG_RDMA_SIW=m
# CONFIG_INFINIBAND_IPOIB is not set
# CONFIG_INFINIBAND_SRP is not set
# CONFIG_INFINIBAND_SRPT is not set
# CONFIG_INFINIBAND_ISER is not set
# CONFIG_INFINIBAND_ISERT is not set
# CONFIG_DMADEVICES is not set

so InfiniBand is enabled on s390x, but without IP over IB or SCSI RDMA Protocol over IB or iSCSI Extensions for RDMA. I believe the core RDMA is available and even used in eg. the SMC-R network protocol. Thus I am not sure we want the IB/RDMA parser to be removed from libpcap ... It would cause a regression within the RHEL-8 release.

FWIW there is a request to enable SRP and iSER in the RHEL-9 kernels for s390x.

Comment 7 Michal Ruprich 2021-09-21 11:09:18 UTC

I think that in the end this is not a problem of libpcap. Packaging point of view here is simple, libpcap added rdma-core as a dependency, you can easily install libpcap on s390x and it correctly pulls that dependency in and there is no error:

# uname -a
Linux s390x-kvm-002.lab.eng.rdu2.redhat.com 4.18.0-343.el8.s390x #1 SMP Thu Sep 16 18:17:01 EDT 2021 s390x s390x s390x GNU/Linux
# cat /etc/redhat-release
Red Hat Enterprise Linux release 8.6 Beta (Ootpa)
# rpm -qa | grep -e libpcap -e rdma
rdma-core-35.0-1.el8.s390x
libpcap-1.9.1-5.el8.s390x
# ldd /usr/lib64/libpcap.so.1
	libibverbs.so.1 => /lib64/libibverbs.so.1 (0x000003ff80580000)
	libc.so.6 => /lib64/libc.so.6 (0x000003ff80380000)
	libnl-route-3.so.200 => /lib64/libnl-route-3.so.200 (0x000003ff80280000)
	libnl-3.so.200 => /lib64/libnl-3.so.200 (0x000003ff80200000)
	libpthread.so.0 => /lib64/libpthread.so.0 (0x000003ff80180000)
	libdl.so.2 => /lib64/libdl.so.2 (0x000003ff80100000)
	/lib/ld64.so.1 (0x000003ff80700000)

So from libpcap point of view, everything works as expected. I agree that this is a RHEL issue, not upstream issue and if something needs to change, it would be rdma-core in RHEL8 since it owns the .service files that fail in the end:
# rpm -ql rdma-core | grep service
/usr/lib/systemd/system/rdma-load-modules@.service
/usr/lib/systemd/system/rdma-ndd.service

Switching this to rdma-core.

Comment 8 Honggang LI 2021-09-23 14:11:28 UTC

Hi, Prashanth

=======================================================
commit b02de521022a1d377bf50e3776c48ed8bb564211
Author: Honggang Li <honli>
Date:   Tue Jan 19 11:36:05 2021 +0800

    redhat: Remove base package dependency from all sub-packages
    
    Depends on base package is useful for RDMA users. Unfortunately,
    it will pull unwanted packages for Cloud or Edge users who may
    don't have RDMA hardware.
=========================================================

I think this commit addresses the issue for you. The rhel-8.4 rdma-core does not include it.
Can you please test rhel-8.5? rhel-8.5 rdma-core has this fix.

thanks

Comment 11 Prashanth Sundararaman 2021-11-12 17:11:08 UTC

Hi Honggang,

I can confirm that after pulling this fix: https://github.com/linux-rdma/rdma-core/pull/933 into http://pkgs.devel.redhat.com/cgit/rpms/rdma-core/tree/rdma-core.spec?h=rhel-8.5.0, it works. I do not see rdma-core included anymore. If you could also patch http://pkgs.devel.redhat.com/cgit/rpms/rdma-core/tree/rdma-core.spec?h=rhel-8.5.0, that would be great.

Thanks
Prashanth

Comment 12 Honggang LI 2021-11-12 23:55:14 UTC

Hi, Prashanth

You want rhel-8.5.0.z and rhel-8.4.0.z backport for https://github.com/linux-rdma/rdma-core/pull/933 .

Is this right?

Comment 13 Prashanth Sundararaman 2021-11-12 23:57:58 UTC

correct. thanks!

Comment 20 RHEL Program Management 2022-11-24 07:27:47 UTC

After evaluating this issue, there are no plans to address it further or fix it in an upcoming release.  Therefore, it is being closed.  If plans change such that this issue will be fixed in an upcoming release, then the bug can be reopened.

Note You need to log in before you can comment on or make changes to this bug.