Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

RHEL Engineering is moving the tracking of its product development work on RHEL 6 through RHEL 9 to Red Hat Jira (issues.redhat.com). If you're a Red Hat customer, please continue to file support cases via the Red Hat customer portal. If you're not, please head to the "RHEL project" in Red Hat Jira and file new tickets here. Individual Bugzilla bugs in the statuses "NEW", "ASSIGNED", and "POST" are being migrated throughout September 2023. Bugs of Red Hat partners with an assigned Engineering Partner Manager (EPM) are migrated in late September as per pre-agreed dates. Bugs against components "kernel", "kernel-rt", and "kpatch" are only migrated if still in "NEW" or "ASSIGNED". If you cannot log in to RH Jira, please consult article #7032570. That failing, please send an e-mail to the RH Jira admins at rh-issues@redhat.com to troubleshoot your issue as a user management inquiry. The email creates a ServiceNow ticket with Red Hat. Individual Bugzilla bugs that are migrated will be moved to status "CLOSED", resolution "MIGRATED", and set with "MigratedToJIRA" in "Keywords". The link to the successor Jira issue will be found under "Links", have a little "two-footprint" icon next to it, and direct you to the "RHEL project" in Red Hat Jira (issue links are of type "https://issues.redhat.com/browse/RHEL-XXXX", where "X" is a digit). This same link will be available in a blue banner at the top of the page informing you that that bug has been migrated.

Bug 1961180

Summary:	[RHEL9] Get wrong FCoE interface name
Product:	Red Hat Enterprise Linux 9	Reporter:	guazhang <guazhang>
Component:	fcoe-utils	Assignee:	Chris Leech <cleech>
Status:	CLOSED CURRENTRELEASE	QA Contact:	guazhang <guazhang>
Severity:	unspecified	Docs Contact:
Priority:	unspecified
Version:	9.0	CC:	cleech, jmeneghi, pvlasin
Target Milestone:	beta	Keywords:	TestBlocker, Triaged
Target Release:	---	Flags:	pm-rhel: mirror+
Hardware:	Unspecified
OS:	Unspecified
Whiteboard:
Fixed In Version:	fcoe-utils-1.0.34-0.git14ef0d2.el9_b	Doc Type:	If docs needed, set a value
Doc Text:		Story Points:	---
Clone Of:
Clones:	2002987 2003230 (view as bug list)		Environment:
Last Closed:	2021-12-07 21:52:33 UTC	Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:
Bug Depends On:
Bug Blocks:	2002987, 2003230

Description guazhang@redhat.com 2021-05-17 12:49:23 UTC

Description of problem:
after discover FCoE interface then found the interface name is wrong, and can not list fcoe interface with cmd fcoeadm -i 

Version-Release number of selected component (if applicable):
fcoe-utils-1.0.33-6.git848bcc6.el9.x86_64

How reproducible:
always

Steps to Reproduce:
1. discover fcoe luns 
2. ip a 
3. fcoeadm -i

Actual results:
can not fcoe interface

Expected results:
get the right fcoe interface name 

Additional info:

9: enp17s0f0200@enp17s0f0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether 00:0a:f7:27:e1:b0 brd ff:ff:ff:ff:ff:ff
    inet6 fe80::20a:f7ff:fe27:e1b0/64 scope link 
       valid_lft forever preferred_lft forever
10: enp17s0f1200@enp17s0f1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether 00:0a:f7:27:e1:b2 brd ff:ff:ff:ff:ff:ff
    inet6 fe80::20a:f7ff:fe27:e1b2/64 scope link 
       valid_lft forever preferred_lft forever

[root@storageqe-53 ~]# rpm -qa |grep fcoe-utils
fcoe-utils-1.0.33-6.git848bcc6.el9.x86_64
[root@storageqe-53 ~]# fcoeadm -i
[root@storageqe-53 ~]# ethtool enp17s0f1
Settings for enp17s0f1:
	Supported ports: [ FIBRE ]
	Supported link modes:   1000baseT/Full
	                        10000baseT/Full
	Supported pause frame use: Symmetric Receive-only
	Supports auto-negotiation: No
	Supported FEC modes: Not reported
	Advertised link modes:  10000baseT/Full
	Advertised pause frame use: No
	Advertised auto-negotiation: No
	Advertised FEC modes: Not reported
	Speed: 10000Mb/s
	Duplex: Full
	Auto-negotiation: off
	Port: FIBRE
	PHYAD: 1
	Transceiver: internal
	Supports Wake-on: g
	Wake-on: d
        Current message level: 0x00000000 (0)
                              
	Link detected: yes
[root@storageqe-53 ~]# 


it same with bug https://bugzilla.redhat.com/show_bug.cgi?id=1918561

Comment 1 guazhang@redhat.com 2021-08-04 12:40:37 UTC

# ip a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
2: eno1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
    link/ether b8:83:03:51:82:de brd ff:ff:ff:ff:ff:ff
    altname enp2s0f0
    inet 10.73.130.41/23 brd 10.73.131.255 scope global dynamic noprefixroute eno1
       valid_lft 42978sec preferred_lft 42978sec
3: eno2: <BROADCAST,MULTICAST> mtu 1500 qdisc mq state DOWN group default qlen 1000
    link/ether b8:83:03:51:82:df brd ff:ff:ff:ff:ff:ff
    altname enp2s0f1
4: eno3: <BROADCAST,MULTICAST> mtu 1500 qdisc mq state DOWN group default qlen 1000
    link/ether b8:83:03:51:82:e0 brd ff:ff:ff:ff:ff:ff
    altname enp2s0f2
5: eno4: <BROADCAST,MULTICAST> mtu 1500 qdisc mq state DOWN group default qlen 1000
    link/ether b8:83:03:51:82:e1 brd ff:ff:ff:ff:ff:ff
    altname enp2s0f3
6: ens5f0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
    link/ether 6c:b3:11:4e:ce:f0 brd ff:ff:ff:ff:ff:ff
    altname enp134s0f0
7: ens5f1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
    link/ether 6c:b3:11:4e:ce:f2 brd ff:ff:ff:ff:ff:ff
    altname enp134s0f1
8: ens5f2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
    link/ether 6c:b3:11:4e:ce:f4 brd ff:ff:ff:ff:ff:ff
    altname enp134s0f2
9: ens5f3: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc mq state UP group default qlen 1000
    link/ether 6c:b3:11:4e:ce:f6 brd ff:ff:ff:ff:ff:ff
    altname enp134s0f3
10: ens5f0200@ens5f0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether 6c:b3:11:4e:ce:f0 brd ff:ff:ff:ff:ff:ff
11: ens5f1200@ens5f1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether 6c:b3:11:4e:ce:f2 brd ff:ff:ff:ff:ff:ff
12: ens5f2200@ens5f2: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether 6c:b3:11:4e:ce:f4 brd ff:ff:ff:ff:ff:ff
13: ens5f3200@ens5f3: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether 6c:b3:11:4e:ce:f6 brd ff:ff:ff:ff:ff:ff

Comment 12 guazhang@redhat.com 2021-09-10 11:00:15 UTC

test pass with scratch build

Comment 15 guazhang@redhat.com 2021-09-11 03:13:07 UTC

HI


the FCoE interface looks right, and list some interfaces with fcoeadm -i

8: ens2f0.200-fcoe@ens2f0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether f4:e9:d4:45:5e:20 brd ff:ff:ff:ff:ff:ff
9: ens2f1.200-fcoe@ens2f1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether f4:e9:d4:45:5e:22 brd ff:ff:ff:ff:ff:ff

# fcoeadm -i
    Description:      NetXtreme II BCM57810 10 Gigabit Ethernet
    Revision:         10
    Manufacturer:     Broadcom Inc. and subsidiaries
    Serial Number:    F4E9D4455E20

    Driver:           bnx2x Unknown
    Number of Ports:  1

        Symbolic Name:     bnx2fc (QLogic BCM57810) v2.12.13 over ens2f1.200-fcoe
        OS Device Name:    host3
        Node Name:         0x2000f4e9d4455e23
        Port Name:         0x2001f4e9d4455e23
        Fabric Name:       0x20c8002a6aa7e701
        Speed:             10 Gbit
        Supported Speed:   1 Gbit, 10 Gbit
        MaxFrameSize:      2048 bytes
        FC-ID (Port ID):   0xba0001
        State:             Online
    Description:      NetXtreme II BCM57810 10 Gigabit Ethernet
    Revision:         10
    Manufacturer:     Broadcom Inc. and subsidiaries
    Serial Number:    F4E9D4455E20

    Driver:           bnx2x Unknown
    Number of Ports:  1

        Symbolic Name:     bnx2fc (QLogic BCM57810) v2.12.13 over ens2f0.200-fcoe
        OS Device Name:    host2
        Node Name:         0x2000f4e9d4455e21
        Port Name:         0x2001f4e9d4455e21
        Fabric Name:       0x20c8002a6aa7e701
        Speed:             10 Gbit
        Supported Speed:   1 Gbit, 10 Gbit
        MaxFrameSize:      2048 bytes
        FC-ID (Port ID):   0xba0140
        State:             Online


but still hit some questions after full fcoe regression testing.

5.14.0-1.el9.x86_64
RHEL-9.0.0-20210907.4


1) the interface name still don't change in boot from SAN server, the fcoe interface bring up in anacanda, so any changes in anacanda ?


8: ens2f0200@ens2f0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether f4:e9:d4:45:34:c0 brd ff:ff:ff:ff:ff:ff
9: ens2f1200@ens2f1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether f4:e9:d4:45:34:c2 brd ff:ff:ff:ff:ff:ff


2) the lvm device disappear after reboot which created with FCoE luns.

 sdc                                   8:32   0    90G  0 disk  
└─360a9800042566643352b476d674b4863 253:3    0    90G  0 mpath 
  └─testvg-test_lv                  253:6    0   500M  0 lvm   /mnt/mytest

add the line to /etc/fstab 
/dev/mapper/testvg-test_lv      /mnt/mytest     xfs     _netdev 0 2

reboot 
sdc                                   8:32   0    90G  0 disk  
└─360a9800042566643352b476d674b4863 253:5    0    90G  0 mpath 

refer the bug 
https://bugzilla.redhat.com/show_bug.cgi?id=980961



3) the kernel will hit some errors when remove vport or run "modprobe -r bnx2x"

[root@storageqe-67 ~]# echo 2000000000000001:1000000000000001>/sys/class/fc_host/host3/vport_create
[root@storageqe-67 ~]# echo 2000000000000002:1000000000000002>/sys/class/fc_host/host2/vport_create
[root@storageqe-67 ~]# service fcoe restart
Redirecting to /bin/systemctl restart fcoe.service
[root@storageqe-67 ~]# echo 2000000000000001:1000000000000001>/sys/class/fc_host/host3/vport_delete
[root@storageqe-67 ~]# echo 2000000000000002:1000000000000002>/sys/class/fc_host/host2/vport_delete
[root@storageqe-67 ~]# 



storageqe-67 login: 
storageqe-67 login: [ 1452.621171] bnx2fc: Setting vport names, 0x1000000000000001 0x2000000000000001
[ 1472.353978] bnx2fc: Setting vport names, 0x1000000000000002 0x2000000000000002

storageqe-67 login: [ 1519.330159] ------------[ cut here ]------------
[ 1519.334814] sysfs group 'power' not found for kobject 'rport-7:0-1'
[ 1519.341128] WARNING: CPU: 25 PID: 337 at fs/sysfs/group.c:279 sysfs_remove_group+0x6f/0x80
[ 1519.349449] Modules linked in: bnx2i libiscsi scsi_transport_iscsi binfmt_misc rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache netfs dm_service_time qedf qed 8021q garp mrp stp llc crc8 bnx2fc cnic uio rfkill libfcoe libfc scsi_transport_fc sunrpc dm_multipath intel_rapl_msr intel_rapl_common isst_if_common nfit libnvdimm x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel ipmi_ssif kvm irqbypass mgag200 rapl i2c_algo_bit intel_cstate acpi_ipmi drm_kms_helper ipmi_si syscopyarea sysfillrect sysimgblt ses fb_sys_fops intel_uncore ipmi_devintf hpilo enclosure pcspkr mei_me cec lpc_ich ipmi_msghandler mei ioatdma dca acpi_tad acpi_power_meter drm fuse xfs sd_mod t10_pi sg bnx2x crct10dif_pclmul crc32_pclmul smartpqi ghash_clmulni_intel serio_raw tg3 scsi_transport_sas uas mdio libcrc32c crc32c_intel usb_storage hpwdt wmi dm_mirror dm_region_hash dm_log dm_mod
[ 1519.428229] CPU: 25 PID: 337 Comm: kworker/25:1 Kdump: loaded Tainted: G        W I      --------- ---  5.14.0-1.el9.x86_64 #1
[ 1519.439689] Hardware name: HPE ProLiant DL380 Gen10/ProLiant DL380 Gen10, BIOS U30 11/13/2019
[ 1519.448265] Workqueue: fc_wq_7 fc_rport_final_delete [scsi_transport_fc]
[ 1519.455016] RIP: 0010:sysfs_remove_group+0x6f/0x80
[ 1519.459838] Code: ff 5b 48 89 ef 5d 41 5c e9 8e c0 ff ff 48 89 ef e8 a6 b9 ff ff eb d1 49 8b 14 24 48 8b 33 48 c7 c7 30 dc 15 b8 e8 24 15 5f 00 <0f> 0b 5b 5d 41 5c c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00
[ 1519.478722] RSP: 0018:ffffae9a069abdc0 EFLAGS: 00010282
[ 1519.483980] RAX: 0000000000000000 RBX: ffffffffb7ec33e0 RCX: 0000000000000000
[ 1519.491161] RDX: ffff9108afc68480 RSI: ffff9108afc57cc0 RDI: ffff9108afc57cc0
[ 1519.498341] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffae9a069abbf8
[ 1519.505519] R10: ffffae9a069abbf0 R11: ffffffffb8be7a48 R12: ffff910200868800
[ 1519.512697] R13: ffff910200868880 R14: ffff9104da1dd000 R15: 0000000000000002
[ 1519.519876] FS:  0000000000000000(0000) GS:ffff9108afc40000(0000) knlGS:0000000000000000
[ 1519.528016] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 1519.533799] CR2: 00007ffe4cbd81f8 CR3: 00000004e9a6c004 CR4: 00000000007706e0
[ 1519.540979] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 1519.548157] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 1519.555335] PKRU: 55555554
[ 1519.558059] Call Trace:
[ 1519.560522]  device_del+0xb2/0x3e0
[ 1519.563949]  device_unregister+0x13/0x60
[ 1519.567897]  bsg_unregister_queue+0x5b/0x80
[ 1519.572109]  bsg_remove_queue+0x1c/0x40
[ 1519.575972]  fc_rport_final_delete+0xf3/0x1d0 [scsi_transport_fc]
[ 1519.582107]  process_one_work+0x1e6/0x380
[ 1519.586143]  worker_thread+0x53/0x3d0
[ 1519.589830]  ? process_one_work+0x380/0x380
[ 1519.594039]  kthread+0x10f/0x130
[ 1519.597290]  ? set_kthread_struct+0x40/0x40
[ 1519.601500]  ret_from_fork+0x22/0x30
[ 1519.605105] ---[ end trace f2b9d5164555ff64 ]---
[ 1519.609818] ------------[ cut here ]------------
[ 1519.614466] sysfs group 'statistics' not found for kobject 'rport-7:0-0'
[ 1519.621210] WARNING: CPU: 25 PID: 10740 at fs/sysfs/group.c:279 sysfs_remove_group+0x6f/0x80
[ 1519.629701] Modules linked in: bnx2i libiscsi scsi_transport_iscsi binfmt_misc rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache netfs dm_service_time qedf qed 8021q garp mrp stp llc crc8 bnx2fc cnic uio rfkill libfcoe libfc scsi_transport_fc sunrpc dm_multipath intel_rapl_msr intel_rapl_common isst_if_common nfit libnvdimm x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel ipmi_ssif kvm irqbypass mgag200 rapl i2c_algo_bit intel_cstate acpi_ipmi drm_kms_helper ipmi_si syscopyarea sysfillrect sysimgblt ses fb_sys_fops intel_uncore ipmi_devintf hpilo enclosure pcspkr mei_me cec lpc_ich ipmi_msghandler mei ioatdma dca acpi_tad acpi_power_meter drm fuse xfs sd_mod t10_pi sg bnx2x crct10dif_pclmul crc32_pclmul smartpqi g00000000000002
[ 1520.079172] FS:  0000000000000000(0000) GS:ffff9108afc40000(0000) knlGS:0000000000000000
[ 1520.087311] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 1520.093092] CR2: 00007ffe4cbd81f8 CR3: 00000004e9a6c004 CR4: 00000000007706e0
[ 1520.100270] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 1520.107449] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 1520.114630] PKRU: 55555554
[ 1520.117354] Call Trace:
[ 1520.119816]  device_del+0xb2/0x3e0
[ 1520.123240]  transport_remove_classdev+0x4c/0x60
[ 1520.127886]  ? transport_add_device+0x20/0x20
[ 1520.132270]  attribute_container_device_trigger+0xdb/0xf0
[ 1520.137704]  fc_rport_final_delete+0xfb/0x1d0 [scsi_transport_fc]
[ 1520.143838]  process_one_work+0x1e6/0x380
[ 1520.147873]  worker_thread+0x53/0x3d0
[ 1520.151557]  ? process_one_work+0x380/0x380
[ 1520.155766]  kthread+0x10f/0x130
[ 1520.159017]  ? set_kthread_struct+0x40/0x40
[ 1520.163227]  ret_from_fork+0x22/0x30
[ 1520.166827] ---[ end trace f2b9d5164555ff66 ]---
[ 1520.171548] ----I      --------- ---  5.14.0-1.el9.x86_64 #1
[ 1520.560342] Hardware name: HPE ProLiant DL380 Gen10/ProLiant DL380 Gen10, BIOS U30 11/13/2019
[ 1520.568918] Workqueue: fc_wq_7 fc_rport_final_delete [scsi_transport_fc]
[ 1520.575663] RIP: 0010:sysfs_remove_group+0x6f/0x80
[ 1520.580484] Code: ff 5b 48 89 ef 5d 41 5c e9 8e c0 ff ff 48 89 ef e8 a6 b9 ff ff eb d1 49 8b 14 24 48 8b 33 48 c7 c7 30 dc 15 b8 e8 24 15 5f 00 <0f> 0b 5b 5d 41 5c c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00
[ 1520.599368] RSP: 0018:ffffae9a049afdf8 EFLAGS: 00010282
[ 1520.604625] RAX: 0000000000000000 RBX: ffffffffb7ec33e0 RCX: 0000000000000000
[ 1520.611803] RDX: ffff9108afc68480 RSI: ffff9108afc57cc0 RDI: ffff9108afc57cc0
[ 1520.618983] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffae9a049afc30
[ 1520.626160] R10: ffffae9a049afc28 R11: ffffffffb8be7a48 R12: ffff910183ba4100
[ 1520.633338] R13: ffff910183ba4180 R14: ffff9104da1dd000 R15: 0000000000000002
[ 1520.640517] FS:  0000000000000000(0000) GS:ffff9108afc40000(0000) knlGS:00s nfsv4 dns_resolver nfs lockd grace fscache netfs dm_service_time qedf qed 8021q garp mrp stp llc crc8 bnx2fc cnic uio rfkill libfcoe libfc scsi_transport_fc sunrpc dm_multipath intel_rapl_msr intel_rapl_common isst_if_common nfit libnvdimm x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel ipmi_ssif kvm irqbypass mgag200 rapl i2c_algo_bit intel_cstate acpi_ipmi drm_kms_helper ipmi_si syscopyarea sysfillrect sysimgblt ses fb_sys_fops intel_uncore ipmi_devintf hpilo enclosure pcspkr mei_me cec lpc_ich ipmi_msghandler mei ioatdma dca acpi_tad acpi_power_meter drm fuse xfs sd_mod t10_pi sg bnx2x crct10dif_pclmul crc32_pclmul smartpqi ghash_clmulni_intel serio_raw tg3 scsi_transport_sas uas mdio libcrc32c crc32c_intel usb_storage hpwdt wmi dm_mirror dm_region_hash dm_log dm_mod
[ 1521.104233] CPU: 25 PID: 337 Comm: kworker/25:1 Kdump: loaded Tainted: G        W I      --------- ---  5.14.0-1.el9.x86_64 #1
[ 1521.115690] Hardware name: HPE ProLiant DL380 Gen10/ProLiant DL380 Gen10, BIOS U30 11/13/2019
[ 1521.124265] Workqueue: fc_wq_7 fc_rport_final_delete [scsi_tranevice_unregister+0x13/0x60
[ 1521.515770]  bsg_unregister_queue+0x5b/0x80
[ 1521.519981]  bsg_remove_queue+0x1c/0x40
[ 1521.523843]  fc_host_remove+0x3a/0x40 [scsi_transport_fc]
[ 1521.529278]  transport_remove_classdev+0x25/0x60
[ 1521.533924]  ? transport_add_device+0x20/0x20
[ 1521.538308]  attribute_container_device_trigger+0xdb/0xf0
[ 1521.543740]  scsi_remove_host+0xcb/0x110
[ 1521.547690]  bnx2fc_destroy_work+0xb1/0xd0 [bnx2fc]
[ 1521.552603]  process_one_work+0x1e6/0x380
[ 1521.556638]  worker_thread+0x53/0x3d0
[ 1521.560324]  ? process_one_work+0x380/0x380
[ 1521.564534]  kthread+0x10f/0x130
[ 1521.567784]  ? set_kthread_struct+0x40/0x40
[ 1521.571994]  ret_from_fork+0x22/0x30
[ 1521.575596] ---[ end trace f2b9d5164555ff6b ]---
[ 1521.580363] ------------[ cut here ]------------
[ 1521.585012] sysfs group 'statistics' not found for kobject 'host7'
[ 1521.591233] WARNING: CPU: 25 PID: 881 at fs/sysfs/group.c:279 sysfs_remove_group+0x6f/0x80
[ 1521.599549] Modules linked in: bnx2i libiscsi scsi_tra
                                                         [ 1522.092284]  transport_remove_classdev+0x4c/0x60
[ 1522.096929]  ? transport_add_device+0x20/0x20
[ 1522.101312]  attribute_container_device_trigger+0xdb/0xf0
[ 1522.106745]  scsi_remove_host+0xcb/0x110
[ 1522.110691]  bnx2fc_destroy_work+0xb1/0xd0 [bnx2fc]
[ 1522.115600]  process_one_work+0x1e6/0x380
[ 1522.119635]  worker_thread+0x53/0x3d0
[ 1522.123318]  ? process_one_work+0x380/0x380
[ 1522.127527]  kthread+0x10f/0x130
[ 1522.130774]  ? set_kthread_struct+0x40/0x40
[ 1522.134983]  ret_from_fork+0x22/0x30
[ 1522.138582] ---[ end trace f2b9d5164555ff6d ]---
[ 1522.143235] ------------[ cut here ]------------
[ 1522.147880] sysfs group 'power' not found for kobject 'host7'
[ 1522.153665] WARNING: CPU: 25 PID: 881 at fs/sysfs/group.c:279 sysfs_remove_group+0x6f/0x80
[ 1522.161981] Modules linked in: bnx2i libiscsi scsi_transport_iscsi binfmt_misc rpcsec_gss_krb5 auth_rpcgss nfsv4 dns_resolver nfs lockd grace fscache netfs dm_service_time qedf qed 8021q garp mrp stp llc crc8 bnx2fc cnic uio rfkill libfcoe libfc scsi_transf 84 00 00 00 00 00 0f 1f 44 00 00
[ 1522.574042] RSP: 0018:ffffae9a04867e10 EFLAGS: 00010282
[ 1522.579299] RAX: 0000000000000000 RBX: ffffffffb7ec33e0 RCX: 0000000000000000
[ 1522.586477] RDX: ffff9108afc68480 RSI: ffff9108afc57cc0 RDI: ffff9108afc57cc0
[ 1522.593658] RBP: 0000000000000000 R08: 0000000000000000 R09: ffffae9a04867c48
[ 1522.600838] R10: ffffae9a04867c40 R11: ffffffffb8be7a48 R12: ffff9104d0bf3280
[ 1522.608015] R13: ffff9104d0bf3300 R14: 0000000000000000 R15: 0000000000000000
[ 1522.615193] FS:  0000000000000000(0000) GS:ffff9108afc40000(0000) knlGS:0000000000000000
[ 1522.623331] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 1522.629110] CR2: 00007ffe4cbd81f8 CR3: 00000004e9a6c004 CR4: 00000000007706e0
[ 1522.636288] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 1522.643467] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 1522.650647] PKRU: 55555554
[ 1522.653373] Call Trace:
[ 1522.655833]  device_del+0xb2/0x3e0
[ 1522.659257]  bnx2fc_destroy_work+0xb1/0xd0 [bnx2fc]
[ 1522.



4) Did the RHEL9 support libhbalinux and libhbaapi ? I can not find them in RHEL9 repo.

Comment 16 Chris Leech 2021-09-14 17:08:40 UTC

(In reply to guazhang from comment #15)
> HI
> 
> 
> the FCoE interface looks right, and list some interfaces with fcoeadm -i
> 
> 8: ens2f0.200-fcoe@ens2f0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc
> noqueue state UP group default qlen 1000
>     link/ether f4:e9:d4:45:5e:20 brd ff:ff:ff:ff:ff:ff
> 9: ens2f1.200-fcoe@ens2f1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc
> noqueue state UP group default qlen 1000
>     link/ether f4:e9:d4:45:5e:22 brd ff:ff:ff:ff:ff:ff
> 
> # fcoeadm -i
>     Description:      NetXtreme II BCM57810 10 Gigabit Ethernet
>     Revision:         10
>     Manufacturer:     Broadcom Inc. and subsidiaries
>     Serial Number:    F4E9D4455E20
> 
>     Driver:           bnx2x Unknown
>     Number of Ports:  1
> 
>         Symbolic Name:     bnx2fc (QLogic BCM57810) v2.12.13 over
> ens2f1.200-fcoe
>         OS Device Name:    host3
>         Node Name:         0x2000f4e9d4455e23
>         Port Name:         0x2001f4e9d4455e23
>         Fabric Name:       0x20c8002a6aa7e701
>         Speed:             10 Gbit
>         Supported Speed:   1 Gbit, 10 Gbit
>         MaxFrameSize:      2048 bytes
>         FC-ID (Port ID):   0xba0001
>         State:             Online
>     Description:      NetXtreme II BCM57810 10 Gigabit Ethernet
>     Revision:         10
>     Manufacturer:     Broadcom Inc. and subsidiaries
>     Serial Number:    F4E9D4455E20
> 
>     Driver:           bnx2x Unknown
>     Number of Ports:  1
> 
>         Symbolic Name:     bnx2fc (QLogic BCM57810) v2.12.13 over
> ens2f0.200-fcoe
>         OS Device Name:    host2
>         Node Name:         0x2000f4e9d4455e21
>         Port Name:         0x2001f4e9d4455e21
>         Fabric Name:       0x20c8002a6aa7e701
>         Speed:             10 Gbit
>         Supported Speed:   1 Gbit, 10 Gbit
>         MaxFrameSize:      2048 bytes
>         FC-ID (Port ID):   0xba0140
>         State:             Online
> 
> 
> but still hit some questions after full fcoe regression testing.
> 
> 5.14.0-1.el9.x86_64
> RHEL-9.0.0-20210907.4
> 
> 
> 1) the interface name still don't change in boot from SAN server, the fcoe
> interface bring up in anacanda, so any changes in anacanda ?
> 
> 
> 8: ens2f0200@ens2f0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc
> noqueue state UP group default qlen 1000
>     link/ether f4:e9:d4:45:34:c0 brd ff:ff:ff:ff:ff:ff
> 9: ens2f1200@ens2f1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc
> noqueue state UP group default qlen 1000
>     link/ether f4:e9:d4:45:34:c2 brd ff:ff:ff:ff:ff:ff

If this is RHEL-9.0.0-20210907.4 then it wouldn't have the new fcoe-utils package in the installer right?  So this should change in a newer compose? Could you retest with RHEL-9.0.0-20210913.7, that looks to have the updated fcoe-utils integrated.

...

> 4) Did the RHEL9 support libhbalinux and libhbaapi ? I can not find them in
> RHEL9 repo.

These have been removed, the fcoe-utils stopped using them a while back and they're dropped from RHEL 9.

Comment 17 guazhang@redhat.com 2021-09-15 03:59:58 UTC

> 
> If this is RHEL-9.0.0-20210907.4 then it wouldn't have the new fcoe-utils
> package in the installer right?  So this should change in a newer compose?
> Could you retest with RHEL-9.0.0-20210913.7, that looks to have the updated
> fcoe-utils integrated.

The question still hit in RHEL-9.0.0-20210914.1 boot from san servre.

8: ens2f0200@ens2f0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether f4:e9:d4:45:34:c0 brd ff:ff:ff:ff:ff:ff
9: ens2f1200@ens2f1: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP group default qlen 1000
    link/ether f4:e9:d4:45:34:c2 brd ff:ff:ff:ff:ff:ff

Anaconda 34.25.0.15
pykickstart v3.32

Is the warn cause the question which found in console log ?
[   24.134230] dracut-initqueue[1566]: /usr/lib/python3.9/site-packages/pykickstart/commands/fcoe.py:146: KickstartParseWarning: A FCOE device with the name ens2f0 has already been defined.  
[   24.134270] dracut-initqueue[1566]:   warnings.warn(_("A FCOE device with the name %s has already been defined.") % zd.nic, KickstartParseWarning)  
[   24.134305] dracut-initqueue[1566]: /usr/lib/python3.9/site-packages/pykickstart/commands/fcoe.py:146: KickstartParseWarning: A FCOE device with the name ens2f1 has already been defined.  
[   24.134326] dracut-initqueue[1566]:   warnings.warn(_("A FCOE device with the name %s has already been defined.") % zd.nic, KickstartParseWarning)  

https://beaker.engineering.redhat.com/recipes/10647160#task131952082
http://lab-04.rhts.eng.pek2.redhat.com/beaker/logs/recipes/10647+/10647160/console.log




about the question 2) and 3) in #15, should we open bugs to trace them ?

Comment 18 guazhang@redhat.com 2021-09-22 03:07:08 UTC

Hi,


move to verified since the fcoe_utils list all fcoe interface successful.

and open a new bug to trace the kernel error when remove fcoe  interface.
https://bugzilla.redhat.com/show_bug.cgi?id=2006606